爬虫 AJAX加载数据(JSON)

获取JSON是最简单的,直接输入URL就好了不须要写爬虫。O(∩_∩)O哈哈~
豆瓣电影javascript

#!/usr/bin/env python
# -*- coding:utf-8 -*-
import ssl
import urllib
import urllib2

url = "https://movie.douban.com/j/search_subjects?type=tv&tag=%E7%83%AD%E9%97%A8&sort=recommend"
headers = {
    "Accept": "application/json, text/javascript, */*; q=0.01",
    "X-Requested-With": "XMLHttpRequest",
    "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.99 Safari/537.36",
    "Content-Type": "application/x-www-form-urlencoded; charset=UTF-8",
}
formdate = {"page_limit": "20", "page_start": "0"}
data = urllib.urlencode(formdate)
request = urllib2.Request(url, data=data, headers=headers)
context = ssl._create_unverified_context()  # 忽略SSL安全认证
reponse = urllib2.urlopen(request, context=context)
print reponse.read()

Chrome浏览器按F12

相关文章
相关标签/搜索