python webdriver爬虫如何处理json

python webdriver爬虫如何处理json

img


用request模块请求会返回403,加了请求头还是一样的,这种情况用webdriver吗?但是我不知道怎么获得data
https://www.coollpet.com/api/comment-list?show_product=1&star_least=4&with_photo=1&limit=100
这个是请求的链接,或许有大佬知道怎么解决这个网站禁止访问的问题吗

链接怎么打不开,实在突破不了禁止就用webdriver


import requests


headers = {
    "authority": "www.coollpet.com",
    "accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9",
    "accept-language": "zh-CN,zh;q=0.9",
    "cache-control": "no-cache",
    "pragma": "no-cache",
    "referer": "https://ask.csdn.net/",
    "sec-ch-ua": "\"Google Chrome\";v=\"107\", \"Chromium\";v=\"107\", \"Not=A?Brand\";v=\"24\"",
    "sec-ch-ua-mobile": "?0",
    "sec-ch-ua-platform": "\"macOS\"",
    "sec-fetch-dest": "document",
    "sec-fetch-mode": "navigate",
    "sec-fetch-site": "cross-site",
    "sec-fetch-user": "?1",
    "upgrade-insecure-requests": "1",
    "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
}
cookies = {
    "client_id": "1670404802816322",
    "_c_id": "1670404802816208659",
    "awesomeab": "ywgd12449-panther-v22s11s1%2Cywgd12431-loong-v22s51s4",
    "__cf_bm": "2IpVBug2Sj56kAhpXpI3hlLoumOl3KpFbY8BgRvMpxo-1670404802-0-Ae/0ROAid+HnhES+urE6eEJTcGlFFqMFvqM840bUEnOOHnqvMk0A3ORGqEI0Nx77pKJqsQK38fFvvN5NH/xNoaQ="
}
url = "https://www.coollpet.com/api/comment-list"
params = {
    "show_product": "1",
    "star_least": "4",
    "with_photo": "1",
    "limit": "100"
}
response = requests.get(url, headers=headers, cookies=cookies, params=params)

print(response.text)
print(response)

你说的不知到如何获取data,是不知道怎么用python去操作json文件吗?

https://blog.csdn.net/weixin_44940593/article/details/127011198?spm=1001.2014.3001.5502
?%ra=card