已经通过页面分析找到了request 的 url,但是运行代码报错:
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(54, 'Connection reset by peer'))
返回是:
{"message":"ObjectID does not exist","status":404}
import requests
url = "https://su5v69fjoj-3.algolianet.com/1/indexes/Organization_203_production/query?x-algolia-agent=Algolia%20for%20JavaScript%20(3.35.1)%3B%20Browser%20(lite)&x-algolia-application-id=SU5V69FJOJ&x-algolia-api-key=a4971670ebc5d269725bb3d7639f9c3d"
hd = {
"User-Agent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.131 Safari/537.36",
"accept": "application/json",
"Accept-Encoding": "gzip, deflate, br",
"Accept-Language": "zh-CN,zh;q=0.9,en-US;q=0.8,en;q=0.7",
"Connection": "keep-alive",
"Content-Length": "239",
"content-type": "application/x-www-form-urlencoded",
"Host": "su5v69fjoj-dsn.algolia.net",
"Origin": "https://jobs.polychain.capital",
"Referer": "https://jobs.polychain.capital/"
}
resp = requests.post(url,headers = hd)
print(resp.status_code)
print(resp.json())
哪里思路不对?
客户端似乎已连接到服务器,但[Errno 104] Connection reset by peer在尝试发送数据时遇到了“ ”异常。Python第一次引发“[Errno 104] Connection reset by peer”异常,然后第二次和更多你会在客户端得到“[Errno 32] Broken pipe”异常。
这可能意味着服务器已启动并正在侦听端口(否则,您会得到“ [Errno 111] Connection refused" exception on the client side”。这也意味着服务器在关闭连接之前崩溃了,因为如果在客户端发送数据之前在服务器端关闭了连接一边,客户端会遇到“ [Errno 32] Broken pipe”异常。
404页面未找到,url地址错了。有用就请点击采纳哦
你要爬什么
import requestsurl = "https://su5v69fjoj-dsn.algolia.net/1/indexes/*/queries?x-algolia-agent=Algolia%20for%20JavaScript%20(3.35.1)%3B%20Browser%20(lite)&x-algolia-application-id=SU5V69FJOJ&x-algolia-api-key=a4971670ebc5d269725bb3d7639f9c3d"payload = "{\"requests\":[{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2217154%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2227096%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2212317%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2226901%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2212021%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2221912%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2213831%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2232337%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2215830%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2227619%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2230080%22)\"},{\"indexName\":\"Job_203_production\",\"params\":\"attributesToRetrieve=%5B%22id%22%2C%22organization.id%22%5D&hitsPerPage=1&filters=(organization.id%3A%2212320%22)\"}]}"headers = { 'Content-Type': 'text/plain'}response = requests.request("POST", url, headers=headers, data=payload)print(response.text)
崇拜哥的话,就点击采纳吧,,关注也可以哦。