Python爬虫3个网页轮流请求报错requests.exceptions

共3网页A,B,C

依次登录A,B,C→从表格中读取两行参数分别设置给A,B→间隔等待2分钟→通过读取的参数在C上面查询→判断查询是否成功  ###到这里没问题

然后从表格里读取第三四行参数→在设置A的时候就报错了

使用except Exception获取异常,提示'Connection aborted.', RemoteDisconnected('Remote end closed connection without response',最早用的request,后面改成3个session去post

post的json参数有5个,分别为method params id session params2

用网页设置时id和params2在变,但是上一个请求的响应里面并没有对应的参数,id递增,params2固定,Referer也加在头部里了,还是不行

Traceback (most recent call last):
  File "****\venv\lib\site-packages\urllib3\connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "****\venv\lib\site-packages\urllib3\connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "****\venv\lib\site-packages\urllib3\connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "D:\Python\Python37\lib\http\client.py", line 1321, in getresponse
    response.begin()
  File "D:\Python\Python37\lib\http\client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "D:\Python\Python37\lib\http\client.py", line 265, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "****\venv\lib\site-packages\requests\adapters.py", line 449, in send
    timeout=timeout
  File "****\venv\lib\site-packages\urllib3\connectionpool.py", line 756, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "****\venv\lib\site-packages\urllib3\util\retry.py", line 531, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "****\venv\lib\site-packages\urllib3\packages\six.py", line 734, in reraise
    raise value.with_traceback(tb)
  File "****\venv\lib\site-packages\urllib3\connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "****\venv\lib\site-packages\urllib3\connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "****\venv\lib\site-packages\urllib3\connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "D:\Python\Python37\lib\http\client.py", line 1321, in getresponse
    response.begin()
  File "D:\Python\Python37\lib\http\client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "D:\Python\Python37\lib\http\client.py", line 265, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "****/****.py", line 255, in <module>
    setid = session2.post(setidurl, headers=req_header1, data=json.dumps(setiddata1), timeout=20)
  File "****\venv\lib\site-packages\requests\sessions.py", line 590, in post
    return self.request('POST', url, data=data, json=json, **kwargs)
  File "****\venv\lib\site-packages\requests\sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "****\venv\lib\site-packages\requests\sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "****\venv\lib\site-packages\requests\adapters.py", line 498, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

 

http.client.RemoteDisconnected: Remote end closed connection without response

远程主动关闭了链接。

还有你说的等待2分钟是什么意思  HTTP都是无状态的 ,不能等待,都是你发请求 然后取回数据,如果后面你没有再取数据,那链接就断了