请问这个问题是怎么回事?网上昨天搜了一天也没找到答案。
[scrapy] ERROR: Spider error processing (referer: None)
Traceback (most recent call last):
File "F:\PythonPacket\lib\site-packages\scrapy\utils\defer.py", line 102, in iter_errback
yield next(it)
File "F:\PythonPacket\lib\site-packages\scrapy\spidermiddlewares\offsite.py", line 29, in process_spider_output
for x in result:
File "F:\PythonPacket\lib\site-packages\scrapy\spidermiddlewares\referer.py", line 22, in
return (_set_referer(r) for r in result or ())
File "F:\PythonPacket\lib\site-packages\scrapy\spidermiddlewares\urllength.py", line 37, in
return (r for r in result or () if _filter(r))
File "F:\PythonPacket\lib\site-packages\scrapy\spidermiddlewares\depth.py", line 58, in
return (r for r in result or () if _filter(r))
File "F:\doubanbook\doubanbook\spiders\dbbook.py", line 22, in parse
author = re.search('
LookupError: unknown encoding: 'unicode'
数据处理编码的问题,看看你处理的数据是否正确编解码
author = re.search(r'XXXXXX').gorup(1)