[I 160902 23:03:21 result_worker:49] result_worker starting...
Web server running on port 25555
[I 160902 23:03:28 processor:208] processor starting...
c:\python27\lib\site-packages\flask\exthook.py:71: ExtDeprecationWarning: Importing flask.ext.login is deprecated, use flask_login instead.
.format(x=modname), ExtDeprecationWarning
[I 160902 23:03:32 scheduler:569] scheduler starting...
[I 160902 23:03:33 scheduler:508] in 5m: new:0,success:0,retry:0,failed:0
Exception in thread Thread-4:
Traceback (most recent call last):
File "c:\python27\lib\threading.py", line 801, in bootstrap_inner
self.run()
File "c:\python27\lib\threading.py", line 754, in run
self.target(*self.__args, **self.__kwargs)
File "c:\python27\lib\site-packages\click\core.py", line 534, in invoke
return callback(*args, **kwargs)
File "c:\python27\lib\site-packages\click\decorators.py", line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File "c:\python27\lib\site-packages\pyspider\run.py", line 240, in fetcher
poolsize=poolsize, proxy=proxy, async=async)
File "c:\python27\lib\site-packages\pyspider\fetcher\tornado_fetcher.py", line 85, in init
self.ioloop = tornado.ioloop.IOLoop()
File "c:\python27\lib\site-packages\tornado\util.py", line 278, in new
instance.initialize(*args, **init_kwargs)
File "c:\python27\lib\site-packages\tornado\platform\select.py", line 76, in initialize
super(SelectIOLoop, self).initialize(impl=_Select(), **kwargs)
File "c:\python27\lib\site-packages\tornado\ioloop.py", line 705, in initialize
self._waker = Waker()
File "c:\python27\lib\site-packages\tornado\platform\common.py", line 44, in init
self.writer.connect(connect_address)
File "c:\python27\lib\socket.py", line 228, in meth
return getattr(self._sock,name)(*args)
error: [Errno 10060]
单独开个窗口,启动scheduler ,命令应该是pyspider scheduler ,记不太清楚了。要么重新启动,这个爬虫的稳定性我觉的还是有点问题,但启动起来还是比较好用的。
pyspider all 并没有启动所有功能,
我用的windows出现了相似情况,尝试用管理员启动命令提示符,然后 输入命令 pyspider all 解决了问题,
我的也是不能启动所有服务 关机重启后才能启动