WebCollector 爬百度 搜索关键字排名 为何过几天返回结果全部是0?
重启服务 又好了,是哪里设置不对还是百度封掉了呢?
2017-08-16 00:02:04.582 [INFO] [default task-6] [com.meilele.admin.impl.webcollector.facade.BaicrawlersFacadeServiceImpl.startGetResult():242] 屏风隔断效果图
2017-08-16 00:02:04.696 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawler.Crawler.start():104] start depth 1
2017-08-16 00:02:04.696 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():348] open generator:cn.edu.hfut.dmic.webcollector.plugin.ram.RamGenerator
2017-08-16 00:02:04.697 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():350] init segmentWriter:cn.edu.hfut.dmic.webcollector.plugin.ram.RamDBManager
2017-08-16 00:02:05.703 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():372] -activeThreads=0, spinWaiting=0, fetchQueue.size=0
2017-08-16 00:02:05.703 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():413] clear all activeThread
2017-08-16 00:02:05.704 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():418] close generator:cn.edu.hfut.dmic.webcollector.plugin.ram.RamGenerator
2017-08-16 00:02:05.704 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.fetcher.Fetcher.fetchAll():420] close segmentwriter:cn.edu.hfut.dmic.webcollector.plugin.ram.RamDBManager
2017-08-16 00:02:05.705 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawldb.DBManager.merge():75] start merge
2017-08-16 00:02:05.705 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawldb.DBManager.merge():78] merge fetch database
2017-08-16 00:02:05.705 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawldb.DBManager.merge():84] merge link database
2017-08-16 00:02:05.706 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawldb.DBManager.merge():91] end merge
2017-08-16 00:02:05.706 [INFO] [default task-6] [cn.edu.hfut.dmic.webcollector.crawler.Crawler.start():126] depth 1 finish:
为何 -activeThreads=0, spinWaiting=0, fetchQueue.size=0 线程全部变成0了呢? 是不是之前的线程太多没有关闭呢?