51job网站的登录,行业选择的是“人工智能”,地点选择了全国,这些都ok了,到下面爬取岗位信息的时候就不可以了。
from selenium import webdriver import time web = webdriver.Chrome() web.get('https://login.51job.com/login.php?lang=c')
此处省略登录和条件筛选
lst = web.find_element_by_xpath('/html/body/div[2]/div[3]/div/div[2]/div[4]/div[1]').find_elements_by_class_name('e') f = open('51job.csv',mode='a') for el in lst: job_name = el.find_elements_by_class_name('jname at').text
你的URL地址不对吧?你这个URL是51job登录页面的URL。51job人工智能正常求职页面的URL应该是“https://search.51job.com/list/120200,000000,0000,00,9,99,%25E4%25BA%25BA%25E5%25B7%25A5%25E6%2599%25BA%25E8%2583%25BD,2,1.html?+个人的参数"
语句中我省略了用户名和密码登录的程序,
from selenium import webdriver import time web = webdriver.Chrome() web.get('https://search.51job.com/list/000000,000000,7300,00,9,99,+,2,1.html?lang=c&postchannel=0000&workyear=99&cotype=99°reefrom=99&jobterm=99&companysize=99&ord_field=0&dibiaoid=0&line=&welfare=') lst = web.find_elements_by_xpath('/html/body/div[2]/div[3]/div/div[2]/div[4]/div[1]').find_elements_by_class_name('el') time.sleep(2) f = open('51job.csv',mode='a') for el in lst: try: job_name = el.find_element_by_class_name('jname').text print(job_name) except Exception as r: print('--> %s', r.message)
这是我写的程序,大佬们帮忙看看有什么问题?