import requests
from bs4 import BeautifulSoup
url = 'https://www.shicimingju.com/book/sanguoyanyi.html'
headers = {"user-agent": "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.198 Safari/537.36"}
url = "https://www.shicimingju.com/book/sanguoyanyi.html"
response = requests.get(url=url,headers=headers).content.decode('utf-8')
soup = BeautifulSoup(response,'lxml')
print("正在请求章节内容")
gettitle = soup.select("#main>#main_left>.book-mulu a").text
print(title)
C:\Users\Administrator\AppData\Local\Programs\Python\Python310\python.exe E:/编程/python/作品/实验/pycharm项目/爬虫/爬取三国演义.py
Traceback (most recent call last):
File "E:\编程\python\作品\实验\pycharm项目\爬虫\爬取三国演义.py", line 7, in <module>
soup = BeautifulSoup(response,'lxml').select("#main>#main_left>.book-mulu a").text
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\site-packages\bs4\element.py", line 2253, in __getattr__
raise AttributeError(
AttributeError: ResultSet object has no attribute 'text'. You're probably treating a list of elements like a single element. Did you call find_all() when you meant to call find()?
Process finished with exit code 1
soup.select("#main>#main_left>.book-mulu a")返回的是一个列表, 要加[0]访问列表的第一元素的.text
另外.book-mulu 不是#main_left 的直接子元素 #main_left>.book-mulu
中 >
要改成空格 #main_left .book-mulu
gettitle = soup.select("#main>#main_left .book-mulu a")[0].text
要输出所有章节内容是
li = soup.select("#main>#main_left .book-mulu a")
for v in li:
print(v.text)
你题目的解答代码如下:
import requests
from bs4 import BeautifulSoup
url = 'https://www.shicimingju.com/book/sanguoyanyi.html'
headers = {"user-agent": "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.198 Safari/537.36"}
url = "https://www.shicimingju.com/book/sanguoyanyi.html"
response = requests.get(url=url,headers=headers).content.decode('utf-8')
soup = BeautifulSoup(response,'lxml')
print("正在请求章节内容")
gettitle = soup.select("#main>#main_left .book-mulu a")[0].text
print(gettitle)
print("循环输出章节内容")
li = soup.select("#main>#main_left .book-mulu a")
for v in li:
print(v.text)
如有帮助,请点击我的回答下方的【采纳该答案】按钮帮忙采纳下,谢谢!