问题遇到的现象和发生背景

豆瓣简单 初学案例

问题相关代码，请勿粘贴

import requests, bs4

引用requests库

url = 'https://movie.douban.com/top250?start=0&filter=%27
res = requests.get(url)
bs = bs4.BeautifulSoup(res.text, 'html.parser')

print(bs.text)

运行结果及报错内容

空白

我的解答思路和尝试过的方法

我想要达到的结果

缺少请求头user-agent，被反扒了没返回内容，要加上

import requests
import bs4
url = 'https://movie.douban.com/top250?start=0&filter='
headers={'user-agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.60 Safari/537.36 Edg/100.0.1185.29'}
res = requests.get(url,headers=headers)
bs = bs4.BeautifulSoup(res.text, 'html.parser')

print(bs.text)

import requests
import bs4
headers = {
        'User-agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.75 Safari/537.36',
        'Cookie':'bid=0gxKQx_R-nk; ll="118282"; __utmz=30149280.1639544253.1.1.utmcsr=baidu|utmccn=(organic)|utmcmd=organic; __utmz=223695111.1639544253.1.1.utmcsr=baidu|utmccn=(organic)|utmcmd=organic; __gads=ID=8b00cd5b0d0633f9-225854da6ecf0098:T=1639544253:RT=1639544253:S=ALNI_MY1CVt09yesPSG_8A55RXf4FO2Ufg; _vwo_uuid_v2=D2D2E8518E29B4353608B39DA5E80D70D|8d6c4905d79c08854ce3a4780f8005ae; _pk_ref.100001.4cf6=["","",1649296971,"https://www.baidu.com/link?url=umSkxYT8g6nLv_SF-AwUZRnjrH0z1jnnDP5POQZ9uHp_ySINGNs_esA6sMLf90XKHxZgXL1vjXrAEYBKCXpkVyo-DtPG_Y1BtrlV0dlRZHO&wd=&eqid=dd521d650000fbe40000000661b975b8"]; _pk_id.100001.4cf6=4622a6c4829c702f.1639544252.2.1649296971.1639544252.; _pk_ses.100001.4cf6=*; ap_v=0,6.0; __utma=30149280.597044920.1639544253.1639544253.1649296971.2; __utmc=30149280; __utma=223695111.312908571.1639544253.1639544253.1649296971.2; __utmb=223695111.0.10.1649296971; __utmc=223695111; __utmt_t1=1; __utmb=30149280.3.8.1649296971; RT=s=1649296975544&r=https://movie.douban.com/top250?start=0&filter=%27'
}
urls = 'https://movie.douban.com/top250?start=0&filter=%27'
res = requests.get(urls,headers=headers).text
bs = bs4.BeautifulSoup(res,'html.parser')

print(bs)

爬虫要加请求头的。。。

您好，我是有问必答小助手，您的问题已经有小伙伴帮您解答，感谢您对有问必答的支持与关注！
PS：问答VIP年卡 【限时加赠：IT技术图书免费领】，了解详情>>> https://vip.csdn.net/askvip?utm_source=1146287632