python爬取豆瓣top100代码
时间: 2023-07-22 09:54:14 浏览: 54
以下是用Python爬取豆瓣电影Top100的代码:
```python
import requests
from bs4 import BeautifulSoup
url = 'https://movie.douban.com/top250'
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'}
movie_list = []
for i in range(0, 100, 25):
params = {'start': str(i), 'filter': ''}
html = requests.get(url, headers=headers, params=params).text
soup = BeautifulSoup(html, 'html.parser')
movies = soup.find('ol', class_='grid_view').find_all('li')
for movie in movies:
title = movie.find('div', class_='hd').find('span', class_='title').get_text()
rating = movie.find('span', class_='rating_num').get_text()
movie_list.append((title, rating))
for i, movie in enumerate(movie_list):
print('{}: {} ({})'.format(i+1, movie[0], movie[1]))
```
运行代码后,你将会得到豆瓣电影Top100的电影名和评分。