python爬取div内容

使用Python爬虫爬取div内容可以使用以下步骤：

1. 导入所需的库：requests和BeautifulSoup

import requests
from bs4 import BeautifulSoup

2. 发送请求获取网页内容

url = 'http://example.com'
response = requests.get(url)
html = response.content

3. 解析网页内容

soup = BeautifulSoup(html, 'html.parser')

4. 找到想要的div标签

div_tag = soup.find('div', {'class': 'example-class'})

其中，'class': 'example-class'是div标签的属性，可以根据实际情况修改。

5. 获取div标签的内容

content = div_tag.text

完整代码示例：

import requests
from bs4 import BeautifulSoup

url = 'http://example.com'
response = requests.get(url)
html = response.content

soup = BeautifulSoup(html, 'html.parser')

div_tag = soup.find('div', {'class': 'example-class'})

content = div_tag.text
print(content)