python爬虫爬取网页数据

Python爬虫可以用来爬取网页数据，以下是一个简单的爬虫示例：

1. 安装必要的库：requests和beautifulsoup4

pip install requests
pip install beautifulsoup4

2. 导入库

import requests
from bs4 import BeautifulSoup

3. 发送请求并获取网页内容

url = "https://www.example.com"
response = requests.get(url)
html_content = response.content

4. 解析网页内容

soup = BeautifulSoup(html_content, 'html.parser')

5. 找到需要的数据

title = soup.title.text

完整示例代码：

import requests
from bs4 import BeautifulSoup

url = "https://www.example.com"
response = requests.get(url)
html_content = response.content

soup = BeautifulSoup(html_content, 'html.parser')
title = soup.title.text

print(title)

以上代码可以爬取"https://www.example.com"网页的标题，并将其打印出来。你可以根据需要修改代码以获取其他数据。