Python爬取食品商务网
时间: 2023-11-05 09:21:28 浏览: 49
Python爬取食品商务网的代码如下所示:
```python
import requests
import parsel
import csv
import time
# 导入工具
import requests
import parsel
import csv
import time
# 保存数据
f = open('data.csv', mode='a', encoding='utf-8-sig', newline='')
csv_write = csv.DictWriter(f, fieldnames=['品种', '平均价格', '趋势'])
csv_write.writeheader()
# 爬取数据
for page in range(1, 19):
time.sleep(1)
url = 'https://price.21food.cn/guoshu-p{}.html'.format(page)
headers = {
'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36'
}
response = requests.get(url=url, headers=headers)
selector = parsel.Selector(response.text)
lis = selector.css('.gs_top_t2_left div:nth-child(1) .sjs_top_cent_erv ul li')
dit = {}
for li in lis:
name = li.css('a::text').get()
dit['品种'] = name
price = li.css('td span::text').get()
dit['平均价格'] = price
qushi = li.css('td .sc_up::text').get()
if qushi == None:
dit['趋势'] = '下降'
else:
dit['趋势'] = qushi
csv_write.writerow(dit)
print(dit)
```
该代码使用了Python中的requests、parsel和csv等库,通过发送HTTP请求获取网页源代码,使用CSS选择器对所需数据进行提取,并将提取到的数据写入CSV文件中。<span class="em">1</span><span class="em">2</span><span class="em">3</span>
#### 引用[.reference_title]
- *1* *2* *3* [Python爬取食品商务网蔬菜价格数据,看看蔬菜最近的价格情况](https://blog.csdn.net/m0_48405781/article/details/108640273)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_2"}}] [.reference_item style="max-width: 100%"]
[ .reference_list ]