京东的robots.txt打不开
时间: 2023-09-03 13:16:12 浏览: 106
京东的robots.txt打不开可能是因为该网站没有公开提供robots.txt文件,或者该文件被设置为不可访问。根据引用中提供的信息,京东网址为https://jd.com/robots.txt,但是我们无法访问该网址,可能是因为京东没有公开提供robots.txt文件。请注意,不是所有的网站都会提供robots.txt文件,这并不影响搜索引擎对网站的抓取和索引。<span class="em">1</span><span class="em">2</span><span class="em">3</span>
#### 引用[.reference_title]
- *1* *3* [【安全狐】robots协议详解(robots.txt)](https://blog.csdn.net/weixin_44893633/article/details/109374079)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_1"}}] [.reference_item style="max-width: 50%"]
- *2* [一些有趣的Robots协议](https://blog.csdn.net/weixin_43328024/article/details/105296459)[target="_blank" data-report-click={"spm":"1018.2226.3001.9630","extra":{"utm_source":"vip_chatgpt_common_search_pc_result","utm_medium":"distribute.pc_search_result.none-task-cask-2~all~insert_cask~default-1-null.142^v93^chatsearchT3_1"}}] [.reference_item style="max-width: 50%"]
[ .reference_list ]