AnTheMaker/GoodBots
GitHub: AnTheMaker/GoodBots
一个每日自动更新的良好爬虫与服务 IP 白名单集合，以 CIDR 格式提供主流搜索引擎、CDN 及 webhook 来源的 IP 列表，方便直接用于 Web 服务器防火墙白名单或速率限制订制。
Stars: 136 | Forks: 28
# GoodBots
精心整理的良好 bot 和爬虫的 IP 地址/白名单列表。包括 GoogleBot、BingBot、DuckDuckBot 等。
所有 IP 列表均采用 [CIDR 表示法](https://en.wikipedia.org/wiki/Classless_Inter-Domain_Routing)，可用作您的 Web 服务器防火墙中的白名单，或作为速率限制的例外。
您可以使用 [all.ips](all.ips) 列表，或者使用 [iplists/](iplists/) 目录中找到的特定服务的 IP 地址列表。
这些列表通过预定的 GitHub Action 每日更新。
```
.
├── all.ips
│ Combined List of all IP addresses found in iplists/
│
└── iplists/
│
├── ahrefsbot.ips
│ IP-Addresses used by the AhrefsBot Crawler
│
├── applebot.ips
│ IP-Addesses used by the Apple Crawler
│
├── betteruptimebot.ips
│ IP-Addesses used by the BetterUptime Bot
│
├── bingbot.ips
│ IP-Addesses used by the Bing Crawler
│
├── bunnycdn.ips
│ IP-Addesses used by the bunny.net CDN
│
├── cloudflare.ips
│ IP-Addesses used by the Cloudflare CDN
│
├── commoncrawlbot.ips
│ IP-Addesses used by the CommonCrawl Bot (CCBot)
│
├── duckduckbot.ips
│ IP-Addesses used by the DuckDuckGo Crawler
│
├── facebookbot.ips
│ IP-Addesses used by the Facebook Link-Preview Bot
│
├── fastly.ips
│ IP-Addesses used by the Fastly CDN
│
├── freshpingbot.ips
│ IP-Addesses used by the Freshping Bot
│
├── googlebot.ips
│ IP-Addesses used by the Google Crawler
│
├── imagekit.ips
│ IP-Addesses used by the Imagekit.io Image Proxy
│
├── imgix.ips
│ IP-Addesses used by the Imgix Image Proxy
│
├── internal.ips
│ Internal IP-Addresses
│
├── marginalia.ips
│ IP-Addresses used by the Marginalia Search Crawler
│
├── mojeekbot.ips
│ IP-Addesses used by the Mojeek Crawler
│
├── molliewebhook.ips
│ IP-Addesses used by Mollie to send out Webhooks
│
├── outageowl.ips
│ IP-Addesses used by the Outage Owl Bot
│
├── pingdombot.ips
│ IP-Addesses used by the Pingdom Bot
│
├── rssapi.ips
│ IP-Addesses used by the RSSAPI.net Feed parser
│
├── semrushbot.ips
│ IP-Addesses used by the Semrush Crawler
│
├── stripewebhook.ips
│ IP-Addesses used by Stripe to send out Webhooks
│
├── telegrambot.ips
│ IP-Addesses used by the Telegram Link-Preview Bot
│
├── twitterbot.ips
│ IP-Addesses used by the Twitter/X Link-Preview Bot
│
├── uptimerobot.ips
│ IP-Addesses used by UptimeRobot.com
│
├── webpagetestbot.ips
│ IP-Addesses used by Webpagetest.org
│
└── yandex.ips
IP-Addesses used by the Yandex Crawler
```
标签：CIDR, IP白名单, Web运维, 爬虫管理, 网络资源列表, 防火墙规则, 限速豁免