sefinek/known-bots-ip-whitelist
GitHub: sefinek/known-bots-ip-whitelist
聚合了 25 种以上知名爬虫和服务的官方 IP 地址列表，每 6 小时自动更新，支持多格式下载，方便用于白名单或黑名单配置。
Stars: 22 | Forks: 1
# 🤖 已知爬虫 IP 白名单
此仓库包含已知机器人和爬虫的 IP 地址最新列表，适用于网络流量的白名单或过滤。它们也可以用作黑名单。
您有任何问题，或者希望接收关于我的仓库重要更改或新功能的通知吗？
加入我的 [Discord 服务器](https://discord.gg/S7NDzCzQTg)！如果您不使用 Discord，也可以在 GitHub 上开启一个 issue。
该项目采用 [MIT 许可证](LICENSE) 发布 — 您可以随意使用它。
如果您喜欢这个仓库，请留下一个 Star ⭐。谢谢！
## ⏱️ 更新计划
列表每 `6 hours`（小时）更新一次。
## 🌍 支持的服务
| Service | Sources | Downloads |
|--------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| AhrefsBot | [api.ahrefs.com](https://api.ahrefs.com/v3/public/crawler-ips) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/ahrefsbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/ahrefsbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/ahrefsbot/ips.json) |
| BetterStack | [uptime.betterstack.com](https://uptime.betterstack.com/ips.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/betterstack/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/betterstack/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/betterstack/ips.json) |
| BingBot | [www.bing.com](https://www.bing.com/toolbox/bingbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/bingbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/bingbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/bingbot/ips.json) |
| Bunny CDN | [IPv4](https://api.bunny.net/system/edgeserverlist/plain) & [IPv6](https://api.bunny.net/system/edgeserverlist/ipv6) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/bunnycdn/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/bunnycdn/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/bunnycdn/ips.json) |
| Censys | RIPEstat & RADB & ARIN | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/censys/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/censys/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/censys/ips.json) |
| Cloudflare | [IPv4](https://www.cloudflare.com/ips-v4) & [IPv6](https://www.cloudflare.com/ips-v6) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/cloudflare/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/cloudflare/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/cloudflare/ips.json) |
| DuckDuckBot | [duckduckgo.com](https://duckduckgo.com/duckduckbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/duckduckbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/duckduckbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/duckduckbot/ips.json) |
| FacebookBot | RIPEstat & RADB & ARIN | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/facebookbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/facebookbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/facebookbot/ips.json) |
| Google Special Crawlers | [developers.google.com](https://developers.google.com/search/apis/ipranges/special-crawlers.json) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/google-special-crawlers/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/google-special-crawlers/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/google-special-crawlers/ips.json) |
| Google User-Triggered Fetchers | [Fetchers](https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers.json) & [Google](https://developers.google.com/search/apis/ipranges/user-triggered-fetchers-google.json) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/google-user-triggered-fetchers/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/google-user-triggered-fetchers/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/google-user-triggered-fetchers/ips.json) |
| GoogleBot | [developers.google.com](https://developers.google.com/static/search/apis/ipranges/googlebot.json) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/googlebot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/googlebot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/googlebot/ips.json) |
| Kagi | [Custom lists](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/custom/kagi.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/kagi/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/kagi/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/kagi/ips.json) |
| Modat Scanner | [scanner.modat.io](https://scanner.modat.io/ipv4.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/modat/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/modat/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/modat/ips.json) |
| NASK PL | RIPEstat & RADB | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/nask/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/nask/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/nask/ips.json) |
| OpenAI | [GitHub](https://raw.githubusercontent.com/FabrizioCafolla/openai-crawlers-ip-ranges/main/openai/openai-ip-ranges-all.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/openai/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/openai/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/openai/ips.json) |
| Palo Alto Networks | RADB & ARIN | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/paloaltonetworks/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/paloaltonetworks/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/paloaltonetworks/ips.json) |
| PingdomBot | [IPv4](https://my.pingdom.com/probes/ipv4) & [IPv6](https://my.pingdom.com/probes/ipv6) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/pingdombot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/pingdombot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/pingdombot/ips.json) |
| Pulsetic | [IPv4](https://api.pulsetic.com/ip-ranges.txt) & [IPv6](https://api.pulsetic.com/ipv6-ranges.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/pulsetic/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/pulsetic/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/pulsetic/ips.json) |
| RSS API | [rssapi.net](https://rssapi.net/ips.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/rssapi/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/rssapi/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/rssapi/ips.json) |
| Semrush | RIPEstat & RADB | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/semrush/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/semrush/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/semrush/ips.json) |
| Shodan | [Custom lists](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/custom/shodan.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/shodan/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/shodan/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/shodan/ips.json) |
| Stripe | [stripe.com](https://stripe.com/files/ips/ips_webhooks.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/stripewebhook/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/stripewebhook/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/stripewebhook/ips.json) |
| TelegramBot | [core.telegram.org](https://core.telegram.org/resources/cidr.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/telegrambot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/telegrambot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/telegrambot/ips.json) |
| UptimeRobot | [uptimerobot.com](https://uptimerobot.com/inc/files/ips/IPv4andIPv6.txt) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/uptimerobot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/uptimerobot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/uptimerobot/ips.json) |
| WebPageTest Bot | [www.webpagetest.org](https://www.webpagetest.org/addresses.php?f=json) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/webpagetestbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/webpagetestbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/webpagetestbot/ips.json) |
| YandexBot | [yandex.com](https://yandex.com/ips) | [TXT](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/yandexbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/yandexbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/yandexbot/ips.json) |
## 📘 所有 IP 地址列表
### 📄 TXT
```
https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/all-safe-ips.txt
```
#### Curl
```
curl -fsS --max-redirs 0 -o all-safe-ips.txt https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/all-safe-ips.txt
```
### 📑 CSV
```
https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/all-safe-ips.csv
```
#### Curl
```
curl -fsS --max-redirs 0 -o all-safe-ips.csv https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/all-safe-ips.csv
```
### 🔤 JSON
```
https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/all-safe-ips.json
```
#### Curl
```
curl -fsS --max-redirs 0 -o all-safe-ips.json https://raw.githubusercontent.com/sefinek/known-bots-ip-whitelist/main/lists/all-safe-ips.json
```
标签：Bingbot, CDN, Docker 部署, Googlebot, Homebrew安装, IP地址库, IP白名单, IP黑名单, Streamlit, SYN扫描, Web安全, 域名解析, 威胁情报, 开发者工具, 机器人检测, 流量过滤, 网络安全, 网络运维, 自动化更新, 自定义脚本, 自定义脚本, 蓝队分析, 访问控制, 防火墙规则, 隐私保护