sefinek/trusted-ips-whitelist
GitHub: sefinek/trusted-ips-whitelist
这是一个收录已知合法爬虫、监控服务和基础设施提供商 IP 地址的数据仓库，帮助管理员识别可信流量。
Stars: 30 | Forks: 2
# 🤖 已知机器人 IP 白名单
本仓库包含已知机器人和爬虫的最新 IP 地址列表，可用于白名单或过滤网络流量，也可作为黑名单使用。
有任何问题或想接收有关我的仓库重要变更和新功能通知吗？
加入我的 [Discord 服务器](https://discord.gg/S7NDzCzQTg)！如果您不使用 Discord，也可以在 GitHub 上提交 issue。
本项目采用 [MIT 许可证](LICENSE) 发布，您可以随意使用。
如果您喜欢这个仓库，请留下一个 star ⭐。谢谢！
| 🔄 更新频率 | 📋 变更日志 |
|:-------------------:|:----------------------------:|
| 每 `6 小时` | [CHANGELOG.md](CHANGELOG.md) |
## 🌍 支持的服务
### 🤖 爬虫
搜索引擎、SEO 工具和网页测试机器人。
| 服务 | 来源 | 下载 |
|--------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| GoogleBot | [developers.google.com](https://developers.google.com/static/crawling/ipranges/common-crawlers.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/googlebot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/googlebot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/googlebot/ips.json) |
| Google 特殊爬虫 | [developers.google.com](https://developers.google.com/static/crawling/ipranges/special-crawlers.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-special-crawlers/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-special-crawlers/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-special-crawlers/ips.json) |
| Google 用户触发式抓取器 | [Fetchers](https://developers.google.com/static/crawling/ipranges/user-triggered-fetchers.json) 和 [Google](https://developers.google.com/static/crawling/ipranges/user-triggered-fetchers-google.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-user-triggered-fetchers/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-user-triggered-fetchers/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-user-triggered-fetchers/ips.json) |
| BingBot | [www.bing.com](https://www.bing.com/toolbox/bingbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bingbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bingbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bingbot/ips.json) |
| DuckDuckBot | [duckduckgo.com](https://duckduckgo.com/duckduckbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/duckduckbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/duckduckbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/duckduckbot/ips.json) |
| YandexBot | [yandex.com](https://yandex.com/ips) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/yandexbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/yandexbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/yandexbot/ips.json) |
| FacebookBot | RIPEstat 和 RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/facebookbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/facebookbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/facebookbot/ips.json) |
| Applebot | [search.developer.apple.com](https://search.developer.apple.com/applebot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/applebot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/applebot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/applebot/ips.json) |
| Kagi | [自定义列表](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/custom/kagi.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/kagi/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/kagi/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/kagi/ips.json) |
| AhrefsBot | [api.ahrefs.com](https://api.ahrefs.com/v3/public/crawler-ips) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/ahrefsbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/ahrefsbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/ahrefsbot/ips.json) |
| Semrush | RIPEstat 和 RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/semrush/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/semrush/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/semrush/ips.json) |
| WebPageTest 机器人 | [www.webpagetest.org](https://www.webpagetest.org/addresses.php?f=json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/webpagetestbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/webpagetestbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/webpagetestbot/ips.json) |
### 🧠 人工智能
大型语言模型提供商的人工智能爬虫。
| 服务 | 来源 | 下载 |
|------------------|------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| ClaudeBot | [claude.com](https://claude.com/crawling/bots.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/claudebot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/claudebot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/claudebot/ips.json) |
| GPTBot | [openai.com](https://openai.com/gptbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/gptbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/gptbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/gptbot/ips.json) |
| OpenAI SearchBot | [openai.com](https://openai.com/searchbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/oai-searchbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/oai-searchbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/oai-searchbot/ips.json) |
| ChatGPT 用户 | [openai.com](https://openai.com/chatgpt-user.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/chatgpt-user/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/chatgpt-user/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/chatgpt-user/ips.json) |
| PerplexityBot | [perplexity.ai](https://www.perplexity.ai/perplexitybot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexitybot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexitybot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexitybot/ips.json) |
| Perplexity 用户 | [perplexity.ai](https://www.perplexity.ai/perplexity-user.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexity-user/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexity-user/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexity-user/ips.json) |
### 📡 监控
正常运行时间监控服务和互联网扫描器。
| 服务 | 来源 | 下载 |
|---------------|-------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| BetterStack | [uptime.betterstack.com](https://uptime.betterstack.com/ips.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/betterstack/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/betterstack/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/betterstack/ips.json) |
| PingdomBot | [IPv4](https://my.pingdom.com/probes/ipv4) 和 [IPv6](https://my.pingdom.com/probes/ipv6) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pingdombot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pingdombot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pingdombot/ips.json) |
| Pulsetic | [IPv4](https://api.pulsetic.com/ip-ranges.txt) 和 [IPv6](https://api.pulsetic.com/ipv6-ranges.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pulsetic/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pulsetic/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pulsetic/ips.json) |
| UptimeRobot | [uptimerobot.com](https://uptimerobot.com/inc/files/ips/IPv4andIPv6.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/uptimerobot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/uptimerobot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/uptimerobot/ips.json) |
| Censys | RIPEstat 和 RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/censys/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/censys/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/censys/ips.json) |
| Modat Scanner | [scanner.modat.io](https://scanner.modat.io/ipv4.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/modat/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/modat/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/modat/ips.json) |
| Shodan | [自定义列表](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/custom/shodan.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/shodan/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/shodan/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/shodan/ips.json) |
### 🏗️ 基础设施
CDN 提供商、托管网络、DNS 解析器和网络服务。
| 服务 | 来源 | 下载 |
|--------------------|----------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Cloudflare | [IPv4](https://www.cloudflare.com/ips-v4) 和 [IPv6](https://www.cloudflare.com/ips-v6) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/cloudflare/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/cloudflare/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/cloudflare/ips.json) |
| Bunny CDN | [IPv4](https://api.bunny.net/system/edgeserverlist/plain) 和 [IPv6](https://api.bunny.net/system/edgeserverlist/ipv6) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bunnycdn/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bunnycdn/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bunnycdn/ips.json) |
| Canonical | RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/canonical/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/canonical/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/canonical/ips.json) |
| NASK PL | RIPEstat 和 RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/nask/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/nask/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/nask/ips.json) |
| Palo Alto Networks | RIPEstat、RADB 和[自定义列表](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/custom/paloaltonetworks.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/paloaltonetworks/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/paloaltonetworks/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/paloaltonetworks/ips.json) |
| DNS 解析器 | [自定义列表](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/custom/dns-resolvers.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/dns-resolvers/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/dns-resolvers/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/dns-resolvers/ips.json |
| Stripe | [stripe.com](https://stripe.com/files/ips/ips_webhooks.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/stripewebhook/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/stripewebhook/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/stripewebhook/ips.json) |
| TelegramBot | [core.telegram.org](https://core.telegram.org/resources/cidr.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/telegrambot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/telegrambot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/telegrambot/ips.json) |
| RSS API | [rssapi.net](https://rssapi.net/ips.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/rssapi/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/rssapi/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/rssapi/ips.json) |
## 📘 合并的 IP 列表
### 🔀 全部（所有类别）
| 格式 | 网址 |
|--------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.csv) |
### 🤖 仅爬虫
| 格式 | 网址 |
|--------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.csv) |
### 🧠 仅人工智能
| 格式 | 网址 |
|--------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.csv) |
### 📡 仅监控
| 格式 | 网址 |
|--------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.csv) |
### 🏗️ 仅基础设施
| 格式 | 网址 |
|--------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.csv) |
标签：Bingbot, Bots白名单, CDN防护, Cloudflare, FacebookBot, Googlebot, Homebrew安装, IP白名单, IP管理, MITRE ATT&CK, SEO工具, TelegramBot, Web安全, 反爬虫, 合法爬虫, 威胁情报, 开发者工具, 搜索引擎优化, 机器人识别, 流量过滤, 爬虫IP, 爬虫检测, 网络安全, 网络安全研究, 网络防护, 自定义脚本, 蓝队分析, 隐私保护