sefinek/trusted-ips-whitelist
GitHub: sefinek/trusted-ips-whitelist
这是一个收录已知合法爬虫、监控服务和基础设施提供商 IP 地址的数据仓库，帮助管理员识别可信流量。
Stars: 35 | Forks: 4
# 🤖 已知机器人 IP 白名单
本仓库包含已知机器人和爬虫的最新 IP 地址列表，可用于对网络流量进行白名单过滤或一般过滤。它们也可以用作黑名单。
本项目基于 [MIT license](LICENSE) 发布 — 你可以随意使用。
如果你喜欢这个仓库，请留下一个 Star ⭐。谢谢！
| 🔄 更新频率 | 📋 更新日志 |
|:-------------------:|:----------------------------:|
| 每 `6 小时` | [CHANGELOG.md](CHANGELOG.md) |
## 📘 综合 IP 列表
### 🔀 全部 (11,522 个 IP, 5,458 个 CIDR)
| 格式 | URL |
|--------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-safe-ips.csv) |
### 🤖 仅爬虫 (9,908 个 IP, 3,614 个 CIDR)
| 格式 | URL |
|--------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-crawlers-ips.csv) |
### 🧠 仅 AI (0 个 IP, 336 个 CIDR)
| 格式 | URL |
|--------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-ai-ips.csv) |
### 📡 仅监控 (565 个 IP, 84 个 CIDR)
| 格式 | URL |
|--------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-monitoring-ips.csv) |
### 🏗️ 仅基础设施 (1,049 个 IP, 1,424 个 CIDR)
| 格式 | URL |
|--------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| TXT | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.txt](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.txt) |
| JSON | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.json](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.json) |
| CSV | [raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.csv](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/all-infrastructure-ips.csv) |
## 🌍 支持的服务
### 🤖 爬虫 (9,908 个 IP, 3,614 个 CIDR)
搜索引擎、SEO 工具和 Web 测试机器人。
| 服务 | IP 和 CIDR | 来源 | 下载 |
|--------------------------------|-------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| GoogleBot | 0 - 311 | [developers.google.com](https://developers.google.com/static/crawling/ipranges/common-crawlers.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/googlebot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/googlebot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/googlebot/ips.json) |
| Google Special Crawlers | 0 - 266 | [developers.google.com](https://developers.google.com/static/crawling/ipranges/special-crawlers.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-special-crawlers/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-special-crawlers/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-special-crawlers/ips.json) |
| Google User-Triggered Fetchers | 0 - 1,504 | [Fetchers](https://developers.google.com/static/crawling/ipranges/user-triggered-fetchers.json) & [Google](https://developers.google.com/static/crawling/ipranges/user-triggered-fetchers-google.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-user-triggered-fetchers/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-user-triggered-fetchers/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/google-user-triggered-fetchers/ips.json) |
| BingBot | 0 - 28 | [www.bing.com](https://www.bing.com/toolbox/bingbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bingbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bingbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bingbot/ips.json) |
| DuckDuckBot | 0 - 319 | [duckduckgo.com](https://duckduckgo.com/duckduckbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/duckduckbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/duckduckbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/duckduckbot/ips.json) |
| YandexBot | 0 - 16 | [yandex.com](https://yandex.com/ips) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/yandexbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/yandexbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/yandexbot/ips.json) |
| FacebookBot | 0 - 1,041 | RIPEstat & RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/facebookbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/facebookbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/facebookbot/ips.json) |
| Applebot | 0 - 12 | [search.developer.apple.com](https://search.developer.apple.com/applebot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/applebot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/applebot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/applebot/ips.json) |
| Kagi | 4 - 0 | [自定义列表](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/custom/kagi.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/kagi/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/kagi/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/kagi/ips.json) |
| AhrefsBot | 9,870 - 0 | [api.ahrefs.com](https://api.ahrefs.com/v3/public/crawler-ips) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/ahrefsbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/ahrefsbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/ahrefsbot/ips.json) |
| Semrush | 0 - 7 | RIPEstat & RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/semrush/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/semrush/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/semrush/ips.json) |
| WebPageTest Bot | 35 - 0 | [www.webpagetest.org](https://www.webpagetest.org/addresses.php?f=json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/webpagetestbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/webpagetestbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/webpagetestbot/ips.json) |
### 🧠 AI (0 个 IP, 336 个 CIDR)
来自大型语言模型提供商的 AI 爬虫。
| 服务 | IP 和 CIDR | 来源 | 下载 |
|------------------|-------------|-----------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| ClaudeBot | 0 - 20 | [claude.com](https://claude.com/crawling/bots.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/claudebot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/claudebot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/claudebot/ips.json) |
| GPTBot | 0 - 21 | [openai.com](https://openai.com/gptbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/gptbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/gptbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/gptbot/ips.json) |
| OpenAI SearchBot | 0 - 35 | [openai.com](https://openai.com/searchbot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/oai-searchbot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/oai-searchbot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/oai-searchbot/ips.json) |
| ChatGPT User | 0 - 240 | [openai.com](https://openai.com/chatgpt-user.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/chatgpt-user/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/chatgpt-user/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/chatgpt-user/ips.json) |
| PerplexityBot | 0 - 8 | [perplexity.ai](https://www.perplexity.ai/perplexitybot.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexitybot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexitybot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexitybot/ips.json) |
| Perplexity User | 0 - 4 | [perplexity.ai](https://www.perplexity.ai/perplexity-user.json) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexity-user/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexity-user/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/perplexity-user/ips.json) |
### 📡 监控 (565 个 IP, 84 个 CIDR)
正常运行时间监控服务和互联网扫描器。
| 服务 | IP 和 CIDR | 来源 | 下载 |
|---------------|-------------|-------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| BetterStack | 34 - 0 | [uptime.betterstack.com](https://uptime.betterstack.com/ips.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/betterstack/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/betterstack/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/betterstack/ips.json) |
| PingdomBot | 152 - 0 | [IPv4](https://my.pingdom.com/probes/ipv4) & [IPv6](https://my.pingdom.com/probes/ipv6) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pingdombot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pingdombot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pingdombot/ips.json) |
| Pulsetic | 48 - 2 | [IPv4](https://api.pulsetic.com/ip-ranges.txt) & [IPv6](https://api.pulsetic.com/ipv6-ranges.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pulsetic/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pulsetic/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/pulsetic/ips.json) |
| UptimeRobot | 232 - 0 | [uptimerobot.com](https://uptimerobot.com/inc/files/ips/IPv4andIPv6.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/uptimerobot/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/uptimerobot/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/uptimerobot/ips.json) |
| Censys | 0 - 36 | RIPEstat & RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/censys/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/censys/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/censys/ips.json) |
| Modat Scanner | 0 - 37 | [scanner.modat.io](https://scanner.modat.io/ipv4.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/modat/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/modat/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/modat/ips.json) |
| Shodan | 95 - 6 | [自定义列表](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/custom/shodan.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/shodan/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/shodan/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/shodan/ips.json) |
### 🏗️ 基础设施 (1,049 个 IP, 1,424 个 CIDR)
CDN 提供商、托管网络、DNS 解析器和 Web 服务。
| 服务 | IP 和 CIDR | 来源 | 下载 |
|--------------------|-------------|----------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Cloudflare | 0 - 22 | [IPv4](https://www.cloudflare.com/ips-v4) & [IPv6](https://www.cloudflare.com/ips-v6) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/cloudflare/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/cloudflare/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/cloudflare/ips.json) |
| Bunny CDN | 906 - 0 | [IPv4](https://api.bunny.net/system/edgeserverlist/plain) & [IPv6](https://api.bunny.net/system/edgeserverlist/ipv6) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bunnycdn/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bunnycdn/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/bunnycdn/ips.json) |
| Canonical | 0 - 37 | RIPEstat & RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/canonical/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/canonical/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/canonical/ips.json) |
| NASK PL | 0 - 642 | RIPEstat & RADB | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/nask/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/nask/ips.csv) • [JSON](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/nask/ips.json) |
| Palo Alto Networks | 0 - 93 | RIPEstat, RADB & [自定义列表](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/custom/paloaltonetworks.txt) | [TXT](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/paloaltonetworks/ips.txt) • [CSV](https://raw.githubusercontent.com/sefinek/trusted-ips-whitelist/main/lists/paloaltonetworks/ips.csv) • [JSON](
标签：Docker 部署, IP白名单, 流量过滤, 网络爬虫, 网络运维, 自定义脚本