章鱼、壁虎与乌龟:追猎你 AI 密钥的 3 款扫描器
Octopus, Gecko and Tortoise: the 3 scanners hunting your AI keys

原始链接: https://tin.computer/blog/fake-ai-crawler-secrets-scanners

Octopus 是一个扫描器,它使用一个 canary 路径、两个随机 404 路径以及大约 300 个秘密文件请求,在约 10 秒内探测网站,并使用多种伪造或伪装的爬虫用户代理来区分真实的 .env 文件与软 404。它在 32 个用户代理之间轮换,包括未公开的 AI 机器人名称和接近真实爬虫的名称,所有请求均来自一个 Google Cloud 连接。请求使用 Accept */*、gzip、类似 Chrome 的 TLS、跟随重定向、保留用户代理并添加 Referer,表明这可能是一个使用类似 Chrome TLS 的 Go 客户端。其他观察者也报告了类似的伪造 AI 爬虫扫描;canary 路径出现在九月日志中,Octopus 于 10 月 3 日开始在作者的网站上出现,并在 10 月 16 日从 23/24 个名称扩展到 32 个。

一篇题为“章鱼、壁虎与乌龟:猎取你 AI 密钥的三款扫描器”的文章,讨论了针对暴露 AI API 密钥的扫描器。Hacker News 评论者指出,部分扫描器在日益增长的机器人流量中伪装成 AI 代理爬虫名称,更难识别。其他人对缺乏有效反击感到沮丧,尽管有人建议举报扫描或投毒响应。防御思路包括 TLS 过滤、meta-refresh 处理、Cookie 检查和 Cloudflare 防护。整体基调反映出对普遍扫描的无奈 resigned resigned?
相关文章

原文

Every Octopus visit starts the same way:

  1. 01

    The canary/z9x8c7v6b5-debug-trigger-<your hostname>

  2. 02

    Two random paths/gubgyjrd34ipmzr98uwq

  3. 03

    About 300 secret filesin about 10 seconds, each with a different crawler name

The two random paths always get a 404. Octopus probably uses them to learn what your site sends for a missing page. Then it can tell a real .env file from a page that says “not found” with a 200.

On each request, Octopus picks one of 32 user agents at random. Seven of them use names that no company documents:

DeepSeekBotGrokBotQwenbotMoonshotBotHunyuanChatGLM-SpiderBravebot

The other 25 copy real crawlers, mostly letter for letter:

GPTBotChatGPT-UserOAI-SearchBotOAI-AdsBotClaudeBotClaude-UserClaude-SearchBotPerplexityBotPerplexity-UserMeta-ExternalAgentMeta-ExternalFetcherMeta-WebIndexerApplebotAmazonbotBytespiderCCBotDuckAssistBotGooglebot ×2bingbotBaiduspiderYouBotcohere-aiKimiBotKimi-SearchBot

A typical one reads Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot. All 32 come from one machine, on one connection, within seconds. No real crawler does that.

Accept
*/*

Accept-Encoding
gzip

TLS
the same handshake as Chrome

Redirects
follows them, keeps the user agent, adds a Referer

Network
Google Cloud, AS396982, *.bc.googleusercontent.com

Its handshake is the same as Chrome’s. It follows redirects, keeps the user agent and adds a Referer. That is how Go’s standard HTTP client behaves. We think Octopus is a Go program with a Chrome-like TLS library.

Other site owners have seen it. GreyNoise, Fastly and Cequence reported scanners with fake AI crawler names on Google Cloud, and the canary path is in public logs from September. On our sites it started on 3 October. Until 16 October it used 23 or 24 names, including PanguBot/1.0, YiBot/1.0 and MistralAI-User. It then went to 32.

联系我们 contact @ memedata.com