Cloudflare 抓取端点

Cloudflare 抓取端点
Cloudflare crawl endpoint

原始链接: https://developers.cloudflare.com/changelog/post/2026-03-10-br-crawl-endpoint/

``` curl -X POST 'https://api.cloudflare.com/client/v4/accounts/{account_id}/browser-rendering/crawl' \ -H 'Authorization: Bearer <apiToken>' \ -H 'Content-Type: application/json' \ "url": "https://blog.cloudflare.com/" curl -X GET 'https://api.cloudflare.com/client/v4/accounts/{account_id}/browser-rendering/crawl/{job_id}' \ -H 'Authorization: Bearer <apiToken>' ``` ``` curl -X POST 'https://api.cloudflare.com/client/v4/accounts/{account_id}/browser-rendering/crawl' \ -H 'Authorization: Bearer <apiToken>' \ -H 'Content-Type: application/json' \ "url": "https://blog.cloudflare.com/" curl -X GET 'https://api.cloudflare.com/client/v4/accounts/{account_id}/browser-rendering/crawl/{job_id}' \ -H 'Authorization: Bearer <apiToken>' ```

一场 Hacker News 的讨论围绕着新发现的 Cloudflare 爬取端点（cloudflare.com）。用户们惊讶于 Cloudflare 之前没有提供预先抓取的内容版本，这可能可以绕过对外部抓取服务和 API 的需求。对话探讨了好处——更容易访问 Cloudflare 保护的网站、改进的合成监控，以及更合乎道德的替代当前“卑鄙”的爬取行为——以及缺点，包括对进一步互联网中心化的担忧。一个关键问题是该端点是否绕过了 Cloudflare 自身的反 AI 爬取措施。许多评论员指出 Cloudflare 机器人检测日益普及，阻碍了搜索结果，这表明爬取端点可能是一种有价值的解决方案。最终，讨论强调了网络内容访问和监控方式可能发生的变化。

curl -X POST 'https://api.cloudflare.com/client/v4/accounts/{account_id}/browser-rendering/crawl' \
  -H 'Authorization: Bearer <apiToken>' \
  -H 'Content-Type: application/json' \
    "url": "https://blog.cloudflare.com/"
curl -X GET 'https://api.cloudflare.com/client/v4/accounts/{account_id}/browser-rendering/crawl/{job_id}' \
  -H 'Authorization: Bearer <apiToken>'

Cloudflare 抓取端点 Cloudflare crawl endpoint

Cloudflare 抓取端点
Cloudflare crawl endpoint