Meta自建AI搜索狂扫全网，已经把独立开发者服务器爬报警

Meta自建AI搜索狂扫全网，已经把独立开发者服务器爬报警

2026-08-08 15:07

ChainThink 消息，8 月 8 日，独立开发者 Pieter Levels 称，Meta 本周高频抓取其旗下多个网站，用于 AI 搜索索引建设，其中一台 VPS 已多次触发负载报警。

DataDome 数据显示，今年第二季度，Meta 两只 AI 爬虫合计发出 91 亿次请求。

其中，负责建立搜索索引的 Meta-WebIndexer 单季请求量增长 163%，6 月请求量首次超过训练爬虫。

Meta 早在 2024 年被曝自建搜索引擎，以降低 Meta AI 对 Google 和 Bing 的依赖。

一名 Meta 员工匿名私信称，公司希望建设自己的“Google”，避免将 AI 搜索请求交给 Google 后被用于训练；该说法尚未获 Meta 证实。

Meta自建AI搜索狂扫全网，已经把独立开发者服务器爬报警

Disclaimer: Contains third-party opinions, does not constitute financial advice

Recommended Reading

Amazon announces a multi-billion dollar investment in Missouri to build a data center campus, expected to create over 400 long-term positions

06-16
Amazon announces a multi-billion dollar investment in Missouri to build a data center campus, expected to create over 400 long-term positions

Elon Musk's current personal net worth has risen to the range of $1.1 trillion to $1.2 trillion.

06-15
Elon Musk's current personal net worth has risen to the range of $1.1 trillion to $1.2 trillion.

OpenAI and Anthropic Employees Cash Out $14 Billion in Five Years

06-15
OpenAI and Anthropic Employees Cash Out $14 Billion in Five Years

Tencent Involved in Investment in Lin Junyang's AI Lab, Former Head of Alibaba's Qwen, Valued at $2 Billion

06-15
Tencent Involved in Investment in Lin Junyang's AI Lab, Former Head of Alibaba's Qwen, Valued at $2 Billion

Binance will delist the CVC/USDC, RPL/USDC, RVN/USDC, and XAI/USDC leveraged trading pairs on June 19

06-15
Binance will delist the CVC/USDC, RPL/USDC, RVN/USDC, and XAI/USDC leveraged trading pairs on June 19

U.S. Security Experts Unite to Urge Repeal of Anthropic Ban, Warn That Restricting Defensive Tools Will Lose the AI Race Against China

06-15
U.S. Security Experts Unite to Urge Repeal of Anthropic Ban, Warn That Restricting Defensive Tools Will Lose the AI Race Against China

Musk vows SpaceX revenue to reach $1 trillion by 2030

06-15
Musk vows SpaceX revenue to reach $1 trillion by 2030