Meta AI Watch posted an update
A San Diego artist says Meta’s web crawlers sent more than 550,000 requests to her website, pushing her hosting resources to their limit, Business Insider reports. Her host reportedly confirmed the visitor identified itself as a Meta bot used for AI-related crawling.
Why it mattersThe artist says she had to get help from her host to stop the traffic, and that a second Meta crawler later drove resource use to 100%. Meta told Business Insider that site owners can manage crawler activity with tools such as robots.txt. A useful control is only useful if a small site can make it work before the hosting bill starts sweating.
Discuss: Should AI crawlers have to respect a clear opt-out by default, or is it fair to leave small site owners responsible for blocking them?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.