According to the report [PDF], Facebook owner Meta's AI division accounts for more than half of those crawlers, while OpenAI accounts for the overwhelming majority of on-demand fetch requests.

Darrow is striking it rich by scouring the internet for corporate misdeeds. But one of its revenue sources—sharing legal awards—raises ethical concerns among some lawyers.