Cloudflare's Bot Control for Content Creators

Bloomberg Technology
34
0
In a significant development for website owners, Cloudflare has announced new features that help content creators control access to their sites by automated bots, particularly those used by large language models (LLMs). Roughly 50% of website traffic is generated by bots, and of that, LLMs account for approximately 25%. This means a considerable volume of online content is frequently scraped and utilized without the creators' knowledge or compensation. Cloudflare's new functionalities allow website owners to gain visibility into bot traffic and manage access to their content effectively. They can choose to block or permit specific bot traffic based on their preferences. In addition, Cloudflare aims to implement a marketplace where content creators can receive compensation for their contributions, thus creating a fairer dynamic for those producing original content online. Furthermore, despite rumors of collaboration with Brazilian authorities regarding the accessibility of Xe (formerly known as Twitter) in Brazil, Cloudflare clarified that their service was simply adopted by Xe, leading to a change in IP addresses that temporarily affected accessibility. The recent enhancements signify a broader movement towards empowering content creators as online environments evolve and a response to the growing power of automated systems on the web.
Highlights
  • • Cloudflare introduces new features for content owners.
  • • 50% of website traffic is generated by bots.
  • • 25% of bot traffic comprises large language models (LLMs).
  • • Content creators can now control bot access to their sites.
  • • Cloudflare provides visibility into how content is accessed.
  • • Website owners can block or permit specific bot traffic.
  • • Cloudflare plans to create a content marketplace for creators.
  • • Large media companies are primary users of these new tools.
  • • Cloudflare clarified its non-involvement with Brazilian authorities.
  • • IP address changes influenced Xe's accessibility in Brazil.
* dvch2000 helped DAVEN to generate this content on 09/24/2024 .

More news