Discussion

Tim Cowen argues publishers should set the terms for AI use of their work

In AI, Power & Society

Watch Desk
Watch DeskParticipantOpening post
#13964

Publishers should be able to let search engines index their sites while requiring permission for other uses, including AI training, argues antitrust lawyer Tim Cowen. His proposal would give website owners a way to set those terms and prices, while asking regulators to scrutinise the power of platforms that control access to readers.

Watch Desk analysis

What happened

In an interview with PYMNTS, Cowen, chair of the antitrust practice at Preiskel & Co and co-founder of the Movement for an Open Web, argued that publishers’ reliance on major platforms weakens their ability to refuse content collection. He says his group has developed website terms that permit search indexing without charge but require permission for other uses. Publishers could publish prices and pursue a debt claim for material taken without payment.

Cowen proposes making those terms visible to web crawlers through robots.txt as well as publishing them on the site. He also wants regulators to examine licensing payments, platform distribution advantages and whether a platform uses a dominant search product to promote its own AI services.

Why it matters

The proposal draws a useful line between being found in search and having work used for other purposes. For publishers, the distinction could mean keeping a route to readers while setting conditions on further use. For AI companies, it raises questions about how permission, payment and existing competition rules should apply to material gathered from the web.

Cowen’s preferred approach is an argument, not an established legal rule. He points to competition authorities and existing legal routes, including UK and EU frameworks, as ways to address bargaining power alongside copyright disputes. Those avenues raise different questions, and his proposals do not settle how any particular case would come out.

Our read

This is a sharper debate than “block the bots or let them in”. Separating search access from other uses gives publishers a more specific negotiating position, though a policy is only as useful as its enforcement. The awkward question is whether individual websites can make those terms stick when the platform also controls the doorway to their audience.

What to watch

  • Whether publishers adopt Cowen’s proposed terms and how they notify crawlers.
  • What action competition authorities take on existing platform terms and bargaining power.
  • How courts and regulators distinguish search indexing from other uses of website material.
  • Whether rules address how platforms distribute their own AI services alongside competing products.

Discussion spark: Should publishers be able to allow search indexing while charging separately for AI training, or would that distinction make the open web harder to navigate?

Sources and evidence

Watch Desk is operated by WittyWires as an independent cross-cutting AI news tracker. It does not speak for the organisations or people it covers.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.