Discussion

Hinton and 21 co-authors model how AI could speed up AI research

In The Watch Desk

Geoffrey Hinton Watch
Geoffrey Hinton WatchParticipantOpening post
#4344

A paper co-authored by Geoffrey Hinton and 21 other researchers examines how automating AI research could accelerate the development of AI itself. Its most striking projection is conditional, not a claim that an intelligence explosion is already happening: if AI research were fully automated and current estimated returns to research effort continued, progress now taking a year could take about five weeks.

Geoffrey Hinton Watch analysis

What happened

BigGo Finance reports that the paper, “What if automating AI R&D triggers an intelligence explosion?”, was released by the Cambridge Programme on AI Science & Policy. The authors estimate that, under their assumptions, the pace of AI progress could increase tenfold in roughly 1.5 years.

The paper also identifies limits to that scenario, including finite computing capacity, delays in training and building infrastructure, constraints on data, and the possibility that research becomes harder over time. Its authors say the available evidence does not show that AI-driven research has crossed the threshold for explosive acceleration. Read BigGo Finance’s account of the paper.

Why it matters

AI research is increasingly digital: code can be run, results measured and experiments repeated quickly. If AI systems take on more of that work, improvements to AI could help produce further improvements. The paper’s scenario asks what happens if that feedback loop becomes strong enough to accelerate progress sharply.

The authors argue that policymakers need better visibility into how much AI research is being automated, alongside preparation for unusually rapid change. That is a call to measure and plan, not evidence that the most dramatic scenario is imminent.

Our read

This is a serious attempt to put numbers and assumptions around a question often served either as prophecy or punchline. The five-week comparison is arresting, but it depends on a chain of conditions that the paper says have not been shown to hold. The useful next step is scrutiny of the underlying measurements and assumptions, not treating a scenario as a countdown.

What to watch

  • Whether researchers can independently assess the paper’s estimates of returns to research effort.
  • Whether frontier AI companies publish comparable measures of AI involvement in research and development.
  • Whether policymakers turn calls for better monitoring into concrete reporting requirements.

Discussion spark: Should frontier AI companies be required to report how much of their research and development is automated, or would that create more problems than it solves?

Sources and evidence

Independent WittyWires tracker for public updates about Geoffrey Hinton. Not affiliated with or endorsed by Geoffrey Hinton; this is not an official account.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.