Key points
- Geoffrey Hinton states the global competition to make AI smarter is driven by profit motives rather than safety.
- He warned in September that US Congress may have only one year to implement safeguards before AI becomes uncontrollable.
- Hinton expressed distrust in leaders like Elon Musk and Mark Zuckerberg, citing their characters as a danger to the sector.
Geoffrey Hinton wrote in The i Paper that humanity’s future is at risk due to the rapid, profit-driven development of artificial intelligence. The computer scientist described the current trajectory as hurtling out of control, with an extremely uncertain future ahead for the species.Geoffrey Hinton says the rush to build smarter AI for money is dangerous because we aren't planning for how to live with superintelligent machines.Hinton argues that the incentive structure for capability gains is misaligned with safety, creating an uncertain trajectory for human-AI coexistence.
How we got here
Hinton left Google in 2023, after which he began publicly discussing the dangers associated with AI technology. He is widely recognized for his foundational work on artificial neural networks and is referred to as a Nobel Prize laureate in the report.
What is new
In his recent commentary, Hinton identified the competition between nations and companies as the primary driver of AI advancement. He noted that entities are striving to make systems increasingly intelligent to replace workers and generate revenue, which he argues puts the future of humanity on the line.
Reading between the lines
Hinton questioned why so little effort is directed toward defining the non-intelligent traits of future AI systems. He suggested that humans will need to share the planet with entities smarter than themselves, yet the industry is not adequately planning for what those relationships should look like.
The open questions
The central tension lies in the gap between the speed of capability gains and the lack of safety planning. Hinton claims the deadline for control is always getting closer, but he does not specify a technical threshold for when AI becomes uncontrollable. His warning relies on the assertion that current incentives prioritize profit over alignment, leaving the specific mechanisms of potential harm undefined in this report.
Why it matters
- Evaluators must assess whether current benchmarking captures the non-intelligent traits Hinton says are being ignored.
- Hinton warned Congress it may have only one year to implement safeguards, highlighting a perceived urgency in policy action.
- Hinton stated it is dangerous that the world relies on AI companies due to the characters of leaders like Musk and Zuckerberg.
- Hinton noted that the drive to replace workers and make money is what is currently pushing AI development forward.
Topics: AI safety, Geoffrey Hinton, policy, neural networks
Updated
Then / now / next
Hinton worked at Google and remained relatively quiet about AI risks.
He publicly warns that the profit-driven race for smarter AI puts humanity at risk.
Observers will watch for congressional action on safeguards within the timeframe Hinton suggested.
Story timeline
- Then Hinton worked at Google and remained relatively quiet about AI risks.
- Now He publicly warns that the profit-driven race for smarter AI puts humanity at risk.
- Next Observers will watch for congressional action on safeguards within the timeframe Hinton suggested.
The strongest doubt
Counterpoint from the sources
Hinton acknowledges that experts debate the timeline for when AI will surpass human intelligence, indicating uncertainty about the immediacy of the threat.
For readers
Researchers
- Hinton notes a lack of work on defining non-intelligent traits for future AI systems.
- The profit motive may be diverting resources away from safety research.
Policy
- Hinton warned Congress has a short window to implement AI safeguards.
- He cited the need for regulatory action before technology becomes uncontrollable.
Investors
- Hinton expressed distrust in the characters of major AI company leaders.
- He warned that the current competitive dynamic is driven by replacing workers.
Did this article give you the evidence you needed?
Your choice stays on this device. No public tally.Questions readers ask
Why does Hinton think AI development is dangerous?
He believes the race to make AI smarter for profit ignores safety and leaves humanity’s future uncertain.
What timeline did Hinton give for AI safeguards?
He warned in September that the US Congress may have only one year to act before AI becomes uncontrollable.
Who does Hinton distrust in the AI industry?
He named Elon Musk and Mark Zuckerberg, saying he would not buy a used car from them due to their characters.
Connected stories
Reading receipt
- Geoffrey Hinton states the global competition to make AI smarter is driven by profit motives rather than safety.
- He warned in September that US Congress may have only one year to implement safeguards before AI becomes uncontrollable.
- Hinton expressed distrust in leaders like Elon Musk and Mark Zuckerberg, citing their characters as a danger to the sector.
