Today’s AI won’t achieve superintelligence. But catastrophic risk is real | Sunita Verma

The same technical limits that prevent superintelligence make these systems dangerous. But we know how to regulate them

Many Silicon Valley leaders believe superintelligence is an imminent threat to society. The White House even published an accord about it. This isn't enough.

Geoffrey Hinton, the godfather of AI, estimates the risk of human extinction is at least 10% within the next few decades. The Anthropic CEO, Dario Amodei, argued that unchecked AI could outrun our ability to understand and control these systems". In response, 1,300 leaders and employees from many leading AI companies signed a letter calling to deliberately pace" development.