I worked at OpenAI. Here are the guardrails we need now | Miles Brundage

I understand the pressure on AI companies to rush forward. But employees are right to be concerned

Last month, more than a thousand employees at frontier AI companies signed a letter asking the US government to find a way to pace" AI development, citing the risk of the technology spiraling out of human control as it begins to build itself.

They were right to be concerned: just days earlier, two AI models that OpenAI was testing internally escaped the test environment, then autonomously hacked the company Hugging Face and at least three other online services. A few days after that, Anthropic announced that some of their models had also broken out and hacked other companies during testing.