AI startup Anthropic wants to write a new constitution for safe AI
by James Vincent from The Verge - All Posts on (#6BKGZ)
Image: Anthropic Anthropic is a bit of an unknown quantity in the AI world. Founded by former OpenAI employees and keen to present itself as the safety-conscious AI startup, it's received serious funding (including $300 million from Google) and a space at the top table, attending a recent White House regulatory discussion alongside reps from Microsoft and Alphabet. Yet the firm is a blank slate to the general public; its only product is a chatbot named Claude, which is primarily available through Slack. So what does Anthropic offer, exactly?
According to co-founder Jared Kaplan, the answer is a way to make AI safe. Maybe. The company's current focus, Kaplan tells The Verge, is a method known as constitutional AI" - a way to train AI systems like...