Anthropic leapfrogs OpenAI with a chatbot that can read a novel in less than a minute
by James Vincent from The Verge - All Posts on (#6BPV8)
Image: Anthropic An often overlooked limitation for chatbots is memory. While it's true that the AI language models that power these systems are trained on terabytes of text, the amount these systems can process when in use - that is, the combination of input text and output, also known as their context window" - is limited. For ChatGPT it's around 3,000 words. There are ways to work around this, but it's still not a huge amount of information to play with.
Now, AI startup Anthropic (founded by former OpenAI engineers) has hugely expanded the context window of its own chatbot Claude, pushing it to around 75,000 words. As the company points out in a blog post, that's enough to process the entirety of The Great Gatsby in one go. In fact, the company...