AI models just don't understand what they're talking about

Researchers find models' success at tests hides illusion of understanding

Researchers from MIT, Harvard, and the University of Chicago have proposed the term "potemkin understanding" to describe a newly identified failure mode in large language models that ace conceptual benchmarks but lack the true grasp needed to apply those concepts in practice....