AI models just don't understand what they're talking about
Researchers find models' success at tests hides illusion of understanding Researchers from MIT, Harvard, and the University of Chicago have proposed the term "potemkin understanding" to describe a newly identified failure mode in large language models that ace conceptual benchmarks but lack the true grasp needed to apply those concepts in practice....