Google Is Testing Its Medical AI Chatbot At the Mayo Clinic

According to the Wall Street Journal, Google is testing its Med-PaLM 2 AI chat technology at the Mayo Clinic and other hospitals. It's based on the company's PaLM 2 large language model (LLM) that underpins Bard, Google's ChatGPT rival. Engadget reports: Unlike the base model, Med-PaLM-2 has been trained on questions and answer from medical licensing exams, along with a curated set of medical expert demonstrations. That gives it expertise in answering health-related questions, and it can also do labor-intensive tasks like summarizing documents and organizing research data, according to the report. During I/O, Google released (PDF) a paper detailing its work on Med-PaLM2. On the positive side, it demonstrated features like "alignment with medical consensus," reasoning ability, and even the ability to generate answers that were preferred by respondents over physician-generated responses. More negatively, it showed the same accuracy problems we've seen on other Chat AI models. In an internal email seen by the WSJ, Google said it believes the updated model could "be of tremendous value in countries that have more limited access to doctors." Still, Google has admitted that the technology is still in its early stages. "I don't feel that this kind of technology is yet at a place where I would want it in my family's healthcare journey," said Google senior research director Greg Corrado. However, he added that the tech "takes the places in healthcare where AI can be beneficial and expands them by 10-fold."

Read more of this story at Slashdot.