Amazon uses kid’s dead grandma in morbid demo of Alexa audio deepfake

Enlarge / The 4th-gen Amazon Echo Dot smart speaker. (credit: Amazon)

Amazon is figuring out how to make its Alexa voice assistant deepfake the voice of anyone, dead or alive, with just a short recording. The company demoed the feature at its re:Mars conference in Las Vegas on Wednesday, using the emotional trauma of the ongoing pandemic and grief to sell interest.

Amazon's re:Mars focuses on artificial intelligence, machine learning, robotics, and other emerging technologies, with technical experts and industry leaders taking the stage. During the second-day keynote, Rohit Prasad, senior vice president and head scientist of Alexa AI at Amazon, showed off a feature being developed for Alexa.

After noting the large amount of lives lost during the pandemic, Prasad played a video demo, where a child asks Alexa, "Can grandma finish reading me Wizard of Oz?" Alexa responds, "Okay," in her typical effeminate, robotic voice. But next, the voice of the child's grandma comes out of the speaker to read L. Frank Baum's tale.

Read 15 remaining paragraphs | Comments