AI Localization Tool Claims to Translate Your Words in Your Voice
upstart writes in with an IRC submission for guy_:
AI localization tool claims to translate your words in your voice:
Localization is a tricky issue for all content creators. It can take significant time and resources to make their work fully accessible to folks who speak different languages. One company thinks it has cracked part of that code with an artificial intelligence system that automatically translates speech into other languages in the same speaker's voice.
Resemble AI says its Localize tool can keep voices consistent in various languages in movies, games, audiobooks, corporate videos and other formats. Google is working on similar tech, but we haven't heard much about that since it published a paper on the Translatotron system last year.
[...] For now, Localize can translate speech between English, French, German, Dutch, Italian and Spanish. There are plans to add Korean, Japanese and Mandarin to the mix in the near future.
Resemble AI says Localize can translate recordings in a way that accurately reflects the speaker's words and meanings. The system, it claims, can turn the original audio into speech that uses colloquialisms and grammar structures of a certain region and language.
No mention is made about trying to lip-synch the vocalizations.
Read more of this story at SoylentNews.