ElevenLabs and NVIDIA Unveil Multilingual AI Voice Technology at Computex

ElevenLabs, in partnership with NVIDIA, has introduced groundbreaking multilingual AI voice technology at Computex. This innovative collaboration was demonstrated by NVIDIA founder and CEO Jensen Huang, who delivered portions of his keynote in both English and Mandarin using ElevenLabs’ advanced AI voice technology, according to ElevenLabs Blog.

Revolutionizing Keynote Presentations

Traditionally, keynote presentations have relied on live translators or subtitles to cater to multilingual audiences. This paradigm is shifting as ElevenLabs’ AI voice technology enables speakers to deliver presentations in multiple languages while preserving their unique vocal traits. Jensen Huang’s delivery of his Computex keynote in both English and Mandarin is a testament to this technology’s capabilities. Remarkably, the AI voice was created in under an hour using only seven minutes of recorded audio.

This advancement not only broadens content accessibility but also allows for the creation of new, previously unimaginable experiences. By leveraging AI, presentations can now reach a global audience more effectively, making significant strides in international communication and engagement.

Enhancing Video Game NPCs

Beyond keynote presentations, ElevenLabs and NVIDIA are collaborating to enhance the realism of non-playable characters (NPCs) in video games. Traditionally, NPC interactions have been limited and scripted. With ElevenLabs’ AI, developers can create NPCs that exhibit human-like reactions and adapt to player actions, offering a more immersive and engaging gaming experience.

The NVIDIA ACE (Avatar, Cloud, and Edge) suite is at the heart of this innovation. ACE combines generative AI with advanced computing to bring digital humans to life. This suite offers ACE NIM microservices, which developers can integrate into their games and applications to create interactive avatars and AI-powered NPCs. The Covert Protocol tech demo showcases these capabilities, featuring NPCs with lifelike voices and behaviors.

Industry Impact and Future Prospects

The impact of this technology extends beyond gaming and presentations. It holds promise for various sectors, including real-time interactions, accessibility, and personalized content creation. ElevenLabs CEO and co-founder Mati Staniszewski highlighted the transformative potential of this collaboration, stating, “The work NVIDIA and ElevenLabs are doing is reshaping our interactions with the world and the content that can be created – from real-time interactions and gaming, to presentations and accessibility.”

Staniszewski further emphasized NVIDIA’s role in building the infrastructure necessary for the generative AI revolution and ElevenLabs' contribution to generating lifelike content across any language in a scalable, emotional, and personalized manner.

This partnership exemplifies the convergence of advanced AI technology and accelerated computing, heralding a new era of digital human interaction and content creation. As AI continues to evolve, the possibilities for its application in various industries appear boundless, paving the way for more innovative and inclusive experiences.