Eleven Labs launches AI dubbing feature in 29 languages.

ElevenLabs launches Dubbing - a new voice translation tool that takes your videos/audios and translates them into different languages while keeping how you sound the same.

What’s going on here?

ElevenLabs' new AI Dubbing tool can automatically translate speech into 29 languages while maintaining the speaker's original voice and speech patterns.

What does this mean?

Dubbing uses ElevenLabs' proprietary research in areas like multilingual speech synthesis and voice cloning to replicate a speaker's vocal identity and style of delivery when translating their speech. This helps preserve the emotion, nuance, and identity of the original performance in the new language.

Creators can easily dub their content into multiple languages in their original voice, although there’s no lip sync. From quick tests, we also feel translations from English work better than compared to translations to English.

You can try uploading a sample audio/video or a URL to get a 1 minute dubbed result. Tip: Clear site cache and restart the browser to test multiple times.

Why should I care?

Voice dubbing for existing content is a big market. Spotify recently launched its Pilot program with OpenAI to dub podcasts. Spotify’s product is still not open for everyone—while anyone can use the Eleven Labs dubbing feature right now.

If you’re an indie maker who was building for the same problem with Eleven Labs in the backend, don’t stop. It’s easy to put off the project but the interface by Eleven Labs is geared toward general use cases. There is an opportunity to target niche use cases by solving edge cases (like lip sync).

The dubbing isn’t error-free, but if you're a creator, start experimenting now. Compare how your global audience reacts to AI translations compared to subtitles. This is the worst it’s going to be.