Although Meta only launched its Meta AI tool in April, the company has continually strived to introduce new features.

Advertisement

With ambitions to compete with ChatGPT, Meta already boasted 1 billion monthly users just a month after launch, and its ongoing roll-out of new features might attract even more users.

Announced at Meta Connect 2024, scheduled for the 17th and 18th of September, a new AI-generated audio translation feature is set to be unveiled…

Automatically Dubbed Videos with Meta AI Translations

Why You Should Never Reheat These Foods in the Microwave – The Hidden Dangers Experts Warn About
I tried the top 5 guard dogs—here’s what makes these breeds the ultimate protectors

As announced on its website, starting this week, numerous content creators on Facebook and Instagram are expected to gain access to Meta AI Translations, a tool that allows for automatic voice dubbing into different languages.

With an optional lip-sync feature that makes it appear as if the person is actually speaking in the new language, Meta promises to maintain the original tone and intonation of the voice.

Currently, a Limited Feature

While this new feature from Meta is set to be expanded to more content creators soon, it is currently only available in English and Spanish. However, from the screenshots that have been shared, it is apparent that Meta plans to add more languages in the future.

Yet, the tool is still limited and requires creators to produce videos with a front-facing camera and a maximum of only two people on screen. For optimal performance, Meta also advises content creators to avoid overlapping voices, minimize background noise, and ensure their mouths are not covered to enhance lip-sync accuracy.

Additionally, only content creators on Instagram, or on Facebook with at least 1,000 followers, can currently use this feature. Viewers, on the other hand, will automatically see videos translated into their language, with an indication that the audio track was generated by Meta AI.

A Tool Designed to Expand Audience Reach

This new feature aims to help content creators reach an international audience, transcending language barriers. Translated videos will have a specific dashboard for each language that allows tracking of individual performance metrics.

Before a Meta AI Translations dubbed video is published, content creators can listen to the dubbed version and decide whether to accept it or make adjustments. Additionally, creators can upload up to 20 manually dubbed audio tracks on a single Reel, allowing for complete control over the content…