Meta company announced on the global launch of the new voice-over feature for Reels videos. The technology works on the basis of generative AI, which translates the user’s voice and synchronizes the movements of the lips with the translation.
To use the feature, you need to select the “Translate your voice with Meta AI” option before publishing the video. The system creates an audio translation track, preserving the intonation of the original voice, after which you can additionally activate lip sync with the new audio. The author can preview the result and decide whether to enable synchronization. The translated video shows a flag about the use of AI.
The feature is now available to Facebook creators with more than 1,000 followers and to all users with public Instagram accounts. Meta advises using the tool in videos with a direct address to the camera, without background music or covering the mouth. The system supports up to two speakers, but it is not desirable that the voices overlap.
The company notes that the new feature will help authors expand the content audience beyond their native language. For this purpose, a tool for evaluating the effectiveness of translation by language has also been implemented. Translation is currently only available in English and Spanish, but Meta plans to expand language support in the future.
