Customize Consent Preferences

We use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.

The cookies that are categorized as "Necessary" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... 

Always Active

Necessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.

No cookies to display.

Functional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.

No cookies to display.

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.

No cookies to display.

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

No cookies to display.

Advertisement cookies are used to provide visitors with customized advertisements based on the pages you visited previously and to analyze the effectiveness of the ad campaigns.

No cookies to display.

Home News Meta, thanks to AI, vocal translations will be more expressive!

Meta, thanks to AI, vocal translations will be more expressive!

by Brad

Meta aims at improving AI-enhanced voice translations towards more authentic communication in real-time. Artificial intelligence has made considerable strides in recent month in automating voice translations. The improvements are targeted towards adding quality, incorporation of multiple languages, and supporting numerous input formats. The recent move of Meta is in extension to early rollout of Seamless M4T, the first of its kind in multimodal AI based translation system for close to hundred written languages plus thirty spoken languages.

SeamlessM4T v2: Advancements and Features


SeamlessM4T v2 provides a better correlation of the text to voice outputs, allowing more uninterrupted multi-lingual conversation with speech and text.

SeamlessExpressive: Capturing User Emotions


An interesting characteristic entitled “SeamlessExpressive” provides for an instrument to go beyond words and convert user’s emotions into the translated utterance. These involve voice pitch, volume, emotional intensification, tempo, speaking rate, as well as pausing. Demo today support the English, Spanish, German, French, Italian, and Chinese. The first four are the initial ones.

SeamlessStreaming: Cross-Lingual Real-Time Communication
“Seamlessstreaming” is a cutting-edge technology, widely accessible, facilitating multilingual instantaneous communication. The speaker understands quicker with latency of approximately two seconds.

The “Efficient Monotonic Multihead Attention” algorithm, EMMA has been one of the main challenges that Meta experienced while creating its SeamlessStreaming system. This specific algorithm is used to parse just a portion of an acoustic input, identify linguistic structure, and determine when there is enough context to start generating outputs in translation or keep listening.

While there have been warnings that this technology could be used in scams or other abuse, Meta has employed appropriate security features. This incorporates audio watermarking and a better process of distinguishing synthetic voices from those real to be integrated directly into an audio signal that would go unnoticeable by any human, but the specialized model will have to take it.

SeamlessM4T v2 and some of these models can currently be found hosted on Hugging Face and Github. The dual nature of VR is known by Meta’s researchers and measures to reduce associated risks were enforced for safe adoption of the technology.


You may also like

Welcome to our tech haven! Explore the latest in cutting-edge news and technology on our blog. Stay informed with up-to-the-minute updates that unravel the wonders of the digital world.

techpulse.cloud, A Technology Media Company – All Right Reserved.