Artificial Intelligence: Tech Giant Microsoft’s VALL-E AI Tool Can Reproduce Your Voice

January 12, 2023 | Artificial Intelligence, News

VALL-E can reproduce any voice based on a three-second audio sample.

Trained on 60,000 hours of English speech data, VALL-E, which is Microsoft’s (NASDAQ: MSFT) new AI tool, can replicate any voice based on its analysis of a three-second audio sample. In an advancement of this technology, VALL-E can also simulate the tone and emotions of the speaker. (English Jagran)

Here is an extract from Cornell University’s research paper on VALL-E:

“Experiment results show that Vall-E significantly outperforms the state-of-the-art zero-shot TTS system [AI that recreates voices it’s never heard] in terms of speech naturalness and speaker similarity. In addition, we find VALL-E could preserve the speaker’s emotion and acoustic environment of the acoustic prompt in synthesis.”

How it works

VALL-E analyzes a person’s voice by breaking it down into components and then using its training to synthesize how the voice would sound if it were speaking different phrases.

It builds on EnCodec, a technology developed by Meta (NASDAQ: META) in October 2022.

Its applications include speech editing, text-to-voice tool, and (in combination with other generative AI tools such as GPT-3) to build an audio creation system.

However, there are ethical concerns surrounding the use of the tool. It could be used by hackers to impersonate a family member’s voice to request (and receive) confidential data. Or it could masquerade as an eminent personality such as a politician. Another risk, it could be used to fool systems that depend on voice recognition for identification.

Related Story:  Microsoft Mulling $10B Investment in ChatGPT Creator OpenAI

Image by Gordon Johnson from Pixabay

Free Industry News

Subscribe to our free newsletter for updates and news about alternatives investments.

  • This field is for validation purposes and should be left unchanged.


Latest Alternative Investment News
Artificial Intelligence: AMD Takes On Rivals In The AI Chip Sweepstakes
December 7, 2023     Artificial Intelligence, News

Chipmaker AMD (NASDAQ: AMD) has unveiled a range of innovative AI solutions spanning from data centers to personal computers. The AMD Instinct MI300 Series features data center AI accelerators, while…
Digital Assets: Robinhood Debuts Crypto Trading On Its App In The EU
December 7, 2023     Digital Assets, FinTech, News

Robinhood (NASDAQ: HOOD) has launched its Crypto app in the European Union (EU), allowing eligible customers to engage in crypto trading with the added incentive of earning Bitcoin rewards. Customers…
FinTech: Samsung Electronics Ties With Mastercard’s Wallet Express
December 7, 2023     FinTech, News

Samsung Electronics (KRX: 005930) and Mastercard (NYSE: MA) have partnered to launch the Wallet Express program, offering banks and card issuers a cost-effective way to expand digital wallet offerings. Through…
Venture Capital: Revaia, Europe’s Biggest Female-Led VC Firm, Racks Up $160M For Second Fund
December 7, 2023     ESG and Sustainability, News, Venture Capital

Revaia, Europe’s largest female-founded venture capital firm, has successfully raised €150 million ($160 million) for its second fund, Revaia Growth II. The funding was secured from sovereign wealth funds, family…