Artificial Intelligence: Meta (Formerly Facebook) To Develop AI That Processes Text And Speech Like Humans

https://dailyalts.com/wp-content/uploads/2022/05/woman-gb6079c741_640.jpg

Meta is collaborating with neuroimaging center Neurospin (CEA) and Inria on this project.

Meta (formerly Facebook) (NASDAQ: FB) has announced a long-term AI research initiative to better understand how the human brain processes speech and text. This project, being undertaken with neuroimaging center Neurospin (CEA) and Inria, will help the development of AI that processes speech and text as well as human beings. (Meta)

How AI falls short

Meta found, after applying deep learning techniques to public neuroimaging data sets, that while the brain anticipates words and ideas far ahead in time, most language models are trained to only predict the immediately following word. Developing this long-range forecasting ability could help improve modern AI language models.

Therefore, Meta concludes that AI models which are able to predict the next word by understanding the context would ultimately go on to be the ones most similar to brain functioning.

However, to train AI models for this level of sophistication needs a huge amount of data to pinpoint where and in what order activity is generated in the brain, for example, when a person reads or listens to a story.

Gathering the data

To gather this data, the Meta team not only models thousands of brain scans recorded from public data sets using functional magnetic resonance imaging (fMRI) but also simultaneously models them using magnetoencephalography (MEG), a scanner that takes snapshots of brain activity every millisecond. The twin processes pinpoint the location and sequence of the brain activity.

In an experiment, Meta and Inria compared language models with the brain responses of 345 volunteers.

“Our results showed that specific brain regions are best accounted for by language models enhanced with far-off words in the future,” says Meta. “These results shed light on the computational organization of the human brain and its inherently predictive nature, paving the way toward improving current AI models.”

Related Story: Le Monde, The Iconic French Paper, Now Uses AI-Powered Translation

Free Industry News

Subscribe to our free newsletter for updates and news about alternatives investments.

  • This field is for validation purposes and should be left unchanged.


Shape

Latest Alternative Investment News

https://dailyalts.com/wp-content/uploads/2023/12/AMD_headquarters_santa_clara.624da707519a6.jpg
Artificial Intelligence: AMD Takes On Rivals In The AI Chip Sweepstakes
December 7, 2023     Artificial Intelligence, News

Chipmaker AMD (NASDAQ: AMD) has unveiled a range of innovative AI solutions spanning from data centers to personal computers. The AMD Instinct MI300 Series features data center AI accelerators, while…

https://dailyalts.com/wp-content/uploads/2023/12/RHCEU-Inline.jpg
Digital Assets: Robinhood Debuts Crypto Trading On Its App In The EU
December 7, 2023     Digital Assets, FinTech, News

Robinhood (NASDAQ: HOOD) has launched its Crypto app in the European Union (EU), allowing eligible customers to engage in crypto trading with the added incentive of earning Bitcoin rewards. Customers…

https://dailyalts.com/wp-content/uploads/2023/12/Samsung_UK_Samsung_Pay_Lifestyle_0552-revised-Pictogram-23.11.30-1024x744-1.png
FinTech: Samsung Electronics Ties With Mastercard’s Wallet Express
December 7, 2023     FinTech, News

Samsung Electronics (KRX: 005930) and Mastercard (NYSE: MA) have partnered to launch the Wallet Express program, offering banks and card issuers a cost-effective way to expand digital wallet offerings. Through…

https://dailyalts.com/wp-content/uploads/2023/12/Revaia-founders.jpg
Venture Capital: Revaia, Europe’s Biggest Female-Led VC Firm, Racks Up $160M For Second Fund
December 7, 2023     ESG and Sustainability, News, Venture Capital

Revaia, Europe’s largest female-founded venture capital firm, has successfully raised €150 million ($160 million) for its second fund, Revaia Growth II. The funding was secured from sovereign wealth funds, family…