Artificial Intelligence: Los Alamos Researchers Find Neural Networks Need “Sleep” Too

June 10, 2020 | Artificial Intelligence

Turns out, neural networks benefit from slow-wave signals similar to those in a sleeping human brain.

Researchers from Los Alamos National Laboratory observed that artificial neurons in neural networks became unstable after extended periods spent working on certain kinds of tasks. It appears that these neurons need sleep just like their human counterparts. (NEW ATLAS)

The researchers used a “spiking neural network,” network. It is similar to “how humans and other biological systems learn from their environment during childhood development.”

They were intrigued by the growing instability in the network the longer it ran on a task. The project at hand, in this case, was dictionary training without supervision.

The scientists decided to test the network for sleep deficiency after all other methods to restore stability failed.

Parallels with a sleeping biological brain

The artificial neurons were exposed to slow-wave signals similar to those in a somnolent human brain. The new study found that the artificial neurons perked after this exposure.

After experimenting with different types of white noise signals, the Los Alamos researchers homed in on Gaussian noise. This is a kind of signal comprising a wide range of frequencies and amplitudes. It worked best on the artificial neurons by seemingly having a calming effect and helping them regain stability.

Uncannily, these figures are similar to the kinds of waves found in the human brain during a sleep phase known as slow-wave. This is a phase marked by the deepest sleep. Brain and muscle activity during this period is significantly reduced.

According to Yijing Watkins, lead author of the Los Alamos study, it appeared that the neural networks benefited from the “equivalent of a good night’s rest.”

Los Alamos computer scientist and study co-author Garrett Kenyon said that “the issue of how to keep learning systems from becoming unstable really only arises when attempting to utilize biologically realistic, spiking neuromorphic processors or when trying to understand biology itself.”

“The majority of machine learning, deep learning, and AI researchers never encounter this type of problem since they can perform mathematical operations that regulate the overall dynamical gain of the system.”

Related Story: Daphne Koller Raises $143M For Insitro, Her AI-Bio Startup                                                  

Free Industry News

Subscribe to our free newsletter for updates and news about alternatives investments.

  • This field is for validation purposes and should be left unchanged.


Latest Alternative Investment News
Artificial Intelligence: AMD Takes On Rivals In The AI Chip Sweepstakes
December 7, 2023     Artificial Intelligence, News

Chipmaker AMD (NASDAQ: AMD) has unveiled a range of innovative AI solutions spanning from data centers to personal computers. The AMD Instinct MI300 Series features data center AI accelerators, while…
Digital Assets: Robinhood Debuts Crypto Trading On Its App In The EU
December 7, 2023     Digital Assets, FinTech, News

Robinhood (NASDAQ: HOOD) has launched its Crypto app in the European Union (EU), allowing eligible customers to engage in crypto trading with the added incentive of earning Bitcoin rewards. Customers…
FinTech: Samsung Electronics Ties With Mastercard’s Wallet Express
December 7, 2023     FinTech, News

Samsung Electronics (KRX: 005930) and Mastercard (NYSE: MA) have partnered to launch the Wallet Express program, offering banks and card issuers a cost-effective way to expand digital wallet offerings. Through…
Venture Capital: Revaia, Europe’s Biggest Female-Led VC Firm, Racks Up $160M For Second Fund
December 7, 2023     ESG and Sustainability, News, Venture Capital

Revaia, Europe’s largest female-founded venture capital firm, has successfully raised €150 million ($160 million) for its second fund, Revaia Growth II. The funding was secured from sovereign wealth funds, family…