Artificial Intelligence: Wu Dao 2.0, China’s Fire-Breathing New AI System, Is 10X Bigger Than GPT-3
Wu Dao is capable of doing everything GPT-3 can do, and then some.
Earlier this week, researchers from the Beijing Academy of Artificial Intelligence launched a new version of Wu Dao, their own deep learning natural language model, which appears to be leagues ahead of GPT-3, the model from Open AI, and Google’s Switch Transformer. The last-named two models each represented massive advances in natural language processing. (TechRadar)
Wu Dao 2.0
While GPT-3 was trained on 175 billion parameters, and the Switch Transformer on 1.6 trillion parameters, Wu Dao 2 uses 1.75 trillion parameters.
Wu Dao 2 was trained by studying 1.2 1.2TB of text in each language and 4.9TB of images and text overall. This massive model can therefore understand both Chinese and English and can simulate conversations, understand pictures, write poems, and even create recipes.
This model is targeting artificial general intelligence, the Holy Grail of AI. It refers to the hypothetical ability of a machine to learn a task such as humans do.
Chinese AI researcher Blake Yan said to the South China Morning Post: “These sophisticated models, trained on gigantic data sets, only require a small amount of new data when used for a specific feature because they can transfer knowledge already learned into new tasks, just like human beings. Large-scale pre-trained models are one of today’s best shortcuts to artificial general intelligence.”
Wu Dao 2 is mega
“The way to artificial general intelligence is big models and big computer,” Dr. Zhang Hongjiang, chairman of BAAI, said Tuesday, as quoted by Engadget.
“What we are building is a power plant for the future of AI, with mega data, mega computing power, and mega models, we can transform data to fuel the AI applications of the future.”
Latest Alternative Investment News
Alternative Investments/Digital: State Street Digital, A New Division At State Street, To Focus On Crypto
State Street (NYSE: STT), which has $40.3 trillion in assets under custody or administration, said Thursday it is establishing a new digital finance division called State Street Digital. The new…
United Airlines (NASDAQ: UAL) announced its new corporate venture fund, United Airlines Ventures, on Thursday. The fund’s brief is to invest in emerging companies that could reinvent travel and aviation…
The IMF warned Thursday that El Salvador’s move to adopt bitcoin as a legal currency in parallel with the US dollar could have various economic and legal repercussions. El Salvador’s…
Clip, a Mexican digital payments and commerce platform founded in 2012, announced June 10, its raise of $250 million in a round led by the SoftBank Latin America Fund and…