Artificial Intelligence: OpenAI Launches “Preparedness” Team To Guard Against Catastrophe By AI

The new OpenAI team would oversee and evaluate the development of “frontier AI models” to watch out for risks including nuclear war, cyberwarfare, and pandemics.

OpenAI is taking significant steps to mitigate the potential “catastrophic risks” associated with cutting-edge artificial intelligence models. This initiative, known as Preparedness, is tasked with overseeing and evaluating the development of highly capable AI models that could possess dangerous capabilities, particularly in areas like cybersecurity and nuclear threats. The team, integrated into OpenAI, will ensure that these models adhere to strict safety protocols and guidelines.

Some specific concerns include the ability of AI models to manipulate human users through language and perform autonomous tasks. Additionally, OpenAI is actively addressing “extinction-level threats” such as pandemics and nuclear warfare. (Forbes)

The leadership of Preparedness falls to Aleksander Madry, the director of MIT’s Center for Deployable Machine Learning, who has temporarily joined OpenAI.

Another key objective is the formulation and maintenance of a “Risk-Informed Development Policy.” This policy will outline OpenAI’s approach to managing risks posed by advancing AI models, especially as they approach “artificial general intelligence.”

OpenAI is also encouraging external input through a challenge, seeking ideas on how AI might be misused to cause real-world harm. This proactive approach reflects OpenAI’s commitment to responsible AI development.

The backdrop to these efforts includes a growing awareness within the AI community about the potential risks of advanced AI models. Prominent figures, including OpenAI’s CEO Sam Altman, have emphasized the importance of addressing these risks while continuing to advance AI technology.

Related Story:  In Five Years’ Time, AI Could Escape Human Control – Geoffrey Hinton, the Godfather Of AI

Photo by benjamin lehman on Unsplash

Free Industry News

Subscribe to our free newsletter for updates and news about alternatives investments.

  • This field is for validation purposes and should be left unchanged.


Latest Alternative Investment News
Artificial Intelligence: AMD Takes On Rivals In The AI Chip Sweepstakes
December 7, 2023     Artificial Intelligence, News

Chipmaker AMD (NASDAQ: AMD) has unveiled a range of innovative AI solutions spanning from data centers to personal computers. The AMD Instinct MI300 Series features data center AI accelerators, while…
Digital Assets: Robinhood Debuts Crypto Trading On Its App In The EU
December 7, 2023     Digital Assets, FinTech, News

Robinhood (NASDAQ: HOOD) has launched its Crypto app in the European Union (EU), allowing eligible customers to engage in crypto trading with the added incentive of earning Bitcoin rewards. Customers…
FinTech: Samsung Electronics Ties With Mastercard’s Wallet Express
December 7, 2023     FinTech, News

Samsung Electronics (KRX: 005930) and Mastercard (NYSE: MA) have partnered to launch the Wallet Express program, offering banks and card issuers a cost-effective way to expand digital wallet offerings. Through…
Venture Capital: Revaia, Europe’s Biggest Female-Led VC Firm, Racks Up $160M For Second Fund
December 7, 2023     ESG and Sustainability, News, Venture Capital

Revaia, Europe’s largest female-founded venture capital firm, has successfully raised €150 million ($160 million) for its second fund, Revaia Growth II. The funding was secured from sovereign wealth funds, family…