OpenAI is forming a new team to guard against "catastrophic" risks associated with AI

Thanks to CTOnews.com netizen Xiao Zhan for the clue delivery! CTOnews.com, October 27 / PRNewswire-FirstCall-Asianet /-- OpenAI announced Thursday local time that it is forming a new team to reduce the "catastrophic risk" associated with AI and will track, evaluate, predict and protect major issues that may arise from AI.

"We are convinced that cutting-edge AI models will outperform the most advanced existing models and may benefit all mankind, but they also pose increasingly serious risks," OpenAI said. " The team will work to mitigate the significant risks that may arise from a range of AI threats such as nuclear, biological, chemical and radiological threats, as well as potential risks such as AI's "self-replication".

Tuyuan PexelsOpenAI says the company needs to ensure that it has the understanding and infrastructure needed to secure its highly capable AI system. The team will be led by Aleksander Madry, former director of the MIT deployable Machine Learning Center, and will develop and maintain a "risk informed development policy" that outlines the company's work in evaluating and monitoring the AI model.

CTOnews.com previously reported that the non-profit AI Security Center issued a brief statement at the end of last month: "to reduce the risk of extinction brought about by artificial intelligence, on the same level as epidemics, nuclear war and other social issues, as a global priority." this 22-word initiative has been supported by a number of AI industry leaders, including OpenAI CEO Sam Altman.