OpenAI workers warn that AI could cause ‘human extinction’
From Independent: 2024-06-04 19:00:23
A group of current and former employees at top Silicon Valley firms developing artificial intelligence warned in an open letter that AI could pose a threat of “human extinction.” The letter, signed by 13 mostly former employees of firms like OpenAI and Google’s DeepMind, argues for more safeguards in AI development to prevent serious risks.
Neel Nanda of DeepMind is the only AI researcher currently affiliated with the companies who signed the letter. The message calls for companies to refrain from punishing current or former employees who speak out about AI risks. OpenAI was involved in a scandal where departing employees were told to sign non-disparagement agreements, which were later lifted.
OpenAI, the company accused of using Scarlett Johansson’s voice as a model for an AI product, denied the allegations. The company is facing controversies, including disbanding a team researching long-term AI risks and losing top researchers. OpenAI expressed support for rigorous debate on AI risks and commitment to responsible development with increased regulation.
The open letter comes amid a season of controversies for top AI firms like OpenAI, who recently introduced advanced AI assistants that can have live voice-to-voice conversations and react to visual information. Actress Scarlett Johansson accused OpenAI of using her voice without permission, a claim the company denied. Top researchers have left OpenAI, as the company faces internal turmoil.
Read more at Independent: OpenAI workers warn that AI could cause ‘human extinction’