From The Independent: 2024-06-05 15:49:42

A group of current and former employees at top Silicon Valley firms developing artificial intelligence issued a warning that without extra safeguards, AI could lead to “human extinction”. They believe more protection is needed for AI researchers to voice concerns and seek input from the public and policymakers to guide AI innovation. Neel Nanda of DeepMind is the only researcher currently associated with the companies who signed the letter. The letter also calls for companies developing AI to avoid punishing or silencing employees for raising concerns about AI risks. OpenAI faced criticism after departing employees were asked to choose between losing equity or signing a non-disparagement agreement, which was later revoked. OpenAI spokesperson emphasized the importance of robust debate and engagement with various communities to ensure responsible AI development. The company highlighted its support for increased AI regulation and safety commitments. The controversies faced by top AI firms, including OpenAI, come amidst the introduction of powerful AI assistants with new capabilities, such as voice-to-voice conversations and visual information processing. Scarlett Johansson accused OpenAI of using her voice without permission as a model for one of its products, which the company denied. OpenAI also disbanded a team focused on researching long-term AI risks and experienced several key departures, including co-founder Ilya Sutskever. The company has undergone significant changes since a board battle last year involving Sam Altman. Anthropic and Google have been contacted for comment.



Read more at The Independent: ‘Human extinction’: OpenAI workers raise alarm about the risks of artificial intelligence