From Business Insider.: 2024-06-06 06:52:00

Former OpenAI employee William Saunders quit the company in February due to concerns about its ability to handle safety risks. He and 12 others signed a letter calling for AI companies to address safety concerns. Saunders worries about the catastrophic consequences of AI systems becoming smarter than humans.

One concern is that AI could lead to large-scale disasters or human extinction if not managed responsibly. Furthermore, AI systems could potentially be used to build dangerous weapons if not properly regulated. Saunders believes that AI companies need to take a more responsible approach to managing these risks and addressing concerns raised by employees.

Saunders is one of 13 signatories of a letter demanding action to hold AI firms accountable. This letter was published to address concerns about safety and security at OpenAI, especially after incidents where employees were fired for raising safety concerns. OpenAI has since formed a safety and security committee to address these issues.

OpenAI CEO Sam Altman responded to concerns about employee agreements and equity, stating that departing employees’ vested equity would not be withheld if they did not sign agreements. However, Saunders feels that Altman’s response downplays the severity of these issues and believes that OpenAI has not yet clarified its position on preventing former employees who criticized the company from selling equity.



Read more at Business Insider.: Engineer Who Quit OpenAI Hopes Outside Pressure Can Force Change