OpenAI previews Voice Engine generator, acknowledging risks

From NBC News: 2024-03-29 16:47:34

OpenAI unveils Voice Engine, a digital voice generator, capable of producing natural-sounding speech with just a 15-second audio sample. Tested for reading assistance and more, the software faces concerns over potential misuse, prompting OpenAI to delay wider release due to fears of fraud, deepfakes, and implications in an election year.

2024 election experiences its first fake voice through a robocall imitating President Biden. Following this incident, the FCC votes unanimously to ban unsolicited AI robocalls. OpenAI acknowledges political risks involved in voice generation technology and is collaborating with various stakeholders to address concerns and develop safeguards against synthetic voice misuse.

While OpenAI enforces usage policies to prevent impersonation without consent, the challenge of detecting and labeling AI-generated content remains. Solutions like watermarking prove ineffective at preventing misuse. Concerns also arise about potential criminal misuse of deepfake voices for fraud, highlighting the need for robust safeguards and legal considerations in deploying voice technology at scale.



Read more at NBC News: OpenAI previews Voice Engine generator, acknowledging risks