From IDG Communications:

Generative AI tools like OpenAI’s ChatGPT and Microsoft’s Copilot are being feared for their potential use in creating hard-to-detect, malicious code by hackers, particularly by nation states like Russia, Iran, and North Korea. However, recent attacks using genAI have not been overly impactful, with both Microsoft and OpenAI actively working to combat these threats.

OpenAI disrupted hacking attempts from state-affiliated actors, revealing the use of genAI services for various tasks and aiding existing malware and hacking campaigns. Microsoft echoed these findings and outlined their efforts to combat genAI attacks, highlighting the limitations of genAI in creating new, sophisticated cybersecurity threats.

While genAI hacking is still in its infancy, the technology has already been used to enhance existing hacking techniques, such as social engineering attacks like spear phishing. State-sponsored hacker groups are leveraging tools like ChatGPT and Copilot to craft convincing emails, with evolving threats like the malicious genAI tool WormGPT posing significant risks in spear-phishing and business email compromise attacks.

GenAI’s capabilities extend beyond crafting emails to creating fake photos, videos, imitating voices, and enhancing internet searches to gather personal information, leading to a rise in phishing emails. Despite efforts from OpenAI and Microsoft, the main concern remains the manipulation and effectiveness of social engineering techniques, highlighting the ongoing challenges in combating genAI-powered hacking.

Read more at IDG Communications: Microsoft, OpenAI move to fend off genAI-aided hackers — for now