The advent of artificial intelligence (AI) has brought about significant advancements, but it has also led to alarming misuse, particularly in the creation of illicit content. Law enforcement agencies worldwide are increasingly encountering cases where individuals exploit AI tools to generate illegal material, leading to arrests and prosecutions.​

Notable Arrests for AI-Generated Illegal Content

In May 2024, the U.S. Department of Justice announced the arrest of Steven Anderegg, a 42-year-old from Wisconsin, on charges related to the production, distribution, and possession of AI-generated child sexual abuse material (CSAM). Anderegg allegedly used the AI model Stable Diffusion to create thousands of realistic images depicting minors in sexually explicit scenarios. He reportedly shared some of these images with a minor, highlighting the potential for AI tools to facilitate harmful activities. ​

Similarly, in August 2024, an Army soldier stationed in Anchorage, Alaska, was arrested for allegedly using AI to generate and distribute child pornography. The soldier faced charges including transportation, receipt, and possession of files depicting child sexual abuse, underscoring the military’s commitment to addressing such offenses within its ranks. ​

In a broader international effort, Europol coordinated a global operation in February 2025, resulting in the arrest of 25 individuals involved in the creation and distribution of AI-generated child sexual abuse material. This operation highlighted the growing concern among law enforcement agencies about the misuse of AI technologies to produce illegal content. ​

The GenNomis Data Breach
In March 2025, a cybersecurity researcher uncovered an unprotected database belonging to GenNomis, a platform operated by South Korean AI firm AI-NOMIS. The exposed 47.8 GB database contained 93,485 AI-generated images, including explicit deepfake content depicting minors and celebrities. This breach not only revealed the vast amount of sensitive content being generated but also raised significant concerns about data security and the ethical implications of AI in content creation. ​

Legal and Ethical Implications
These incidents underscore the urgent need for robust legal frameworks to address the challenges posed by AI-generated illegal content. While some jurisdictions have begun enacting legislation to criminalize the creation and distribution of such material, enforcement remains complex due to the rapid evolution of AI technologies. Moreover, these cases highlight the ethical responsibilities of AI developers and users to prevent the exploitation of these technologies for harmful purposes.​

As AI continues to advance, it is imperative for legal systems, technology companies, and society at large to collaborate in establishing safeguards that prevent misuse while promoting the responsible development and application of AI technologies.