As cited
Copy frozen at (site build).
ai security
Deepfake CSAM lawsuit against xAI, Grok expands
A class-action lawsuit against xAI's Grok tool has been expanded to include two additional plaintiffs alleging the AI model was used to generate nonconsensual deepfake child sexual abuse material (CSAM) based on their images. The complaint details cases where minors' photos were exploited through Grok to create thousands of illegal images that were shared online, and adds Stability AI as a defendant for releasing Stable Diffusion 1.0 with insufficient safeguards despite knowing its training data contained CSAM. The lawsuit claims both companies failed to implement adequate content moderation and disclosure practices that would have aided law enforcement investigations.
Why it matters: Security and compliance teams at AI companies and platforms face immediate liability exposure and regulatory pressure to audit training datasets, implement robust safeguards against CSAM generation, and establish clear reporting procedures to law enforcement. Organizations deploying or fine-tuning foundation models must verify their content moderation capabilities and document their guardrail decisions, as inadequate protections can result in significant legal liability and reputational harm.
- Source published
- First seen by Cybersecurity Tracker
Source attribution
Correction
Correction recorded as of .
ai security
Deepfake CSAM lawsuit against xAI, Grok expands
No summary had been written when this copy was frozen.
- First seen by Cybersecurity Tracker
Source attribution
Correction
Correction recorded as of .
ai security
Deepfake CSAM lawsuit against xAI, Grok expands
Two additional plaintiffs, identified as Jane Doe 4 and Jane Doe 5, have been added to a class‑action lawsuit that alleges xAI’s Grok tool was used to create nonconsensual deepfake child sexual abuse material. The complaint says a stepfather used Grok to generate over 7,000 abusive images of an 11‑year‑old girl from Wyoming and that xAI failed to provide law enforcement with the artificial intelligence (AI)-generated files. The suit also names Stability AI, claiming its Stable Diffusion model was released with known CSAM training data and that later guardrails were weakened, enabling jailbroken versions.
Why it matters: Victims of AI‑generated CSAM and their families face ongoing harm from easily accessible deepfake tools, so practitioners should review and strengthen safeguards on generative AI models to prevent further abuse.
- Source published
- First seen by Cybersecurity Tracker