xAI sues a man for using Grok to generate CSAM ‘deepfakes’

xAI has filed a lawsuit against a South Carolina resident, alleging that the individual intentionally bypassed the company's safety filters to generate child sexual abuse material using the Grok chatbot. The legal action seeks to address the unauthorized use of the platform to produce illegal content while highlighting the ongoing challenges companies face in preventing the misuse of generative AI tools.