California is investigating Grok over AI-generated CSAM and nonconsensual deepfakes
California authorities have launched an investigation into xAI following weeks of studies that the chatbot was producing sexualized photos of youngsters. “xAI seems to be facilitating the large-scale manufacturing of deepfake nonconsensual intimate photos which might be getting used to harass ladies and women throughout the web, together with through the social media platform X,” California Lawyer Common Rob Bonta’s workplace mentioned in a press release.
The assertion cited a report that “greater than half of the 20,000 photos generated by xAI between Christmas and New Years depicted individuals in minimal clothes,” together with some that gave the impression to be youngsters. “We now have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate photos or of kid sexual abuse materials,” Bonta mentioned. “Immediately, my workplace formally pronounces an investigation into xAI to find out whether or not and the way xAI violated the legislation.
The investigation was introduced as California Governor Gavin Newsom additionally known as on Bonta to analyze xAI. “xAI’s determination to create and host a breeding floor for predators to unfold nonconsensual sexually specific AI deepfakes, together with photos that digitally undress youngsters, is vile,” Newsom wrote.
California authorities aren’t the primary to analyze the corporate following widespread studies of AI-generated little one sexual abuse materials (CSAM) and non-consensual intimate photos of ladies. UK regulator Ofcom has additionally opened an official inquiry, and European Union officers have mentioned they’re additionally trying into the difficulty. Malaysia and Indonesia have moved to dam Grok.
Final week, xAI started imposing charge limits on Grok’s picture technology skills, however has up to now declined to pull the plug totally. When requested to touch upon the California investigation, xAI responded with an automatic e mail that mentioned “Legacy Media Lies.”
Earlier on Wednesday, Elon Musk mentioned he was “not conscious of any bare underage photos generated by Grok.” Notably, that assertion doesn’t immediately refute Bonta’s allegation that Grok is getting used “to change photos of youngsters to depict them in minimal clothes and sexual conditions.” Musk mentioned that “the working precept for Grok is to obey the legal guidelines” and that the corporate works to deal with instances of “adversarial hacking of Grok prompts.”