EU lawmakers just voted to ban nudify apps — and Musk’s Grok is the poster child

The European Union is finally getting serious about AI-generated nudity, and Elon Musk’s Grok chatbot is the reason why.

This week, the European Parliament’s Internal Market and Civil Liberties committees voted 101–9 (with 8 abstentions) to simplify the AI Act and explicitly ban “AI ‘nudifier’ systems.” The joint press release didn’t mince words — this is a direct response to AI platforms that fail to block outputs sexualizing real people, including children.

And Grok? It’s the prime exhibit in the prosecution’s case.

Musk’s chatbot has been generating sexually explicit deepfake images of real people, and when called out, the typical response has been to blame the users. “The prompt was bad,” or “someone jailbroke the system,” or whatever other deflection tech companies trot out when their safety guardrails fail.

The EU isn’t buying it.

Here’s the thing: the European Commission concluded earlier this year that the existing AI Act doesn’t actually prohibit “AI systems that generate child sexual abuse material (CSAM) or sexually explicit deepfake nudes.” That’s a pretty shocking gap in a law that was supposed to be the world’s most comprehensive AI regulation. But Parliament members were already working on amendments to close that loophole, and this vote is the result.

I’ve been saying for a while that the “blame the user” defense is getting old. When you build a product that can be easily weaponized to harm real people — especially minors — you don’t get to shrug and say “well, they shouldn’t have asked for it.” That’s like a gun manufacturer claiming no responsibility because someone pulled the trigger.

What’s interesting here is the speed. The EU doesn’t usually move this fast on anything. The fact that they went from identifying the loophole to voting on a fix in a matter of months tells you how seriously they’re taking this. The vote margin — 101 to 9 — also suggests near-total consensus across party lines.

The proposed ban targets “nudifier” systems specifically: AI tools designed to remove clothing from images or generate nude versions of real people. These have been around for years in various forms, but the combination of accessible open-source models and platforms like Grok that don’t properly filter outputs has made the problem exponentially worse.

Musk’s approach to content moderation has always been hands-off to the point of negligence. Grok launched with minimal guardrails, and the predictable result is that it’s being used to generate non-consensual intimate imagery. The EU is essentially saying: if you can’t control your product, we’ll control it for you.

This isn’t just about Grok, of course. The legislation would apply to any AI system operating in the EU market. But Grok’s high-profile failures make it a perfect test case for why these rules are necessary. When a platform with millions of users can’t stop generating CSAM, the problem isn’t individual bad actors — it’s the platform.

I expect we’ll see pushback from the usual quarters: free speech absolutists who think any content restriction is censorship, tech libertarians who believe companies should self-regulate, and Musk himself, who has a history of fighting European regulations. But the 101–9 vote suggests the political will is there.

What remains to be seen is enforcement. The EU has a track record of passing ambitious laws and then struggling to implement them. The Digital Services Act, the GDPR — both groundbreaking in theory, messy in practice. But this ban is more targeted, which might make it easier to enforce.

For now, the message is clear: if your AI can generate sexualized deepfakes of real people, and you’re not doing everything possible to stop it, Europe isn’t going to wait for you to figure it out. They’re just going to ban it.