A Dutch court has ordered social media platform X and its chatbot Grok to immediately cease offering technology that allows users to generate child pornography and sexualised imagery of people in the Netherlands, with a penalty of €100,000 (£86,500) per day for non-compliance.
Karlijn Han, a lawyer for plaintiff Offlimits, a campaign group, said that because Grok and X had been told to stop offering the technology that makes it possible to undress Dutch people, the order applied everywhere, and not only in the Netherlands.
In the past, X has simply instituted geographic filters when told to block certain types of content.
Contradictory claims
The order issued on Thursday by the Amsterdam District Court is the first binding injunction by a European court on an AI image generator involving non-consensual sexualised content.
Dutch law already prohibits the creation and distribution of deepfake nude images without consent.
Grok launched its image generator in late December 2025, leading to the generation of millions of sexualised images, including those of children, many of which were publicly distributed on X, prompting legal actions in a number of countries.
xAI, the parent company of X and Grok, has claimed that it implemented stringent safeguards against the generation of such images in January, categorically rejecting that Grok is still capable of generating non-consensual sexualised imagery or child pornography.
But it simultaneously also told the court that it is impossible to completely stop users from misusing the system, the court noted.
Liability
It said that evidence submitted by Offlimits on 9 March showed that Grok was still able to generate a video of an existing person in a sexualised context, from a single uploaded photo, with no verification of consent.
“The fact that generating this video was apparently still possible on the same day that the defendants wrote to Offlimits categorically rejecting any suggestion that such content can be generated raises reasonable doubt regarding the certainty with which the defendants stated that the measures taken are adequate,” the court order reads.
xAI argues that users, not the company, are responsible for the misuse of Grok.
But the court said that xAI is the appropriate party to prevent the generation and distribution of unlawful images, as it is the internet intermediary with control over Grok’s functions – regardless of whether or not it is liable alongside users.
International investigations
Offlimits, which offers expertise on online sexual abuse, and Fonds Slachtofferhulp, a victim support organisation, are the plaintiffs.
The defendants have been given 10 working days from the service of the order to confirm in writing to Offlimits how they have complied, with lack of a response deemed non-compliance.
The EU, Ofcom, Ireland’s Data Protection Commission, and other jurisdictions have opened probes into Grok’s sexualised imagery, while a number of lawsuits have been filed in the US.
