In a powerful call to action, the UK’s Children’s Commissioner, Dame Rachel de Souza, has urged the government to ban AI-powered “nudification” apps that generate fake nude or sexual images of children. According to a recent report, these disturbing applications have become so widespread that many young girls are now hesitant to post their photos on social media out of fear.
While the creation and distribution of child sexual abuse material (CSAM) is illegal, the apps enabling the creation of such deepfake images currently remain legal. De Souza expressed deep concern, stating, “Children have shared with me their fears about the mere existence of such technology. They worry that anyone — whether a stranger, a classmate, or even a friend — could misuse a smartphone to create manipulated, sexualized images of them.” She emphasized that there is absolutely no legitimate reason for such apps to exist.
Highlighting the scale of the problem, de Souza pointed out that these AI tools are easily accessible through popular search engines and app stores. Worryingly, many of these apps disproportionately target girls and young women, with most software designed to manipulate female bodies specifically. Young people themselves are increasingly calling for stricter measures to curb the misuse of these technologies.
The Commissioner has proposed a comprehensive ban on apps that create sexually explicit deepfakes using artificial intelligence. She also called for legislation to place legal responsibilities on GenAI developers to assess the risks their apps pose to children, ensure swift removal of CSAM, and formally recognize deepfake sexual abuse as a form of violence against women and girls. Although the UK government has introduced new offenses criminalizing the creation and sharing of explicit deepfakes, Dame de Souza’s focus remains on the urgent need to protect children, given the rising links between deepfake abuse and mental health issues such as PTSD and suicidal ideation.
A 16-year-old girl surveyed in the report reflected the growing anxiety among teens, saying, “Even before it became a major issue, I could already see that this technology would be abused — it was obvious it would be used for harmful purposes.”
