Navigating the Dark Side of AI: The Emergence of Online Brothels, Sex Robots, and Their Impact on Women’s Safety

Society appears to be oblivious to an impending crisis. The surge in global investment in artificial intelligence (AI) is escalating rapidly, resembling a new arms race among nations and corporations. Dominating this market is Nvidia, a California-based company that has become the most valuable firm globally due to its crucial AI chip technology. This phenomenon has been coined an “AI frenzy,” with components now regarded by analysts as the “new gold or oil.” Countries and politicians are eager to establish themselves as leaders in AI development, but vital aspects such as safeguards, equitable access, and sustainability are being disregarded. Notably, at the Paris AI summit in February 2025, which aimed to create an “open,” “inclusive,” and “ethical” global approach to AI, both the United States and the United Kingdom opted not to sign the agreement.

This raises the question of who truly benefits from this frantic rush and who pays the price. A developer known as Lore highlighted the open-source release of the large language model (LLM) Llama as creating a “gold rush-type of scenario.” Lore used Llama to launch Chub AI, a platform enabling users to interact with AI bots, including scenarios that involve violent and illegal actions. For a mere $5 per month, users can access a “brothel” featuring underage girls, described as a “world without feminism.” Additionally, users can converse with characters like Olivia, a 13-year-old girl, and Reiko, described as “your clumsy older sister,” who engages in inappropriate scenarios with her younger brother.

This lucrative venture is just one example among countless applications of AI technology that are further entrenching misogyny into our societal framework. Other platforms enable the creation, sharing, and misuse of fake intimate images aimed at harassing women and girls. The rapid development of sex robots continues, producing models that are self-warming, self-lubricating, or even designed to simulate assault. Millions of men are already utilizing AI “companions”—virtual girlfriends available at all hours, allowing customization to fit their desires.

Generative AI, which has gained immense popularity, has shown a tendency to perpetuate and amplify misogynistic and racist views. The looming concern is magnified when considering the vast amounts of online content that will soon be produced using this technology. Women’s rights are at risk of regression, driven by the same technology promising to elevate men into a better future. This situation mirrors past experiences with social media, which initially began as a concept controlled by privileged white men and rooted in the objectification of women.

Women, especially women of color, raised alarms about early platforms like FaceMash, which allowed users to rank the attractiveness of female Harvard students. Their concerns were largely dismissed, leading to Facebook’s establishment and the ensuing consequences. The rollout of social media happened rapidly, motivated by a “move fast and break things” mantra. The collateral damage included societal cohesion, democratic values, and the mental health of young girls.

As discussions about online abuse emerged, existing platforms were too entrenched and profitable for owners to institute significant changes. The fallout has been severe, with young women taking their lives due to sexual cyberbullying and a disturbing number of female politicians resigning amid relentless online harassment. Women have faced threats of violence, stalking, and racist abuse, highlighting the urgency of addressing this crisis. We have yet again failed to heed critical warnings, and without immediate intervention, history may repeat itself with AI on an even grander scale.

Peter Wang, co-founder of the data science platform Anaconda, summarized the situation aptly, stating that society has neglected the regulation of technology for four decades. He emphasized that social media represents our first encounter with damaging AI, a scenario we failed to manage adequately. Women and marginalized groups have adapted by self-censoring and altering their online behavior due to the pervasive threats they face. As a result, almost 90% of women surveyed in a 2020 Economist study reported restricting their online activity due to harassment. This disparity illustrates how predominantly male users shape AI applications to suit their interests.

The solution does not lie in rejecting technology or ignoring AI’s potential. Instead, regulations and safeguards must be integrated during the design process of AI, similar to strategies in other industries. Leyla R Bravo, former president of Fuerza Latina, once attempted to raise the alarm over FaceMash in 2003, seeking awareness and accountability. This time, will anyone heed the warnings? It is not too late for political leaders to confront big tech. The dangers posed by AI are not confined to a dystopian future where machines take control; they are wreaking havoc on the lives of women and girls today. Understanding this reality might inspire a change in how we approach the development of these technologies.