By Ashwani Mishra, Editor-Technology, 63SATS
Artificial intelligence is revolutionizing industries, including entertainment.
Major Hollywood studios are using AI-powered visual effects, like in the latest Indiana Jones film, where FaceSwap technology made Harrison Ford appear younger for a 25-minute flashback. Apps like Deep Nostalgia animate old photos, showcasing AI’s creative possibilitie
But there is a sinister side to AI, one that is growing at an alarming rate and leaving devastation in its wake.
AI-powered chatbots and deepfake technologies are being used on platforms like Telegram to exploit and degrade women and girls. A recent investigation has uncovered the shocking scale of this abuse, with over 4 million monthly users engaging with deepfake bots that create explicit images of real people, as reported by WIRED, a figure that likely represents only a fraction of the true scale of the problem.
The vast reach of these bots has made them accessible to a disturbingly large audience, and the ramifications are terrifying.
The Disturbing Rise of AI-Powered Deepfake Bots
These bots, powered by AI similar to the infamous DeepNude app, allow users to manipulate photos with just a few clicks, generating fake nude images or sexually explicit videos of women. All it takes is a single clothed photograph, and within minutes, a deepfake imageâcompletely fabricatedâcan be produced. The appeal for bad actors is clear: the process is fast, anonymous, and alarmingly easy.
âIt is really concerning that these toolsâwhich are really ruining lives and creating a very nightmarish scenario primarily for young girls and for womenâare still so easy to access and to find on the surface web, on one of the biggest apps in the world,â said Henry Ajder, an expert on deepfake technology who has been tracking these issues for years.
The Human Cost of Deepfakes
The devastating consequences of these deepfake images are not abstract; they are horrifyingly real. High-profile celebrities like Taylor Swift and Jenna Ortega have already been targeted by deepfake technology, but the impact on ordinary women and, most alarmingly, teenage girls, is far worse. In many cases, the fake images are used for blackmail and sextortion, with girls as young as 14 being targeted by malicious actors looking to exploit their vulnerability.
Ajder, who first discovered these explicit chatbots on Telegram four years ago, described the situation as “nightmarish.” His warnings have become more urgent as the use of such bots has exploded, posing significant risks not only to the individual victims but also to societal perceptions of privacy, security, and digital integrity.
The digital nature of the crime makes it all the more insidious. Victims of deepfakes face an uphill battle to regain control over their images, and there are currently few legal frameworks to protect them or hold the perpetrators accountable.
Telegramâs Troubling Role
Telegram, a platform originally designed for secure communication, has found itself at the center of this deepfake crisis. While it is primarily known for features like translation and alert services, it has become a hub for harmful AI bots, and the platform’s CEO, Pavel Durov, has come under scrutiny.
Earlier this year, Durov was arrested and charged with facilitating child pornography after reports surfaced linking the platform to the dissemination of abusive content, including deepfakes. However, despite his arrest, the platform’s lax policies have allowed these bots to continue operating largely unchecked.
Regulatory action has been slow, and while some countries have introduced measures to combat non-consensual deepfakes, global efforts to curb their spread remain fragmented. Meanwhile, the usersâmany of whom are teenagersâare left exposed to these malicious tools.
The Need for Urgent Action
The rise of deepfake bots on Telegram and other platforms highlights the urgent need for comprehensive legal and technological solutions. AI has the power to revolutionize industries, but without stringent ethical guidelines and enforcement, it can just as easily be used to exploit, humiliate, and endanger individuals.
Leaders across the globe, including Indiaâs PM Narendra Modi have called for stricter regulations and more aggressive intervention by platforms like Telegram, but change has been slow.
Also read: PM Modi Pushes for Unified Global Rules on AI and Digital Technology
The potential for AI to transform our world is immense, but as the proliferation of deepfake bots on Telegram shows, it also presents a dark future if left unchecked. Society must grapple with the ethical dilemmas posed by these technologies and take steps to prevent further harm before millions more fall victim to their misuse.