The increasing number of women using the internet is a positive change. But it has also exposed more women to dangers in the virtual world. Yes, it seems that online crimes against women are on the rise. These include sexual harassment, intimidation, threats of rape or death, cyberstalking, and sharing of photos and videos without consent. The survey revealed that 60 percent of girls and women have faced harassment on social media platforms, and about 20 percent of them have either said goodbye to social media or reduced its use due to this. Courts in India give more importance to offline crimes than online crimes against women.
The rise of artificial intelligence-generated content has further aggravated the challenges faced by women in the digital space, leading to new forms of online harassment and privacy violations. This has called for urgent action by both tech companies and governments. Today, when threats to women in cyberspace have multiplied, there is no haven left where they can hide or a heavily guarded area where they can sit and wait for the cyber threats that threaten their dignity to end.
A global survey has revealed that 60 percent of girls and women have faced harassment on social media platforms, and about 20 percent of them have either said goodbye to social media or reduced its use due to this. Similarly, UN Women has found that 58 percent of women and girls worldwide have been subjected to some form of online abuse. These include trolling, stalking, doxing, and other forms of online predatory behavior based on gender, which are emerging as new threats in the digital age.
Artificial intelligence is being used to create deepfake videos and images that target women with fabricated content that is often sexual or defamatory in nature. U.S. Vice President Kamala Harris faced deepfakes depicting her in false and harmful contexts during her campaign for the 2024 presidency. Artificial intelligence tools spread false narratives or misogynistic content designed to undermine the character and credibility of women, particularly targeting women in leadership roles.
Nikki Haley was a victim of manipulated images and fake news during the Republican primaries. Women face a disproportionate level of objectification and sexually explicit content online, amplified by artificial intelligence’s ability to create realistic fake content. Explicit photos of Italian Prime Minister Giorgia Meloni created by artificial intelligence circulated widely on social media.
Deepfakes and altered images created by artificial intelligence violate women’s privacy, often resulting in significant reputational damage and mental distress. Bangladeshi politician Rumin Farhana was targeted with deepfake content ahead of the elections. Steps to mitigate the problem by tech companies and governments.
Companies should invest in advanced artificial intelligence detection systems to proactively flag and remove harmful content before it is widely disseminated, with human monitoring to prevent errors. Meta (Facebook) recently announced artificial intelligence tools to combat deepfakes, but their implementation remains inconsistent. Platforms must provide clear accountability measures and report how they handle flagged content with transparent audits of their moderation policies.
The EU Digital Services Act (2022) mandates digital platforms to report content moderation actions. Tech companies need to ensure that algorithms are designed in a way that reduces gender bias and prevents misuse of artificial intelligence tools for harmful purposes. The Google artificial intelligence principles highlight the responsible use of artificial intelligence, but more implementation is needed.
Governments should enact data protection laws and create specific legal provisions to address the misuse of AI-generated content, including deepfake-specific laws. India’s Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules 2021 provide a framework for content moderation but lack stringent AI-specific regulations. Governments should establish AI ethics boards and frameworks that mandate ethical AI development, with a focus on preventing gender-based discrimination.
The EU’s Artificial Intelligence Act aims to regulate high-risk AI systems, especially in media and surveillance. Governments should launch public awareness campaigns to identify and report deepfake content, particularly targeting vulnerable groups. India’s National Cybercrime
Reporting Portal facilitates easy reporting of cybercrimes involving AI-generated content. Tech companies should be held accountable through monetary penalties if they fail to remove harmful content within a stipulated time frame. The GDPR in the European Union allows for heavy fines on companies that fail to protect users from data misuse.
A proactive, multilateral approach between governments, tech firms, and civil society will ensure the creation of safer digital spaces for women, promote ethical AI development, and ensure robust online security.
