Microsoft talks about lawsuit against AI hackers over explicit image abuse

Microsoft has been constantly pushing for responsible AI use

Reading time icon 2 min. read


Readers help support Windows Report. We may get a commission if you buy through our links. Tooltip Icon

Read our disclosure page to find out how can you help Windows Report sustain the editorial team. Read more

Microsoft lawsuit AI hacker image abuse feature banner

AI has been taking our lives for good and bad reasons. In the recent past, we have come across multiple instances of bad actors using AI for malicious activities, which includes creating explicit deepfakes and AI-generated harmful content. Well, Microsoft recently took action against a group of AI hackers by slapping a lawsuit.

Yesterday, the company shared all the details about how it is taking down AI hackers. So, how it all started?

Microsoft’s AI Incident Detection and Response team discovered hackers had stolen a customer’s access code for an AI image generator. This allowed hackers to bypass safeguards and create inappropriate images.

Although Microsoft revoked the stolen code, the hackers kept using stolen credentials, and the damage kept spreading on anonymous message boards. In response, Microsoft filed lawsuit against Storm-2139, a group of six hackers, who created tools to hack into AI platforms like Azure OpenAI Service.

Ten other hackers used these tools to produce explicit AI images that violated Microsoft’s terms of service. The hackers are from countries like Iran, England, Hong Kong, and Vietnam.

Court filings suggests that hackers produced thousands of offensive AI-generated images—many of which were misogynistic, violent, or sexualized.

These images disproportionately targeted women, people of color, and public figures. This lawsuit reminds us how powerful AI is—and how easily bad actors can misuse it

This lawsuit isn’t just about holding these individuals accountable; it’s Microsoft’s way of saying AI should be used responsibly. The company is also working alongside lawmakers and advocates to make sure these kinds of abuses don’t happen in the future.

More about the topics: AI, microsoft

User forum

0 messages