NEW YORK – A scourge of pornographic deepfake images generated by artificial intelligence and sexualising people without their consent has hit its most famous victim, singer Taylor Swift, drawing attention to a problem that tech platforms and anti-abuse groups have struggled to solve.

Sexually explicit and abusive fake images of Swift began circulating widely this week on the social media platform X.

Her ardent fanbase of Swifties quickly mobilised, launching a counteroffensive on the platform formerly known as Twitter and a #ProtectTaylorSwift hashtag to flood it with more positive images of the pop star. Some said they were reporting accounts that were sharing the deepfakes.

The White House said on Friday it was alarmed by fake online images of the pop singer and said social media companies have an important role to play in enforcing their own rules to prevent the spread of such misinformation.

“This is very alarming. And so, we’re going to do what we can to deal with this issue,” White House Press Secretary Karine Jean-Pierre said at a news briefing, adding that Congress should take legislative action on the issue.

The deepfake-detecting group Reality Defender said it tracked a deluge of nonconsensual pornographic material depicting Swift, particularly on X. Some images also made their way to Meta-owned Facebook and other social media platforms.

“Unfortunately, they spread to millions and millions of users by the time that some of them were taken down,” said Mason Allen, Reality Defender’s head of growth.

The researchers found at least a couple dozen unique AI-generated images. The most widely shared were football-related, showing a painted or bloodied Swift that objectified her and in some cases inflicted violent harm on her deepfake persona.

Researchers have said the number of explicit deepfakes have grown in the past few years, as the technology used to produce such images has become more accessible and easier to use. In 2019, a report released by the AI firm DeepTrace Labs showed these images were overwhelmingly weaponised against women. Most of the victims, it said, were Hollywood actors and South Korean K-pop singers.

When reached for comment on the fake images of Swift, X directed the AP to a post from its safety account that said the company strictly prohibits the sharing of non-consensual nude images on its platform.

“Our teams are actively removing all identified images and taking appropriate actions against the accounts responsible for posting them,” the company wrote in the X post early Friday morning.

“We’re closely monitoring the situation to ensure that any further violations are immediately addressed, and the content is removed.”

Meanwhile, Meta said in a statement that it strongly condemns “the content that has appeared across different internet services” and has worked to remove it.

“We continue to monitor our platforms for this violating content and will take appropriate action as needed,” the company said.

A representative for Swift didn’t immediately respond to a request for comment Friday.

Allen said the researchers are 90 per cent confident that the images were created by diffusion models, which are a type of generative artificial intelligence model that can produce new and photorealistic images from written prompts. The most widely known are Stable Diffusion, Midjourney and OpenAI’s DALL-E. Allen’s group didn’t try to determine the provenance.

–with Reuters

News all day, every day at CityNews.com.au.