Blackmailers are using AI to generate nudes from social media photos

The latest digital security bulletin from the FBI is sure to turn some heads, in both the literal and figurative sense. According to the US federal law enforcement agency, criminals are using AI-generated images to put a new spin on blackmail. They’ve been seen using publicly-posted images on social media and running them through an AI image generator to create convincing (but entirely fake) nude photos, then extorting the victims for money or real photos, in a practice the bureau is calling “sextortion.”

This sort of thing isn’t exactly new — nothing was stopping malefactors from using social media selfies and Photoshop before, and that’s happened in some isolated cases. The danger comes from the ease of access to this technique created by new AI “deepfake” image tools. Now criminals don’t need months or years of experience in convincing image manipulation, they just need a few photos and the right software. The bureau says that fake explicit images of both adults and children have been spread on porn sites for general harassment in addition to being sent directly to victims for extortion attempts. The FBI has noticed an increase in victim reports over the last few months.

AI-generated image tools have become incredibly easy to access for the public in the last year. One need only go to Bing to generate, say, a photo of “Marilyn Monroe in lederhosen.” Most public-facing AI image generators won’t let you train them on a set of specific photos or generate anything verging on pornography. But there are community-created software tools that can be run on individual PCs (often with the help of powerful consumer-grade hardware) without any such restrictions.

Options for victims are few and frustrating. According to the FBI’s report (spotted by BleepingComputer), parents are recommended to closely monitor their children’s online activity and periodically search for their personal info in places it shouldn’t be. A good tip is using reverse image search services like Google or TinEye to find places where your personal photos may have been posted without your consent. Victims are instructed to not pay or otherwise appease blackmailers — it does not guarantee removal of images or video from the internet — and otherwise follow standard social media safety steps like declining friend requests from strangers and utilizing any available privacy settings.