Facebook’s new AI stickers can generate child soldiers, Elmo with a knife

Enlarge / A selection of AI-generated stickers created in Facebook Messenger and shared on social media site X. (credit: Meta)

Less than a week after Meta unveiled AI-generated stickers in its Facebook Messenger app, users are already abusing it to create potentially offensive images and sharing the results on social media, reports VentureBeat. In particular, an artist named Pier-Olivier Desbiens posted a series of virtual stickers that went viral on X on Tuesday, starting a thread of similarly problematic AI image generations shared by others.

"Found out that facebook messenger has ai generated stickers now and I don't think anyone involved has thought anything through," Desbiens wrote in his post. "We really do live in the stupidest future imaginable," he added in a reply.

Available to some users on a limited basis, the new AI stickers feature allows people to create AI-generated simulated sticker images from text-based descriptions in both Facebook Messenger and Instagram Messenger. The stickers are then shared in chats, similar to emojis. Meta uses its new Emu image synthesis model to create them and has implemented filters to catch many potentially offensive generations. But plenty of novel combinations are slipping through the cracks.