“We’re going to partner with Microsoft to figure out if there are ways using our archive of material to create a sort of gen AI detection system in order to counter the emerging threat that gen AI will be used for terrorist content at scale,” Hadley says. “We’re confident that gen AI can be used to defend against hostile uses of gen AI.”

The partnership was introduced right this moment, on the eve of the Christchurch Call Leaders’ Summit, a motion designed to eradicate terrorism and extremist content material from the web, to be held in Paris.

“The use of digital platforms to spread violent extremist content is an urgent issue with real-world consequences,” Brad Smith, vice chair and president at Microsoft stated in a press release. “By combining Tech Against Terrorism’s capabilities with AI, we hope to help create a safer world both online and off.”

While firms like Microsoft, Google, and Facebook all have their very own AI analysis divisions and are possible already deploying their very own sources to fight this challenge, the brand new initiative will finally help these firms that may’t fight these efforts on their very own.

“This will be particularly important for smaller platforms that don’t have their own AI research centers,” Hadley says. “Even now, with the hashing databases, smaller platforms can just become overwhelmed by this content.”

The menace of AI generative content material is just not restricted to extremist teams. Last month, the Internet Watch Foundation, a UK-based nonprofit that works to eradicate youngster exploitation content material from the web, published a report that detailed the growing presence of child sexual abuse material (CSAM) created by AI instruments on the darkish internet.

The researchers discovered over 20,000 AI-generated photographs posted to at least one darkish internet CSAM discussion board over the course of only one month, with 11,108 of those photographs judged probably to be prison by the IWF researchers. As the IWF researchers wrote of their report, “These AI images can be so convincing that they are indistinguishable from real images.”