AI‑fueled identity fraud surges: Social media under siege

The latest Global Identity Fraud Report by AU10TIX highlights a growing threat of identity fraud fueled by AI-based attacks. An analysis of millions of transactions from July to September 2024 shows that digital platforms, particularly social media, payments, and cryptocurrencies, face unprecedented challenges.

Fraud has evolved from simple document forgery to sophisticated synthetic identities, deepfake images, and automated bots that can bypass traditional verification systems. Social media witnessed a dramatic increase in bot attacks before the U.S. presidential elections 2024. The report indicates that attacks on social media accounted for 28 percent of all fraud attempts in Q3 2024, a significant leap from 3 percent in Q1.

These attacks focus on spreading misinformation and large-scale manipulation of public opinion. AU10TIX underscores that bot-driven disinformation campaigns employ advanced Generative AI (GenAI) elements to evade detection. This innovation enables attackers to scale operations while bypassing traditional verification systems.

One of the most striking findings in the report is the emergence of completely synthetic deepfake selfies—hyper-realistic images designed to circumvent verification systems. AU10TIX emphasizes that these synthetic selfies present a unique challenge to traditional KYC (Know Your Customer) procedures.

AU10TIX recommends that organizations move beyond traditional document-based verification methods. A key recommendation is adopting behavior-based detection systems that probe deeper than standard identity checks. Companies can identify anomalies indicative of potentially fraudulent activity by analyzing user behavior patterns, such as login routines, traffic sources, and other unique behavioral cues.

The use of artificial intelligence in crime poses a serious cybersecurity threat. The FBI warns that this technology allows fraudsters to create realistic content that facilitates fraud. The rapid generation of fake documents and images is becoming more common, necessitating increased vigilance and caution online.

Education and cooperation are becoming critical in the fight against cybercrime. Not only law enforcement agencies, but users must also be aware of threats and prevention methods. Regularly reporting suspicious activity and exercising caution when sharing data are the foundation of protection in the digital age.