Cybercriminals exploit new AI models for data theft and fraud
Chatbots are helpful tools that can be creatively utilized. They also present an opportunity for cybercriminals already using DeepSeek, a large Chinese language model (LLM) competing with ChatGPT.
Artificial intelligence offers new possibilities. AI tools can streamline work, but these benefits come with risks. It's no surprise that creators of models like ChatGPT are continuously working to improve security systems. Currently, the creators of Qwen and DeepSeek are taking a less rigorous approach to this issue. The latter model can even provide advice on how to commit theft.
Hidden online forums are teeming with manuals that show how to use modern AI to produce harmful content, bypass security mechanisms, and break protective systems. Cybercriminals have already developed detailed instructions on jailbreaking, a technique that removes restrictions imposed on AI models so they can generate uncensored content.
New AI tools targeted by hackers
Experts from Check Point Research highlight four ways hackers are exploiting new AI models. Cybercriminals use Qwen to create advanced software to steal confidential data. This allows them to capture information about payment cards, login credentials, and user passwords, which can then be traded on the black market.
Techniques like "Do Anything Now" or "Plane Crash Survivors" enable cybercriminals to manipulate AI models, forcing them to create content that would typically be blocked. As a result, artificial intelligence can be used to write malware and assist in preparing attacks on computer systems.
Artificial intelligence vs. banks
New attack methods allow cybercriminals to bypass banks' anti-fraud systems. Experts from Check Point Research have found that hackers are sharing methods for intercepting transactions and circumventing security measures in financial institutions.
Cybercriminals leverage the capabilities of ChatGPT, Qwen, and DeepSeek to enhance spam scripts. Consequently, their actions become more effective and more challenging to detect by spam filtering systems.
Therefore, we see that new tools are both an opportunity and a threat on a global scale. Technology companies must implement effective protective mechanisms to counter the growing wave of threats.
