Indirect Prompt Injection: The Foundational Paper on Remotely Controlled AI Assistants
Hechos validados
Seminal work by Greshake et al. (Feb. 2023, arXiv:2302.12173). Shows how malicious control instructions can be hidden in web pages, PDFs, or emails to remotely control AI assistants when they summarize those documents.
Explicación sencilla
A cuckoo's egg in the mailbox: The AI reads your mail aloud, finds a hidden note in the text, and secretly transfers your pocket money to strangers.
Relevancia de seguridad y consejo práctico
The fundamental architectural weakness of LLMs: text data and control instructions share the same channel.