101 indexed

ATLASATLAS adversarial ML techniques

101 MITRE ATLAS top-level techniques covering the adversarial-ML attack surface, grouped by tactic. Authored by Adam Lundqvist.

12 in Defense Evasion · 101 total

IDTitleSummary
AML.T0067LLM Trusted Output Components ManipulationAdversaries may utilize prompts to a large language model (LLM) which manipulate various components of its response in order to make it appear trustworthy to t…
AML.T0068LLM Prompt ObfuscationAdversaries may hide or otherwise obfuscate prompt injections or retrieval content to avoid detection from humans, large language model (LLM) guardrails, or ot…
AML.T0071False RAG Entry InjectionAdversaries may introduce false entries into a victim's retrieval augmented generation (RAG) database. Content designed to be interpreted as a document by the …
AML.T0073ImpersonationAdversaries may impersonate a trusted person or organization in order to persuade and trick a target into performing some action on their behalf. For example, …
AML.T0074MasqueradingAdversaries may attempt to manipulate features of their artifacts to make them appear legitimate or benign to users and/or security tools. Masquerading occurs …
AML.T0076Corrupt AI ModelAn adversary may purposefully corrupt a malicious AI model file so that it cannot be successfully deserialized in order to evade detection by a model scanner. …
AML.T0092Manipulate User LLM Chat HistoryAdversaries may manipulate a user's large language model (LLM) chat history to cover the tracks of their malicious behavior. They may hide persistent changes t…
AML.T0094Delay Execution of LLM InstructionsAdversaries may include instructions to be followed by the AI system in response to a future event, such as a specific keyword or the next interaction, in orde…
AML.T0097Virtualization/Sandbox EvasionAdversaries may employ various means to detect and avoid virtualization and analysis environments. This may include changing behaviors based on the results of …
AML.T0107Exploitation for Defense EvasionAdversaries may exploit a system or application vulnerability to bypass security features. Exploitation of a vulnerability occurs when an adversary takes advan…
AML.T0109AI Supply Chain Rug PullAdversaries may publish legitimate AI components or software, gain user adoption, then push an update with a malicious variant, leading to [AI Supply Chain Com…
AML.T0111AI Supply Chain Reputation InflationAI Supply Chain Reputation Inflation is the process of building or leveraging genuinely credible-looking trust signals to increase the perceived legitimacy of …
Sourced from MITRE ATLAS. Curated by Adam Lundqvist, Founder at SQUR.
MITRE ATLAS adversarial ML techniques — by tactic | SQUR Knowledge Base