Skip to content
AI Policy Generator

Assessments, matrices and reports · Checklist · Tools and instruments

Adversarial Security and Robustness Checklist

Checklist of robustness and adversarial tests for AI models and apps: prompt injection, data leakage, jailbreaks, poisoning and evasion.

GROU LLC · built on AI Business Core, by Vreinn · · How we verify sources

Who it helps

Security and engineering teams launching LLM apps or in-house models.

Who uses it
CISO, IT, architecture, security, data and technical implementation teams
Usual owner
CISO; AI team
Formats
DOCX, PDF
Languages
Español, English
Approximate length
4 pages
Length
Short. A notice, a letter, a register or a checklist, ready to fill in.
Document type
Assessments, matrices and reports. Tools to analyze a system, a vendor or a risk and document the conclusion.
Document code
APG-TLS-002. APG is the AI Policy Generator collection, TLS the area (Tools and instruments) and the number identifies the document. Use it to cite the document in your document system.

Preview

Excerpt generated from the document: the "How to use this document" section, the title and the first two sections, plus the full table of contents. The rest of the text is not shown.

APG-TLS-002 · Version 1.1.0 · sources as of November 4, 2026

How to use this document

  • What it is for. This is a base checklist to confirm, before a pilot, a production release or a relevant change, that an AI model or application was tested against manipulation and failure: prompt injection, jailbreaks, data leakage, agent abuse, poisoning, evasion, out-of-distribution inputs, service abuse and, for third-party models hosted internally, backdoors, tampered chat templates and embedded alignment or censorship. It does not replace a penetration test or a full red-team exercise, but it records what was tested, what was found and what was decided.
  • Who should own it. Information security, together with the system owner and the technical team that builds or integrates the system. Enter the function in [RESPONSIBLE FUNCTION] and the person who signs off the result in [OWNER].
  • Decisions to take first. Decide the testing depth for each risk level (aid C), who runs the tests (internal team, independent team or third party), which severity blocks deployment and who may accept residual risks.
  • Fields to complete. Complete the identification details, mark each control as "Met," "Partial," "Not met" or "N/A," note the evidence and record each finding in Section 14. Use "Module selection" to keep the sections that match your profiles and the type of system.
  • Country variants. This document has no country variants. Use "Related regulatory references" to see which cybersecurity, products-with-digital-elements or AI laws expect your organization to run adversarial testing or document robustness.
  • Technical references. To design test cases, you can draw on public catalogs such as the OWASP Top 10 for LLM Applications (2025 edition), MITRE ATLAS and NIST AI 600-1.
  • Approval and filing. The decision in Section 15 is signed by information security and the system owner; the [AI COMMITTEE] decides when the system is High risk and the decision is "Approve with conditions" or "Escalate." File the checklist with the model card and, for third-party models hosted internally, record the summary in their provenance sheet.

Module selection

Profile, level or system type Sections to keep
All 1 to 4, 7, 9, 11, 12, 14 and 15
P2 Integrates models through APIs or RAG Also 5 and 6; and 13.5 and 13.6 if it uses third-party models in Medium- or High-risk systems
P3 Hosts models, including open-weight models Also 5, 6 and 13
P4 Trains or fine-tunes models Also 10 and, if it fine-tunes a language model, 5, 6 and 13.7
P5 Uses agents that act in systems Also 5, 6 and 8
Classic classification or scoring model Also 10
Basic level Rows with no level marker
Standard and Reinforced level All rows, with rows marked [REINFORCED LEVEL] only at the Reinforced level

Delete the sections that do not apply to your organization.

Adversarial Security and Robustness Checklist

Field Value
Organization [LEGAL ENTITY NAME]
Responsible function [RESPONSIBLE FUNCTION]
Verification owner [OWNER]
AI system [AI SYSTEM]
Model and application version [COMPLETE]
Model vendor or developer [VENDOR]
Deployment profiles of the system [COMPLETE: P1 to P5]
Type of system [COMPLETE: language model application, retrieval-augmented search over documents, agent with tools, classic classification or scoring model, vision or other]
Stage [COMPLETE: before pilot, before production, relevant change or periodic review]
Risk level (per the "AI System Inventory") [COMPLETE: Low, Medium or High]
Testing team [COMPLETE: internal, independent or third party]
Testing dates From [DATE] to [DATE]

1. Using the checklist

1.1 [ORGANIZATION NAME] applies this checklist to every Medium- or High-risk AI system, every AI application exposed to customers or the public, every agent that can take actions and every third-party model hosted on owned or rented infrastructure, before the pilot, before production and after relevant changes to the model, system instructions, data sources, connected tools, weights version or chat template.

1.2 Each control is marked as follows:

Result Meaning
Met The control exists and was tested, with evidence.
Partial The control exists but does not cover all cases or was not fully tested.
Not met The control does not exist or the test failed.
N/A Does not apply to this type of system; the reason is stated.

1.3 Each "Partial" or "Not met" generates a finding in Section 14 with its severity. Finding severity is not a risk level: when the finding is recorded in the risk register of the "AI Risk Management Procedure," it is given the risk level shown in the last column.

Finding severity Criterion Risk level in the register
Critical Allows confidential or personal data to be exposed, unauthorized actions to be taken, a hidden model behavior to be triggered, or unlawful or seriously harmful content to be generated in a reproducible way. High (Unacceptable if it amounts to a prohibited practice)
High Allows relevant controls to be bypassed or outputs to be significantly degraded with moderate effort. High
Medium Requires unlikely conditions or has a limited and reversible impact. Medium
Low Minor or good-practice weakness, with no demonstrated direct impact. Low

2. Scope and threat model

ID Control Result Evidence
2.1 The system is in the "AI System Inventory," with its system owner and technical lead identified. [COMPLETE] [COMPLETE]
2.2 The assets to protect are documented: data, system instructions, credentials, connected tools, the model itself and reputation. [COMPLETE] [COMPLETE]
2.3 Potential attackers and abusers are identified: external users, internal users, third-party content the system reads and vendors. [COMPLETE] [COMPLETE]
2.4 All entry points to the model are identified: user messages, documents, web pages, emails, tool responses and training data. [COMPLETE] [COMPLETE]
2.5 The consequences that would be unacceptable for this system are defined. [COMPLETE] [COMPLETE]

Full table of contents of the document:

  • 1. Using the checklist
  • 2. Scope and threat model
  • 3. Governance and preparation
  • 4. Inputs and data
  • 5. Prompt injection
  • 6. Jailbreaks and disallowed content
  • 7. Data leakage and privacy
  • 8. Agents, tools and output handling [MODULE P5]
  • 9. Poisoning and supply chain
  • 10. Evasion and model robustness
  • 11. Availability and service abuse
  • 12. Monitoring, response and resilience
  • 13. Third-party and open-weight models hosted internally [MODULE P3]
  • 14. Findings log
  • 15. Decision and approval
  • Implementation aids
  • Related regulatory references
  • Version history

Rules in the registry whose obligations relate to this base document, based on our reading of the sources. It does not mean they apply to you.

Brazil

Chile

Ecuador

European Union

International standards

Peru

Texas

Kits that include this document

Includes 6 documents

AI Integrators Kit

Six base documents for integrating third-party models through APIs or RAG: due diligence, model provenance, architecture, integration map, adversarial security and service level agreement.

USD 119USD 194

Complete kit · available to buy

Includes 7 documents

Self-Hosted and Open-Weight Models Kit

Seven base documents for hosting in-house or open-weight models: provenance, security baseline, adversarial testing, architecture, model card, life cycle and rollback.

USD 149USD 233

Complete kit · available to buy

Includes 8 documents

AI Agents Kit

Six base documents for agents that act in systems: autonomy and permissions policy, integration map, adversarial testing, human oversight, rollback and incident response.

USD 169USD 292

Complete kit · available to buy

Includes 91 documents

Complete pack

Every sellable template in the catalog in a single pack: base policies, procedures, registers, notices and matrices to adapt with your own team, at a flat price below the sum of the individual documents.

USD 297USD 3393

Complete kit · available to buy

What AI Policy Generator is and how it works