- Home
- AI Security Testing Tools
- RAMPART
On the recordRead 9 Oct 202625 facts
RAMPART
On the record
- Attack and probe tests
- Its two test categories are attacks, where a detected attack means UNSAFE, and probes, where detected expected behavior means SAFE.microsoft.github.io · read 8 Oct 2026
- Attack testing
- Its XPIA tests check whether malicious content planted in data sources can manipulate an agent when retrieved.microsoft.github.io · read 9 Oct 2026
- Behavior probes
- Behavioral probes check for expected responses, tool use, or side effects and are described as useful for regression testing.microsoft.github.io · read 9 Oct 2026
- Evaluation output
- Results include a safety status of SAFE, UNSAFE, UNDETERMINED, or ERROR, along with trace and evaluation details.microsoft.github.io · read 9 Oct 2026
- Included tests
- The documented built-in attack is cross-prompt injection (XPIA), and the documented probe verifies expected agent behavior.microsoft.github.io · read 8 Oct 2026
- Install requirements
- The installation guide requires Python 3.11 or later and supports installation with uv or pip.microsoft.github.io · read 9 Oct 2026
- Integration model
- Users provide an adapter connecting their agent to RAMPART, which supplies execution strategies, evaluators, pytest integration, and reporting.microsoft.github.io · read 8 Oct 2026
- Intended users
- The project describes its framework as a developer-friendly way to write and run safety and security tests for AI agents.github.com · read 9 Oct 2026
- License
- The GitHub repository identifies RAMPART as MIT-licensed.github.com · read 9 Oct 2026
- Limitations
- The xdist documentation says results recorded only during fixture teardown are excluded from report streaming and mixed RAMPART versions across controller and workers are unsupported.microsoft.github.io · read 8 Oct 2026
- Maker
- The documentation identifies Microsoft Corporation as its copyright holder.microsoft.github.io · read 8 Oct 2026
- OneDrive
- An optional onedrive extra installs dependencies for using the built-in OneDriveSurface to place XPIA payloads in OneDrive.microsoft.github.io · read 8 Oct 2026
- Optional integration
- The optional onedrive extra adds dependencies for using the built-in OneDriveSurface to place XPIA payloads in OneDrive.microsoft.github.io · read 9 Oct 2026
- Parallel execution
- RAMPART supports pytest-xdist parallel runs and produces a unified report across worker processes.microsoft.github.io · read 8 Oct 2026
- Purpose
- RAMPART is a pytest-native safety testing framework for agentic AI applications.microsoft.github.io · read 9 Oct 2026
- PyRIT
- RAMPART uses PyRIT for LLM interaction, prompt normalization, and conversation memory, and installs PyRIT as a dependency.microsoft.github.io · read 8 Oct 2026
- PyRIT integration
- RAMPART uses PyRIT for LLM interaction, prompt normalization, and conversation memory, and installs PyRIT as a dependency.microsoft.github.io · read 9 Oct 2026
- pytest integration
- RAMPART registers as a pytest plugin automatically and provides harm and trial markers.microsoft.github.io · read 9 Oct 2026
