Agentic AI security / Detection research

MCP Detect

MCP-DETECT captures Model Context Protocol tool traffic, applies a bounded set of structural and stateful detections, publishes adversarial evasions, and binds every measurement to exact reproducible evidence.

Scope

Research software, not autonomous enforcement or complete MCP protection. Every corpus and worked example is synthetic and self-authored.

Status
Open source under MIT
Role
Sole engineer, architecture through measurement
Stack
Python, MCP SDK, Wazuh, Docker, JSONL telemetry, Ollama lab
Evidence model
Frozen corpora, rule hashes, golden matches, and denied retests

At a glance

Claim

Makes selected MCP behaviors observable and produces reproducible evidence for five implemented abuse techniques.

Evidence

Ten rules plus two parent anchors, a 4,727-record benign corpus, five compiler gates, and an 18-class evasion corpus.

Boundary

All data is self-authored, 5 of roughly 85 SAF-MCP techniques are implemented, and there is no semantic detection backend.

On this page

The problem

MCP tool calls need inspectable evidence.

MCP connects agents to filesystems, ticketing, memory stores, and internal services. A configuration review can list declared permissions, but it cannot show which tools were actually advertised, what arguments moved through them, whether metadata changed mid-session, or whether an undeclared server appeared in live traffic.

So the project asks a narrower question: what evidence can be extracted from MCP traffic, which abuse techniques are detectable from that evidence, and which classes need controls outside telemetry?

Architecture

Capture once, analyze through bounded paths.

  1. Observe Transparent proxy Forwards MCP JSON-RPC bytes untouched and emits one JSONL event per message.
  2. Structure Telemetry schema Normalizes sessions, server commands, tools, arguments, and direction.
  3. Detect Rules and baseline Wazuh handles structural patterns. Python tracks stateful metadata drift.
  4. Measure Framework gates Runs fixtures, joins alerts to sessions, measures coverage, and records gaps.
  5. Reproduce Frozen evidence Checksums, rule hashes, golden matches, and source-level retests keep each claim inspectable.

Implemented coverage

Five techniques, each with a named evasion.

9/12 documented evasion classes with a working detection; 3 are structurally undetectable

Covered Structurally undetectable blind spot

Tool poisoning

Flags hidden instructions embedded in advertised tool descriptions. It does not catch every semantic manipulation, and meaning-preserving rewrites can evade it.

Credential exfiltration

Correlates a sensitive-file read with secret-shaped content leaving in a later tool argument. Encoded or transformed secrets can evade plaintext matching.

Sensitive absolute paths

Matches a bounded list of high-risk absolute paths used with content-exposing file tools. Renamed tools, new paths, or indirection can evade.

Path traversal

Detects relative escape patterns in file-tool arguments. It complements, and does not replace, server-side path confinement.

Rug pull

Tracks hash-visible tool and server metadata drift across a stateful baseline. A legitimate upgrade looks identical to a malicious swap at this layer, and behavior-only changes are invisible.

Measurement discipline

Gates tied to real historical bugs.

Each detection declares its backends, rules, session join, fixtures, status, and known gaps in a detection.yaml. The framework compiler checks schema, rule references, fixture references, session-key correctness, and false positives against a frozen benign corpus. Its tests reconstruct earlier failures so a new detection cannot silently reintroduce the same class of mistake.

10+2Rules and parent anchors
5Of ~85 SAF-MCP techniques
4,727Benign records, 541 sessions
0False positives on that corpus
12Documented evasion classes
5Write-side compiler gates

The five techniques are behaviors the rules implement. The 12 evasion classes are separate ways those detections can be bypassed: nine leave a signal this sensor can test, while three are structurally invisible at this layer.

Measurement boundary

The corpora and worked examples are self-authored. Results are reproducible, but they are not evidence of performance against independent adversary traffic.

Trust boundaries

An AI Bill of Materials from observed traffic.

The framework inventories observed MCP servers, tool names, version hashes, session counts, filesystem access, and network egress, then compares a declared known-good inventory against observations to surface shadow-server candidates. An unrecognized server is reported as unknown and routed to manual review, not assigned a guessed trust level.

Known limits

The blind spots are part of the result.

  • Coverage breadth. Five of roughly 85 SAF-MCP techniques are implemented.
  • No semantic backend. Prompt manipulation and meaning-preserving obfuscation are out of scope for the current detections.
  • Behavior-only compromise. A tool can return manipulated results without changing any visible metadata.
  • Encoded content. Base64 and similar transforms bypass plaintext secret matching.
  • Self-authored data. Independent or held-out traffic is the highest-value next validation step.
  • Offline analysis. The proxy captures traffic, but the workflow is not positioned as inline production enforcement.

Technical series

Inside MCP Detect, from baseline to denied retest.

I documented the project in three first-person articles. The series starts with model-selected benign traffic, pressure-tests the five detections, and ends at the authorization decision that telemetry could not prove.

  1. Part 1 Start by watching the agent behave 541 sessions, 1,011 model-selected calls, and the accepted zero-call git_show gap.
  2. Part 2 Build the detections, then break them Canonical results, benign regression, ten successful evasions, and the compiler gates those failures created.
  3. Part 3 Follow identity into the handler A synthetic cross-tenant defect, exact source fix, and denied authorization retest.

Source

Inspect it yourself.

The proxy, schema, complete synthetic corpora, rules, drift detector, compiler gates, coverage reports, and authorization reference are public under MIT.