The MCP Eval Runner is a standardized testing harness for MCP servers and agent workflows that allows users to define test cases as YAML fixtures and run regression suites directly from their MCP client.
From the registry: A standardized testing harness for MCP servers and agent workflows
Please install the `mcp-eval-runner` MCP server into my current AI client (that's you).
Required prerequisites (do these first if not already done):
- **Node.js v22.5.0+** — Requires Node.js 22.5.0 or newer
Canonical MCP server config (stdio transport):
- command: `npx`
- args: ["-y","mcp-eval-runner@latest"]
Note: Standardized YAML-fixture testing harness for MCP servers. Default fixture directory is ./evals (override with --fixtures=<path>). Supports --watch, --timeout, --format, --concurrency flags.
Add this MCP server to my current client's config in the correct format for you. If you need secrets or credentials I haven't provided, ASK me — do not invent values or leave raw placeholders. After adding it, tell me how to verify the server is connected.Real-time infrastructure monitoring with metrics, logs, alerts, and ML-based anomaly detection.
Persistent codebase knowledge graph. Survives session restarts and context compaction.
Validate oh-my-posh configurations and segment snippets against the official schema.