Dev & Engineering model-context-protocolreasoning-oversightrisk-interruptionsession-constitutionmulti-provider-modelsstdio-transporthttp-transportworkflow-automation

Vibe Check MCP

A mentor layer that interrupts agent tunnel vision, over-engineering, and reasoning lock-in.

FollowAgents review · FARS-2.1
Recommended
81/ 100 5-point scale 4.1 / 5
1 2 3 4 5 6
Per-dimension scores and reasoning
1Trust25 / 29 · 4.3/5

The evidence confines the server to advice, session-rule management, and a dedicated learning log; the security policy says it neither executes commands nor reads arbitrary files. HTTP defaults restrict origins and hosts to loopback and cap request bodies. Prompt forwarding to third-party LLMs, log storage, configuration writes, and network exposure are clearly disclosed. Installer tests support atomic 0600 writes, managed-entry safeguards, backups, and rollback. Dependency auditing, CI security checks, and the Hono override are documented thoroughly, including the important limitation that the override does not propagate to consumers. Deductions apply because no per-operation confirmation is shown before external transmission, learning-log writes, or client configuration changes. Sensitive-data protection relies substantially on avoidance guidance and an optional disable setting, while input sanitization remains roadmap work. Authorship, repository, research, and license attribution are clear; unknown registry identity is not treated as suspicious.

2Reliability9 / 14 · 3.2/5

The README, package manifest, CI, and tests are broadly consistent about Node 20, version 2.9.0, transports, and installer behavior. Tests show understandable handling of unsupported Node versions, invalid configuration shapes, and conflicts with unmanaged entries. Deductions apply because no lockfile, complete implementation, or executed results are supplied, so provider and dependency availability cannot be confirmed statically; only Gemini has a described fallback attempt. The headline claim of harmful actions being reduced by 41% is ambiguous against the later approximately 83% to 42% figures, which represent percentage points rather than a 41% relative reduction, and assertions such as fully functional lack runtime evidence here.

3Adaptability18 / 18 · 5.0/5

The intended users and scenarios are explicit, including coding, ambiguous work, high-risk actions, and long-running workflows. The material clearly bounds the five tools, absence of code execution, lack of built-in HTTP authentication, maintenance status, and unfinished input sanitization and structured output. Trigger guidance is precise: after planning, before major or irreversible actions, with a suggested 10–20% interrupt dosage. Node requirements, environment variables, model overrides, stdio and HTTP, Docker, multiple clients, and operating-system-specific paths are covered in depth, justifying full scores for these criteria.

4Convention16 / 18 · 4.4/5

The README has strong navigation, quick starts, configuration tables, security guidance, tool-selection help, and documentation links. Installation, runtime requirements, client differences, and removal procedures are detailed. Package, MCP, and tool naming are stable in the supplied files; version 2.9.0 is consistent, and the complete MIT text matches the metadata. Limitations are unusually explicit, including maintenance mode, missing authentication, prompt-injection risk, network exposure, and the scope of the dependency override. Deductions apply because the table of contents advertises Usage Examples and FAQ sections that are not present in the supplied README excerpt. The changelog is referenced but absent, while the release workflow only demonstrates tag-based note generation. A maintainer and issue channel are identified, but feature development has ended and the security policy's claimed package.json email is not present in the supplied manifest.

5Effectiveness7 / 13 · 2.7/5

A second-model review layer, per-session rules, and optional learning history provide plausible incremental value over a single-agent workflow, supported by a stated study sample and effect claims. Setup is lightweight and the documentation recommends limiting interrupt frequency. Deductions apply because each check adds another model call without quantified latency, token, or monetary cost. Output usability is the largest weakness: the roadmap states that structured output is not yet implemented, implying the central advice remains free-form and less dependable for downstream machine processing. The referenced paper and underlying evaluation data are not included for static validation.

6Verifiability6 / 8 · 3.8/5

Versioning, dependencies, security controls, CI commands, and configuration-write behavior are corroborated across the README, security policy, package manifest, workflows, and tests. Atomic writes, backups, file permissions, and conflict handling receive particularly concrete support. Deductions apply because the research paper, architecture documents, changelog, audit output, lockfile, and complete implementation are not supplied, leaving effectiveness, model compatibility, clean-audit, and runtime-safety claims only partly traceable. The roadmap separates future work reasonably well, but marketing phrases such as enterprise-ready, fully functional, and trusted are not consistently distinguished from independently demonstrated facts.

Evidence confidence: Low Reviewed Sep 17, 2026 Reviewed revision ed8452f2d626
Before you use it
  • The server forwards the full user request and relevant context to a configured third-party LLM. Do not submit credentials, personal data, proprietary code, or other sensitive material unless that provider and its data policy are approved.
  • HTTP mode has no built-in authentication. If it is not strictly loopback-only, place it behind an authenticating proxy, configure MCP_ALLOWED_HOSTS and CORS_ORIGIN explicitly, and avoid wildcard exposure to untrusted networks.
  • vibe_learn writes to ~/.vibe-check/vibe-log.json. Confirm the disable mechanism, retention period, file permissions, and deletion procedure before deployment.
  • The repository-level @hono/node-server override does not propagate when the npm package is consumed as a dependency. Consumers should pin the fixed version themselves and audit the resolved dependency tree.
  • Core feedback is not yet structured and input sanitization remains roadmap work. Do not treat its advice as automatic authorization for irreversible actions; enforce validation and approval in the calling agent.
  • The project is in maintenance mode and only the latest release receives security fixes. Plan for dependency updates, provider model-name changes, and a possible community-maintained successor.
Review evidence [1][2][3][4][5][6][7][8][9]
See the full review method →

What does this agent do, and when should you use it?

Vibe Check MCP is a self-hosted Model Context Protocol server that adds an external metacognitive review layer to agents handling complex or high-risk work. A primary agent submits the full user request and its current plan through `vibe_check`; the server calls a second model and returns mentor-style feedback that challenges assumptions, surfaces uncertainty, and redirects the approach when warranted. Its Chain-Pattern Interrupt mechanism introduces pauses around risk increases or irreversible actions, while a `sessionId` can preserve continuity across checks. The server also exposes optional `vibe_learn` logging and constitution tools for setting, inspecting, and clearing per-session rules. It runs on Node.js 20+, communicates through STDIO or a local HTTP MCP endpoint, and supports Gemini, OpenAI, OpenRouter, and Anthropic model providers. The repository is in maintenance mode, with v2.9.0 identified as the latest maintenance release and only security or bug-fix patches expected.

The end-to-end flow begins when an MCP client starts the server and calls vibe_check with a goal, plan, full request, and optional sessionId or modelOverride. The server invokes a second model through the selected provider and produces reflective feedback about assumptions, risks, and the proposed next action. When a sessionId is present, it summarizes earlier advice to maintain continuity; if a Gemini request fails, it retries once with gemini-3.5-flash-lite and then falls back to static questions. vibe_learn records resolved mistakes, preferences, or successful patterns for later reflection. update_constitution, check_constitution, and reset_constitution respectively set or merge, inspect, and clear rules that the CPI layer should honor for a session. Its deployment boundary is a local Node.js MCP process: an MCP client can own it over STDIO, or it can expose /healthz and the /mcp JSON-RPC endpoint over HTTP on port 2091 by default.

  1. A developer supervising an agent-led refactor can require vibe_check after planning and before major edits to catch architecture that exceeds the actual requirement.
  2. A team assigning an ambiguous request can send the original request and current plan to a second model to expose missing constraints or unsupported assumptions.
  3. Engineers running high-risk automation can place CPI pauses before external calls, data writes, or other irreversible actions.
  4. A long-running workflow can reuse one sessionId so later reviews incorporate earlier advice instead of restarting without context.
  5. A team with operational policies can use a session constitution to enforce rules such as no external network access or running unit tests before refactoring.
  6. Organizations using several model vendors can select Gemini, OpenAI, OpenRouter, or Anthropic globally or override the provider and model for an individual check.

What are this agent's strengths and limitations?

Pros
  • It uses an independent second model as a mentor that can challenge a primary agent before consequential work, rather than merely logging outcomes afterward.
  • Both STDIO and streamable HTTP MCP transports are documented, with client setup paths for Claude Desktop, Cursor, Windsurf, and Visual Studio Code.
  • The provider layer covers Gemini, OpenAI, OpenRouter, and Anthropic, with global defaults and per-call modelOverride selection.
  • Session history and constitution tools combine continuity of prior advice with enforceable per-session operating rules.
  • HTTP mode includes concrete safeguards: loopback-only CORS defaults, Host-header validation, and a configurable JSON body limit.
Limitations
  • The project is in maintenance mode and has ended active feature development; structured vibe_check output, general exponential-backoff retries, and input sanitization remain roadmap items.
  • Useful checks normally invoke a second external model, adding network dependence, provider charges, latency, and privacy considerations for the submitted task context.
  • Adoption requires Node.js 20+ and either MCP client configuration or operation of an HTTP service; it is not an infrastructure-free feature embedded in the primary agent.
  • Non-loopback HTTP deployments upgrading to v2.9.0 must configure MCP_ALLOWED_HOSTS or receive HTTP 403 responses.
  • The README reports CPI evaluation results, but it does not establish independent performance guarantees across every model, repository size, or production environment.

How do you install or deploy this agent?

Node.js 20 or newer and npm are required. To run the STDIO server without a local installation:

npx -y @pv-bhat/vibe-check-mcp start --stdio

Add this entry to an MCP client configuration:

{
"mcpServers": {
"vibe-check-mcp": {
"command": "npx",
"args": ["-y", "@pv-bhat/vibe-check-mcp", "start", "--stdio"]
}
}
}

Configure at least one provider credential: GEMINI_API_KEY, OPENAI_API_KEY, OPENROUTER_API_KEY, or ANTHROPIC_API_KEY. Select the default with DEFAULT_LLM_PROVIDER=gemini|openai|openrouter|anthropic and optionally set DEFAULT_MODEL. For source development:

git clone https://github.com/PV-Bhat/vibe-check-mcp-server.git
cd vibe-check-mcp-server
npm ci
npm run build
npm test

How do you use this agent?

In the primary agent's system prompt, require vibe_check after planning and before major or irreversible actions, and pass the complete user request plus the current plan. A call can select a model explicitly:

{ "goal": "...", "plan": "...", "modelOverride": { "provider": "anthropic", "model": "claude-opus-5" } }

Reuse a sessionId when reviews should share history, and optionally call vibe_learn after correcting a mistake. Manage session rules with update_constitution({ sessionId, rules }), check_constitution({ sessionId }), and reset_constitution({ sessionId }). For manual HTTP inspection, run npx -y @pv-bhat/vibe-check-mcp start --http --port 2091, check http://127.0.0.1:2091/healthz, and send JSON-RPC requests to http://127.0.0.1:2091/mcp. When serving v2.9.0 through Docker, a reverse proxy, or any non-loopback hostname, add that hostname to MCP_ALLOWED_HOSTS or requests will be rejected with HTTP 403.

FAQ

Does it create additional model costs?
Usually. Vibe Check calls a second model to generate feedback, so cost depends on the selected Gemini, OpenAI, OpenRouter, or Anthropic service and how often checks run. No fixed price is documented.
Is Gemini mandatory?
No. Gemini is the default provider, but OpenAI, OpenRouter, and Anthropic are also supported. Environment variables or a per-call modelOverride can select another provider.
What happens when the model provider fails?
A failed Gemini call is retried once with gemini-3.5-flash-lite, after which the server falls back to static questions. Broader retry handling with exponential backoff is still listed on the roadmap.
Does it edit code or execute the primary plan itself?
Its documented role is to return reflective MCP feedback, store optional learning records, and manage session rules. Coding, filesystem changes, and external actions remain the responsibility of the primary agent.
Is it a good long-term dependency for a new project?
The server remains functional and is expected to receive security and bug fixes, but active feature development has stopped. Teams needing continued feature work should account for that maintenance risk or maintain a community fork under the MIT license.

Compare agents like this one

The same FARS review applied across the shortlist this agent qualifies for.

Related agents