Automation & Ops ai-securityred-teamingvulnerability-scanningmcp-securityjailbreak-evaluationopenclawllm-security

AI-Infra-Guard (A.I.G) – AI Red Teaming Platform by Tencent Zhuque Lab

Full-stack AI security self-inspection: OpenClaw security scan, agent/MCP/skill scan, AI infra vulnerability scan, and jailbreak evaluation.

FollowAgents review · FARS-2.1
Not recommended
48/ 100 5-point scale 2.4 / 5
1 2 3 4 5 6
1Trust7 / 29 · 1.2/5

Evidence shows: README explicitly states the platform lacks authentication and is intended for internal use only, defaulting to 127.0.0.1, reflecting least privilege (least_privilege=1). No user confirmation mechanism is provided (user_confirmation=0). Data flow transparency: README describes scan targets, API keys, etc., but lacks internal processing details (data_flow_transparency=1). Sensitive data handling: SECURITY.md provides API key protection advice but no implementation evidence (sensitive_data_handling=1). Dependency security: go.mod lists many dependencies but no vulnerability scanning or audit evidence (dependency_security=1). External effects: scanning actively connects to targets, but README clarifies this is intended (external_effects=1). Rollback mechanism not mentioned (rollback=0). Source attribution: README and code files attribute to Tencent Zhuque Lab, but publisher unverified (source_attribution=1).

2Reliability6 / 14 · 2.1/5

Evidence shows: README and SECURITY.md are consistent in describing platform positioning and trust model (self_consistency=2). Dependency availability: go.mod lists many dependencies but no version pinning or mirror info (dependency_availability=1). Failure messages: SECURITY.md provides report template but no runtime error handling (failure_messages=1).

3Adaptability10 / 18 · 2.8/5

Evidence shows: README identifies target users (enterprise/individual internal use) and multiple scenarios (audience_and_scenarios=2). Capability boundaries: README details scan types and limitations (capability_boundaries=2). Trigger precision: provides commands and parameters but not detailed trigger conditions (trigger_precision=1). Environment fit: supports Docker, CLI, multi-platform, but lacks system requirements (environment_fit=2).

4Convention13 / 18 · 3.6/5

Evidence shows: README is well-structured with quick start, features, API docs (information_architecture=2). Install notes: provides Docker, script, source methods (install_notes=2). Naming stability: consistent project and module naming (naming_stability=2). Examples and FAQ: README provides examples, FAQ links to external docs (examples_and_faq=2). Known limitations: README explicitly states lack of authentication, internal use only (known_limitations=2). License: Apache-2.0 full text (license=3). Versioning and changelog: README lists version updates, CHANGELOG.md exists (versioning_changelog=2). Maintenance responsibility: SECURITY.md provides maintainer contact and disclosure process (maintenance_responsibility=2).

5Effectiveness9 / 13 · 3.5/5

Evidence shows: Output usability: provides report format and API docs (output_usability=2). Marginal value: offers multiple scanning capabilities with unique value (marginal_value=2). Cost benefit: free and open source, but requires Docker and resources (cost_benefit=2).

6Verifiability3 / 8 · 1.9/5

Evidence shows: Claim traceability: README performance data lacks test methodology or source (claim_traceability=1). Cross-source corroboration: relies only on README and SECURITY.md, no independent verification (cross_source_corroboration=1). Fact-inference separation: README mixes facts and inferences without clear distinction (fact_inference_separation=1).

Evidence confidence: Low Reviewed Aug 09, 2026 Reviewed revision 2ce1ca9abc40
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
Safety controls not found in source: confirmation before acting, rollback or recovery path
Before you use it
  • The platform lacks authentication and is intended for internal use only; do not expose to public networks.
  • Protect sensitive information such as API keys to avoid leakage.
  • Many dependencies; recommend security audit.
Review evidence [1][2][3][4][5][6][7][8][9]
See the full review method →

What does this agent do, and when should you use it?

A.I.G (AI-Infra-Guard) is an open-source AI red teaming platform by Tencent Zhuque Lab, designed to help enterprises and individuals conduct comprehensive security self-assessments of AI systems. It integrates multiple core capabilities: ClawScan (OpenClaw security scan), agent security scan, MCP server and agent skills scan, AI infrastructure vulnerability scanning (covering 100+ components and 1900+ CVEs), and LLM jailbreak evaluation. Users can deploy it quickly via Docker and use the web UI (default port 8088) or CLI tools (e.g., aig-skill-scan). The project is open-sourced under Apache 2.0, with complete API documentation and a plugin extension mechanism.

A.I.G offers several scanning and evaluation capabilities: 1) AI infrastructure vulnerability scan: fingerprints running AI services (e.g., vLLM, Ollama, ComfyUI) and matches against 1900+ known CVEs, outputting component version, vulnerability severity, and remediation links; 2) MCP server and agent skills scan: detects 14 major categories of security risks from source code or remote URLs, including tool poisoning, credential exfiltration, command injection, etc.; 3) Agent scan: an independent multi-agent automated scanning framework to evaluate the security of AI agent workflows on platforms like Dify and Coze; 4) Jailbreak evaluation: tests target LLM APIs with curated datasets and multiple attack methods (e.g., multi-turn PAIR, GOAT) and provides cross-model comparisons; 5) ClawScan: one-click evaluation of OpenClaw security risks. Users can trigger scans via the web UI or use CLI tools (e.g., aig-skill-scan) to integrate into CI/CD pipelines.

  1. Security teams deploy A.I.G internally to scan running AI services like vLLM and Ollama for vulnerabilities, ensuring infrastructure security
  2. Developers integrate aig-skill-scan into CI/CD pipelines to automatically audit agent skills and prevent malicious skills from going live
  3. AI application vendors use the jailbreak evaluation module before release to test their LLM applications' resilience to prompt injection attacks
  4. MCP server developers use the MCP scan feature to detect security risks such as tool poisoning and command injection in their servers
  5. Enterprise security personnel use the agent scan to evaluate AI agent workflows on Dify or Coze for permission abuse or data leakage risks
  6. Security researchers extend A.I.G with custom fingerprints and vulnerability rules via its API and plugin mechanism

What are this agent's strengths and limitations?

Pros
  • Comprehensive coverage: integrates multiple scanning capabilities – AI infra, MCP, agent skills, jailbreak evaluation – providing a one-stop solution for AI security risks
  • Leading performance: skill scan achieves 0.9848 F1 score on SkillTrustBench (with Claude Opus 4.6), at the forefront of the industry
  • Open ecosystem: Apache 2.0 license, plugin extension mechanism supports custom fingerprints, vulnerability rules, MCP rules, and evaluation datasets
  • Multi-platform integration: provides web UI, CLI tools, API, and ClawHub skills (e.g., EdgeOne ClawScan) that can be embedded into any AI agent workflow
Limitations
  • High deployment requirements: needs Docker, at least 4GB RAM and 10GB disk
  • Lacks authentication: positioned for internal corporate use, no auth mechanism, cannot be exposed on public networks, adding deployment constraints
  • Model dependency: skill scanning and jailbreak evaluation rely on external LLM APIs (e.g., DeepSeek), requiring API keys, external dependencies, and costs
  • Scan target limitation: AI infrastructure scanning requires the target service to be running and accessible, cannot scan source code offline

How do you install or deploy this agent?

Recommended installation is via Docker Compose:

git clone https://github.com/Tencent/AI-Infra-Guard.git
cd AI-Infra-Guard
# For Docker Compose V2+, use 'docker compose'
docker-compose -f docker-compose.images.yml up -d

After deployment, visit http://localhost:8088 . Alternatively, use the one-click install script:

curl https://raw.githubusercontent.com/Tencent/AI-Infra-Guard/refs/heads/main/docker.sh | bash

Or install the aig-scanner skill in OpenClaw:

clawhub install aig-scanner

How do you use this agent?

For AI infrastructure scanning: in the web UI, click 'AI Infra Scan' and enter the URL of a running service (e.g., http://127.0.0.1:8000), then click Start Scan. For jailbreak evaluation: configure the target LLM's API endpoint (base URL + API key) in Settings → Model Config, select a dataset, and start the evaluation. For skill scanning via CLI:

pip install aig-skill-scan
export LLM_API_KEY="your-api-key"
aig-skill-scan --repo /path/to/your/skill -m deepseek-v4-flash --language en -o result.json

How does this agent compare with similar options?

The project does not explicitly mention direct competitors, but it can be compared to other AI security tools such as commercial red teaming platforms.

FAQ

Can A.I.G be deployed on a public network?
No. The project explicitly states it lacks authentication and recommends internal use only.
What configuration is needed for skill scanning?
You need Python, set the LLM_API_KEY environment variable, and specify the repository path to scan.
What should I enter as the target URL for AI infrastructure scanning?
Enter the network address of a running AI service (e.g., http://127.0.0.1:8000), not a GitHub URL. CIDR and IP ranges are supported.
Which models are supported for jailbreak evaluation?
Any model endpoint that follows the OpenAI API specification can be configured by setting the base URL and API key in settings.
How can I contribute new scanning rules?
Follow the contribution guide: add YAML or dataset files under data/fingerprints, data/vuln, data/mcp, or data/eval, and submit a pull request.

Related agents