traceAI

An open-source, OpenTelemetry-native tracing framework for AI applications that instruments LLM calls, agents, tools and retrieval without replacing your stack.

Stars
★ 266
Last updated
today
License
Apache-2.0
Primary language
Python

At a glance

How it runs
Library / SDK
Works with
Universal · cross-platform
Cost
Free, no paid service needed
Setup effort
Low · running in minutes
You'll need
Python 3.10–3.13 (for the Python quickstart)Node.js (OpenAI SDK 4 or 5 for TypeScript)Java 17+Go 1.26+.NET 10 (for C#)Shell / CLINetwork access
Typical use
Platform teams adding LLM call tracing to an existing OpenAI application without changing business code
Not a fit if
  • Teams wanting automatic C# framework instrumentation — C# only offers manual spans
  • Users who need guaranteed full conformance to the evolving OTel GenAI specification
  • Applications that cannot export any telemetry over OTLP to a backend

What does this agent do, and when should you use it?

traceAI, from the future-agi/traceAI repository (Apache 2.0), is an open-source tracing framework built natively on OpenTelemetry for observing LLM calls, agents, tools, and retrieval in AI applications. It ships as libraries/SDKs in five languages — Python, TypeScript/JavaScript, Java, Go, and C# — with 79 integration families including OpenAI, Anthropic, LangChain/LangGraph, LlamaIndex, Pinecone, and MCP. Once instrumented, model calls, retrieval, and tool execution are connected via OpenTelemetry spans and context, carrying semantic attributes like gen_ai.request.model and input.value, and exported through standard OTLP to your own backend or the Future AGI platform. Python and TypeScript expose privacy environment variables such as FI_HIDE_INPUTS to control what leaves your application. The core pitch: keep your application code and observability stack, and instrument only at the SDK boundary to get request-level traces.

traceAI intercepts supported SDK calls through per-language instrumentors, client wrappers, or middleware and emits OpenTelemetry spans. The Python path: pip install fi-instrumentation-otel and an integration package (e.g., traceai-openai), call register() for a tracer provider, then OpenAIInstrumentor().instrument(tracer_provider=provider) auto-patches the client so each chat.completions.create produces nested agent/tool/chain/LLM spans with model, input/output, and token usage. TypeScript uses register() from @traceai/fi-core with OpenAIInstrumentation from @traceai/openai (manuallyInstrument(OpenAI) for ESM); Java provides wrapper clients such as TracedOpenAIClient; Go offers option.WithMiddleware(traceaiopenai.Middleware(...)); C# exposes manual span APIs (tracer.Chain(...)). Traces export via OTLP to Future AGI or any OpenTelemetry backend you configure.

  1. Platform teams adding LLM call tracing to an existing OpenAI application without changing business code
  2. Teams on agent frameworks like LangChain, CrewAI, or Pydantic AI debugging tool and retrieval chains across multi-span requests
  3. RAG developers tracing retrieval pipelines built on LlamaIndex, Pinecone, Qdrant, or pgvector
  4. Teams collecting AI telemetry into their own OTLP backend, reusing an existing OpenTelemetry pipeline instead of Future AGI
  5. Compliance-sensitive teams masking inputs, outputs, images, and embedding vectors via FI_HIDE_INPUTS-style variables

How do you install or deploy this agent?

pip install fi-instrumentation-otel traceai-openai

The Python quickstart targets Python 3.10–3.13. Other languages:

npm install @traceai/fi-core @traceai/openai @opentelemetry/instrumentation openai@5
<dependency>
  <groupId>com.futureagi</groupId>
  <artifactId>traceai-java-openai</artifactId>
  <version>1.0.0</version>
</dependency>
go get github.com/future-agi/traceAI/go/openai@latest
go get go.opentelemetry.io/otel/exporters/otlp/otlptrace/[email protected]
dotnet add package fi-instrumentation-otel

How do you use this agent?

Set credentials, then run your instrumented application:

export FI_API_KEY="your-futureagi-api-key"
export FI_SECRET_KEY="your-futureagi-secret-key"
export OPENAI_API_KEY="your-openai-api-key"
export OPENAI_MODEL="gpt-4.1"
import os
from openai import OpenAI
from fi_instrumentation import register
from fi_instrumentation.fi_types import ProjectType
from traceai_openai import OpenAIInstrumentor

provider = register(project_name="traceai-quickstart", project_type=ProjectType.OBSERVE)
OpenAIInstrumentor().instrument(tracer_provider=provider)
try:
    response = OpenAI().chat.completions.create(
        model=os.environ["OPENAI_MODEL"],
        messages=[{"role": "user", "content": "Say hello in one word."}],
    )
    print(response.choices[0].message.content)
finally:
    provider.shutdown()

After a call finishes, open the traceai-quickstart project in Future AGI's Observe; flush or shut down the provider before short-lived processes exit.

What are this agent's strengths and limitations?

Pros
  • OpenTelemetry-native: accepts your own tracer provider and OTLP exporter, so you are not locked into Future AGI as a backend
  • Broad coverage: 79 integration families across 5 languages, including OpenAI Realtime, Google GenAI Live, and MCP
  • Fine-grained privacy controls: FI_HIDE_INPUTS, FI_HIDE_EMBEDDING_VECTORS and similar env vars decide what leaves your app before instrumentation initializes
  • Reads real attributes (gen_ai.request.model, input.value, token usage) rather than opaque custom formats
Limitations
  • Configuration coverage differs across languages: C# offers only manual spans with no automatic framework instrumentation
  • The README explicitly disclaims full conformance to any particular revision of the evolving OTel GenAI spec, a potential migration risk
  • Package availability is not a claim of complete upstream feature compatibility; each package's scope must be checked in its source
  • Content capture is enabled by default; without proactive masking configuration, sensitive prompts and outputs are exported

How does this agent compare with similar options?

The README documents importing existing telemetry from OpenInference and OpenLLMetry, meaning traceAI interoperates with these OpenTelemetry-ecosystem tracing schemes and can be mixed in the same OTLP pipeline.

Key facts side by side with the most closely related agents.

Agent Source review Form / cost Stars Updated Language Full support on
traceAI This agent 69 · Some gaps Library / SDKFree ★ 266 today Python —
Langtrace 42 · Major gaps Library / SDKFreemium ★ 1.2k 11mo ago TypeScript OpenAI API · Claude API
Laminar 41 · Major gaps Self-hosted serviceFreemium ★ 3.5k today TypeScript OpenAI API · Claude API
AgentSight 77 · Some gaps CLIFree ★ 771 13d ago C Claude Code

How does FollowAgents rate this agent?

FollowAgents source review · FARS-2.1
Some gaps
69/ 100 5-point scale 3.5 / 5
This review covers the source as of Oct 31, 2026. The project has shipped 20 stable release(s) since, which have not been re-reviewed. The score and verdict describe the reviewed version only. Recent releases ↓
Trust 17/29
Reliability 9/14
Adaptability 14/18
Convention 14/18
Effectiveness 10/13
Verifiability 5/8
Why each dimension lost points
Trust17 / 29 · 2.9/5

Evidence shows the framework only injects OpenTelemetry tracing at SDK boundaries and performs no actions beyond capturing calls — a narrow permission surface; however, by default it captures all prompts/completions and exports them to the Future AGI cloud, an external network effect with no per-invocation user confirmation, so least_privilege and user_confirmation are deducted. Sensitive-data handling is thorough: TraceConfig offers 10+ hide flags, __REDACTED__ substitution, error-detail redaction coupling, and the Open WebUI filter defaults to redaction with tested isolation of hostile TLS env vars. Dependency security shows frozen lockfiles, --ignore-scripts, and no-network tests, but no evidence of vulnerability scanning. Rollback is entirely absent (0). Copyright points to Future AGI, Inc.; publisher unverified, so attribution loses one point.

Reliability9 / 14 · 3.2/5

Docs and CI are largely self-consistent: registration order, shutdown semantics, and error-status handling align across languages; but installation.md claims Python 3.8+ while README says 3.10–3.13, a version drift that costs self_consistency. Dependency availability is backed by frozen installs and offline test matrices. Error handling is documented in depth (error.type taxonomy, tri-state hide_error_details), but nothing was executed and error messages are inferred from docs.

Adaptability14 / 18 · 3.9/5

Five languages and 79 integration families give very broad audience coverage — full marks. Capability boundaries are stated honestly (C# manual spans only; 'package availability is not a claim of complete upstream feature compatibility'), though actual per-integration scope requires checking each package, hence the deduction. Trigger precision is supported by explicit ordering requirements (instrument before client creation, manual ESM patch). Environment fit relies on env vars and OTLP endpoints, but the Go example demands a special no-compression setting, limiting generality.

Convention14 / 18 · 3.9/5

Information architecture is clear: quickstart, integration tables, configuration, security policy. Install notes are complete but contain the Python version inconsistency (3.8+ vs 3.10–3.13) and mix fi-instrumentation with fi-instrumentation-otel package names. Naming is stable across languages (traceai-*, @traceai/*). Examples are extensive and paired with verification scripts. Known limitations are honestly annotated but not centralized. Apache-2.0 text is complete — full marks. No CHANGELOG file appears; only scattered version references (1.0.0, 1.1.0), so versioning drops to 1. SECURITY.md gives response timelines and scope, but no named maintainers or update path.

Effectiveness10 / 13 · 3.8/5

Output is standard OTel spans consumable by any OTLP backend and verifiable with InMemorySpanExporter — good usability, though the polished final presentation depends on an external platform screenshot, hence the deduction. Marginal value is clear: minimal-intrusion AI-semantic spans and eval tags added to an existing observability stack. Cost/benefit is reasonable — trace overhead and token/cost capture are documented, but no quantified overhead data is provided.

Verifiability5 / 8 · 3.1/5

Most claims (package names, license, CI config, redaction behavior) trace to in-repo files and each integration-table row links its source directory; but the '79 families / 5 languages' totals exceed the files provided, and the provenance JSON behind the 'real trace' screenshot is not shown — deducted. Docs, CI workflows, and tests corroborate each other (e.g. the Open WebUI tests detail env-var isolation), a strong cross-source pattern. Fact vs inference is mostly separated: 'A dash means no dedicated framework package…not a promise of unsupported runtime behavior' is an explicit boundary statement, though a few compatibility/perf claims remain bare assertions.

Risks and how to mitigate them
  • Not found in source: rollback or recovery pathBack up first, or work on a git branch or snapshot, so its changes can be undone.
  • By default all prompts and completions are exported to the Future AGI cloud; configure hide_inputs/hide_outputs redaction before production use.
  • Requires FI_API_KEY/FI_SECRET_KEY, creating an account and billing tie to a third-party cloud; you can supply your own OTel exporter to avoid lock-in.
  • Python version requirements are inconsistent across docs (3.8+ vs 3.10–3.13); defer to package metadata.
  • Publisher identity is not verified by the curated registry; assess supply-chain trust yourself (package signing, lockfiles).
  • This is a static source review; no code was executed and test effectiveness is unverified.
Evidence confidence: Low Reviewed Oct 31, 2026 Reviewed revision 703317678879 New commits since this review; the score may not cover them
See the full review method →

Recent releases

Latest entries from the project's GitHub Releases. Notes are quoted from upstream as written, not rewritten or tested by FollowAgents.

  1. traceai-google-genai-live-v0.1.0 traceAI-google-genai-live 0.1.0
    Release notes excerpt
    - New package: tracing for Gemini Live sessions opened with client.aio.live.connect on the Gemini Developer API (google-genai >=2.28,<3; tested on 2.31.0 and 2.28.0 with gemini-3.8-live). Gemini Live is a preview API: a field rename upstream is a floor and fixture update here, not a silent fallback. google-genai 3.0 removes Live.send / Live.start_stream, which this package never wrapped; pin below 3. - One trace per session: setup, user turns, model turns (model, tokens, transcription), tool …
    View on GitHub ↗
  2. traceai-minimax-v0.1.0 traceAI-minimax 0.1.0
    Release notes excerpt
    _This version has no CHANGELOG entry; see the commits since the previous tag._ Install: pip install traceAI-minimax==0.1.0
    View on GitHub ↗
  3. traceai-agentscope-v0.1.0 traceAI-agentscope 0.1.0
    Release notes excerpt
    _This version has no CHANGELOG entry; see the commits since the previous tag._ Install: pip install traceAI-agentscope==0.1.0
    View on GitHub ↗

FAQ

Do I have to use the Future AGI platform?
No. Python and TypeScript instrumentors accept your own OpenTelemetry tracer provider, and Go middleware takes one via WithTracerProvider. Future AGI keys are only needed when exporting to Future AGI.
Will traces contain my prompts?
By default yes — content capture is on. Set FI_HIDE_INPUTS, FI_HIDE_OUTPUTS, FI_HIDE_INPUT_IMAGES, FI_HIDE_EMBEDDING_VECTORS, etc. (implemented in Python/TypeScript) before initializing instrumentation. Masking does not guarantee manually added attributes are free of sensitive data.
Why do traces go missing from short-lived scripts?
Spans are batch-exported; call provider.shutdown() (or TraceAI.shutdown() in Java) before the process exits to flush pending spans, as the README explicitly emphasizes.
What is the extent of C# support?
C# provides manual span and activity APIs in .NET 10 (e.g., tracer.Chain(...)); it does not auto-patch the OpenAI client, and its framework columns in the coverage matrix are intentionally empty.
What does it cost?
traceAI itself is Apache 2.0 open source and free to use with your own OpenTelemetry backend; exporting to the Future AGI platform depends on that platform's pricing.
View on GitHub ↗ Install ↓

Related agents