Lumen Data Exploration Framework

Turn natural-language questions into data pipelines, visualizations, and shareable analysis.

Source repo
holoviz/lumen
Stars
★ 318
Last updated
today
License
BSD-3-Clause
Primary language
Python

At a glance

How it runs
CLIFramework
Works with
Universal · cross-platform
Setup effort
Low · running in minutes
You'll need
Python 3.11+conda or pipShell / CLILocal filesystem
Typical use
A data analyst can start Explorer to explore a CSV and generate charts or tables from natural-language requests.
Not a fit if
  • Teams that need a documented ChatGPT, Claude, or MCP client integration
Source review
62/100 · Some gaps

What does this agent do, and when should you use it?

Lumen is an open-source, extensible Python framework for conversational data exploration and retrieval-augmented generation (RAG). Its declarative data model lets large language models generate data transformation pipelines, charts, tables, and dashboards. Built on Panel, it can start an Explorer service with lumen-ai serve, and generated pipelines can be serialized for continued work in a notebook or reuse in dashboards. It is aimed at teams that want users to analyze local or remote files, SQL databases, or data lakes through natural language. The README does not identify model providers, credential requirements, or data-handling boundaries, so teams should verify those details before adopting it.

After installation, run lumen-ai serve data.csv to start the Lumen Explorer. Lumen generates data pipelines for local or remote files, SQL databases, and data lakes, and can use documents and embeddings to provide context to an LLM. From natural-language requests, it produces charts, data tables, or dashboards, and can summarize results and extract key insights. Users can inspect, validate, and manually edit LLM outputs; declarative pipelines can be serialized for notebook analysis or dashboard reuse. The framework also supports custom agents, tools, and analyses.

  1. A data analyst can start Explorer to explore a CSV and generate charts or tables from natural-language requests.
  2. A team working with SQL databases or a data lake can evaluate Lumen for generating data transformation pipelines from questions.
  3. A domain team can provide internal documents as RAG context for analysis alongside its data.
  4. Teams that need to review AI-generated analysis can inspect, validate, and manually edit the outputs.
  5. A data scientist can serialize a generated pipeline and continue the analysis in a notebook.
  6. A team that wants non-programmers to assemble interactive dashboards can reuse generated declarative content in dashboards.

How do you install or deploy this agent?

Lumen supports Python 3.11 and above on Linux, Windows, and macOS. The README recommends installation from conda-forge and also documents PyPI:

conda install -c conda-forge lumen

Alternatively:

pip install lumen

The README does not list model providers, credential configuration, or optional dependency requirements.

How do you use this agent?

Replace data.csv with the data file to explore, then run this command to start the Lumen Explorer service:

lumen-ai serve data.csv

The README points users to Explorer after installation but does not specify its access URL, port, authentication setup, or model credential configuration.

What are this agent's strengths and limitations?

Pros
  • Its declarative data model can represent multi-step SQL or Python transformation pipelines that can be serialized and reused.
  • Built on Panel, it can produce charts, interactive tables, and complete dashboards.
  • Users can inspect, validate, and manually edit LLM outputs to review generated analysis.
  • Custom agents, tools, and analyses can be added for domain-specific workflows.
Limitations
  • It requires Python 3.11 or later and installation through conda or pip.
  • The README does not identify supported LLM providers, credential requirements, model costs, or where data is sent.
  • It gives a launch command but does not document the Explorer access URL, port, or service deployment configuration.
  • The README does not describe handling for model failures, SQL execution errors, or data access permissions.

How does this agent compare with similar options?

Key facts side by side with the most closely related agents.

Agent Source review Form / cost Stars Updated Language Full support on
Lumen Data Exploration Framework This agent 62 · Some gaps CLI ★ 318 today Python —
Data Formulator 58 · Major gaps CLIFree + model costs ★ 18k 2mo ago Python OpenAI API · Claude API
Business Analytics Agent 60 · Some gaps Desktop appFree + model costs ★ 2.6k 14d ago JavaScript OpenAI API
WrenAI GenBI 53 · Major gaps CLIFreemium ★ 18k 1d ago Python Codex · Claude Code

How does FollowAgents rate this agent?

FollowAgents source review · FARS-2.1
Some gaps
62/ 100 5-point scale 3.1 / 5
Trust 12/29
Reliability 8/14
Adaptability 12/18
Convention 13/18
Effectiveness 12/13
Verifiability 5/8
Why each dimension lost points
Trust12 / 29 · 2.1/5

The README says Lumen connects to databases, files, and data lakes and generates and runs SQL/Python. The docs show cloud keys, AWS credentials, and local model setup, and say outputs can be inspected, validated, and edited. The supplied material does not clearly establish least-privilege database permissions, confirmation before execution, a sensitive-data policy, or rollback, so those criteria receive only partial credit. The README gives some visibility into data sources, LLMs, and outputs. pyproject and the build workflow list dependencies and restricted workflow permissions, which support limited dependency-security assessment, but there is no vulnerability-audit evidence. The README identifies the HoloViz project and support channel, and pyproject names maintainers; publisher registry identity remains unknown.

Reliability8 / 14 · 2.9/5

The README's account of generated SQL/Python, inspectable artifacts, and serialization broadly aligns with the FAQ's description of an execution layer; pyproject's Python requirement is supported by the installation guide. The guide covers optional providers and client libraries, but availability of cloud services, CLIs, databases, and vector stores depends on external environments. The supplied files provide little detail on user-facing failure messages or troubleshooting, so failure_messages scores low.

Adaptability12 / 18 · 3.3/5

The README and installation guide cover researchers, developers, non-programmers, cloud and local models, and file, SQL, and data-lake scenarios. The framework is configurable and extensible and supports multiple providers, but the supplied material does not clearly define unsupported tasks or safety boundaries. Invocation is mainly described through `lumen-ai serve` or constructing `ExplorerUI` in Python; specific rules for when an Agent should handle a request are absent. Python 3.11+ and Linux, Windows, and Mac are documented, though optional dependencies and providers create a complex environment matrix.

Convention13 / 18 · 3.6/5

Documentation is organized around installation, providers, FAQ, and next steps. The installation guide covers Python versions, package managers, environment variables, optional extras, and launch examples, earning a high install-notes score. README, package name, and CLI commands are broadly consistent, though Lumen and Lumen AI naming varies. README and FAQ provide examples and answers but little in the way of known limitations. The license file is complete and metadata identifies BSD. pyproject uses VCS-derived versions, and the release workflow publishes by tag and extracts release notes from CHANGELOG, but no changelog content is supplied for review. Maintainer metadata, source location, and support channel are clear; unverified publisher identity adds no endorsement.

Effectiveness12 / 13 · 4.6/5

The evidence describes inspectable and editable queries, charts, tables, dashboards, and serializable specifications, supporting high output usability. Connecting natural-language questions to data, analysis, and reusable visualizations has clear marginal value. README and installation docs explain API charges, local models, hosting costs, and provider options, but do not quantify resource use or returns, so cost-benefit receives partial credit.

Verifiability5 / 8 · 3.1/5

The README's main capability claims have corresponding descriptions in the FAQ, installation guide, and pyproject entry points, dependencies, and extras; multiple files also corroborate supported platforms, installation paths, and provider coverage. The materials distinguish configuration facts from product claims through their structure, but some broad claims, such as supporting nearly any output and deterministic analyses, lack specific support in the supplied code or tests, so full marks are not justified.

Risks and how to mitigate them
  • The framework accesses configured data sources and generates and runs SQL or Python. Define database permissions, query confirmation, and sensitive-data handling before deployment; the supplied material does not specify these controls.
  • Cloud LLMs and hosted deployments may incur external API costs. The credentials and optional providers documented also make deployment security dependent on the user's own secret management and service configuration.
Evidence confidence: Low Reviewed Oct 22, 2026 Reviewed revision 6b761ec87a69
See the full review method →

FAQ

Does Lumen require a paid model or API key?
The README does not identify model providers, credential requirements, or model costs, so this cannot be determined from the supplied information.
Which data sources can it use?
The README names local or remote files, SQL databases, and data lakes, and shows a CSV in its launch command; it does not list specific connectors or databases.
Can I inspect or change generated results?
Yes. The README says LLM outputs can be inspected, validated, and manually edited.
Can Lumen be deployed directly as a shareable dashboard?
The README says generated content can be serialized, reused in notebooks, or composed into dashboards, but does not provide production deployment steps.
Does Lumen provide ChatGPT, Claude, or MCP integrations?
The supplied README does not document those integrations.
View on GitHub ↗ Install ↓

Related agents