LlamaIndex

What does this agent do, and when should you use it?

LlamaIndex OSS is an open-source Python framework for building agentic applications that augment LLMs with private data. Its `llama-index-core` package is extended through separate integration packages for LLMs, embedding models, and vector stores; the README states that more than 300 integration packages are available. The framework supplies data connectors, index and graph structures, and retrieval/query interfaces that produce knowledge-augmented output. The documented flow loads a local directory with `SimpleDirectoryReader`, creates a `VectorStoreIndex`, and queries it through `index.as_query_engine().query()`. LlamaParse is a separate platform for document agents, offering Parse, Extract, Index, Split, and Agents, and may be used with the framework or on its own.

An application installs llama-index-core plus selected integrations such as llama-index-llms-openai, llama-index-llms-ollama, and llama-index-embeddings-huggingface. SimpleDirectoryReader("YOUR_DATA_DIRECTORY").load_data() loads documents from a chosen local directory, and VectorStoreIndex.from_documents(documents) creates a vector index. index.as_query_engine() creates a query interface, whose .query("YOUR_QUESTION") call returns a query result. Data is in memory by default; index.storage_context.persist() writes storage under ./storage, which can later be reloaded with StorageContext.from_defaults(persist_dir="./storage") and load_index_from_storage(storage_context). The OpenAI example reads OPENAI_API_KEY; the Ollama example configures Settings.llm, Settings.tokenizer, and Settings.embed_model.

1. A Python developer building a question-answering feature over a local document directory can load files with SimpleDirectoryReader and query a VectorStoreIndex.
2. A team using OpenAI for generation can install llama-index-llms-openai and supply OPENAI_API_KEY while using the core indexing interface.
3. A developer running models through Ollama can configure Ollama, a Hugging Face embedding model, and an AutoTokenizer in Settings.
4. An application that must survive restarts can persist its index to ./storage and reload it with load_index_from_storage.
5. An organization needing document parsing, OCR, structured extraction, indexing, or document-agent capabilities can use LlamaParse with the framework or separately.

What are this agent's strengths and limitations?

How do you install or deploy this agent?

A Python environment is required. Install the core package and the integrations used by the documented examples:

pip install llama-index-core
pip install llama-index-llms-openai
pip install llama-index-llms-ollama
pip install llama-index-embeddings-huggingface

For the OpenAI example, set OPENAI_API_KEY in the runtime environment first. No local LlamaParse installation command is documented; its documented entry point is account signup and API-key creation.

How do you use this agent?

A minimal documented flow is:

from llama_index.core import VectorStoreIndex, SimpleDirectoryReader
documents = SimpleDirectoryReader("YOUR_DATA_DIRECTORY").load_data()
index = VectorStoreIndex.from_documents(documents)
query_engine = index.as_query_engine()
response = query_engine.query("YOUR_QUESTION")

The OpenAI path requires OPENAI_API_KEY and the OpenAI integration package. Index data is memory-only by default; for reuse after restart, call index.storage_context.persist() and reload with StorageContext.from_defaults(persist_dir="./storage") and load_index_from_storage(...).

How does this agent compare with similar options?

FAQ