AnythingLLM
Free tierThe all-in-one AI application — chat with docs, run AI agents, fully private and local
Free tier available·All audiences·Powered by Any (local via built-in provider/Ollama, or cloud via OpenAI, Azure OpenAI, AWS Bedrock, and more)·API available·Open source
Key strengths
Fully local & private by default — no data leaves your machineSupports any LLM (local or cloud: OpenAI, Azure, AWS, and more)Chat with any document type: PDFs, Word, CSV, codebases, and moreOpen-source (MIT license) with an extensible plugin/agent ecosystemNo setup or coding required — one-click desktop install
Free tier + paid plans
United States
Self-hostable
No ratings yet
Developer Setup & API
Running via Docker (Self-Hosted)
docker pull mintplexlabs/anythingllm
docker run -d -p 3001:3001 \
-v ${PWD}/anythingllm:/app/server/storage \
mintplexlabs/anythingllm
Access the UI at http://localhost:3001.
Built-in Developer API
AnythingLLM exposes a REST API that allows developers to:
- Programmatically upload and manage documents
- Query workspaces and retrieve LLM responses
- Manage users and permissions (multi-user mode)
- Trigger agent skills and automations
Full API documentation is available at the official docs site (docs.anythingllm.com).
Key Configuration Options
| Parameter | Description |
|---|---|
| LLM Provider | Local (built-in), Ollama, OpenAI, Azure OpenAI, AWS Bedrock, and more |
| Embedding Engine | Local or remote embedding model |
| Vector Database | Built-in (LanceDB) or external (Chroma, Pinecone, Weaviate, etc.) |
| Storage | Local filesystem by default |
Extensibility
- Custom Agent Skills: Build and share JavaScript-based agent plugins via the Community Hub.
- Data Connectors: Connect external data sources beyond file uploads.
- Slash Commands: Programmable shortcut macros for prompt workflows.
- White-labeling: Full branding customization for team/enterprise deployments.