AnythingLLM
Free tierThe all-in-one AI application — chat with docs, run AI agents, fully private and local
Free tier available·All audiences·Powered by Bring your own LLM API key; built-in support for llama.cpp (via AMD Lemonade), Microsoft Foundry Local, and others·API available·Open source
Key strengths
Fully local & private by default — no data leaves your machineSupports any LLM (local or cloud: OpenAI, Azure, AWS, and more)Chat with any document type: PDFs, Word, CSV, codebases, and moreOpen-source (MIT license) with an extensible plugin/agent ecosystemNo setup or coding required — one-click desktop install
Free tier + paid plans · from $50 USD/mo
United States
Founded 2023
Self-hostable
Facts verified against anythingllm.com on
Recent changes
- Models updated: Bring your own LLM API key; built-in support for llama.cpp (via AMD Lemonade), Microsoft Foundry Local, and others
- Starting price: $0/mo → $50/mo
- Plans updated: Desktop app is free. Cloud/hosted plans start at $50/mo (Basic), $99/mo (Pro), and Enterprise (contact for quote). Self-hosting with Docker is free.
Get alerts when AnythingLLM changes
Free. We'll email you when pricing, the free tier, API access or open-source status changes.
No ratings yet
- Private RAG pipelines: Build document Q&A systems over internal knowledge bases using the built-in RAG engine and developer API — no third-party data exposure.
- Local LLM experimentation: Swap between llama.cpp (AMD Lemonade), Microsoft Foundry Local, or external API-backed models without re-architecting your setup.
- Self-hosted team AI: Deploy via Docker for multi-user environments; manage workspaces and users programmatically through the API.
- Custom agent automation: Author custom agent skills to extend AnythingLLM's capabilities for domain-specific workflows.
- On-device meeting intelligence: Integrate local transcription and summarization into workflows where audio data must never leave the device.
- Open-source forking/extension: MIT license allows full modification and redistribution; 67,000+ GitHub stars indicate a large ecosystem of community contributions.
Alternatives
See all alternatives