Ask your documents questions
You add documents to a workspace. For each question, the app finds the relevant passages and the AI answers from them. Everything stays on your computer.
AnythingLLM is a free app you install on your computer. You add your documents, then ask them questions as you would a coworker who had read them. The AI runs on your machine: no account to create, no subscription, and according to the vendor neither your documents nor your conversations are sent anywhere else.
AnythingLLM has a free plan. The recommended plan to start with: Desktop, free. Prices checked on October 3, 2026 on the vendor’s official page.
Who it’s for: people who work with sensitive documents (contracts, personnel files, internal procedures) and cannot upload them to an online assistant.
You add documents to a workspace. For each question, the app finds the relevant passages and the AI answers from them. Everything stays on your computer.
In “Query” mode, the AI uses only your documents, and says it found nothing rather than making something up. In “Chat” mode, it mixes your documents with its general knowledge. In “Agent” mode, it can also use tools.
The app comes with a built-in engine that runs on your machine. You can also connect it to Ollama or LM Studio, or to an online service (OpenAI, Anthropic, Google Gemini, Mistral) with your own access key.
Also
Prices are published in dollars. The app’s code is public, under the MIT license. If you connect an online AI service, its cost comes on top.
| Plan | Price | Who it’s for |
|---|---|---|
| Desktop Recommended to start | Free | One person, on their computer |
| Cloud Basic | $50 per month | Freelancers and small teams |
| Cloud Pro | $99 per month | Teams that use it every day |
| Enterprise | Custom pricing | Large organizations |
The whole desktop app, with no account and no usage limit: documents, agent, meeting assistant, assistant on top of your apps. The Android app and the self-hosted server version are free too.
Get the desktop app, which is free: it is the one that keeps everything on your computer. The Cloud plans are only useful if several people need to share the same workspaces, and in that case your documents are hosted by the vendor.
Your data. With the desktop app, your documents, your conversations, and the AI stay on your computer.
What it does less well
The prompt to copy
Based on the document, answer in three points: what is the deadline to meet, who approves, and what supporting documents are required? Quote the passage that lets you answer.
In the starter kit for one job.
The same idea online, with nothing to install, but your documents go to Google.
To chat with a local model and attach a few documents, in a simpler app.
For an internal assistant shared by the whole team, installed by the IT team.
Another desktop app that combines local AI models, online services, and documents.
The most widely used local AI engine. AnythingLLM can connect to it.
Desktop: free; Cloud Basic: $50 per month; Cloud Pro: $99 per month; Enterprise: custom pricing. Prices checked on October 3, 2026 on the vendor’s official page.
Yes. The whole desktop app, with no account and no usage limit: documents, agent, meeting assistant, assistant on top of your apps. The Android app and the self-hosted server version are free too.
With the desktop app, your documents, your conversations, and the AI stay on your computer.
Gemini Notebook: The same idea online, with nothing to install, but your documents go to Google. LM Studio: To chat with a local model and attach a few documents, in a simpler app. Open WebUI: For an internal assistant shared by the whole team, installed by the IT team. Msty: Another desktop app that combines local AI models, online services, and documents. Ollama: The most widely used local AI engine. AnythingLLM can connect to it.
Page checked on October 3, 2026. Brands are named to identify the tools. No affiliation.