Olympus

Should I use a private AI service or run AI locally?

Run AI locally when the data must never leave your computer and a smaller model is good enough. Use a private cloud service when you need stronger answers and trust its no-logging promise. For your own mail and files, a mix often works best: keep the data local and send only what is safe to the best model.

The trade-offs

Local modelPrivate cloud service
Where your text goesNowhere: it stays on your computerTo the service, under its own retention rules
Answer qualityBehind the best cloud modelsOften uses strong open or frontier models
HardwareNeeds memory and a recent chipAny device
ExamplesOllama, LM Studio, JanProton Lumo, Venice, Duck.ai

Neither protects you if you paste the wrong document into the wrong place. And a private chat service knows your own mail and files only through what you upload or connect, which it then receives.

Using both with Olympus

Olympus keeps your mail, files and messages on your computer and answers from Private items with a small model there, sized to your computer's memory. Personal items can go to ChatGPT, Claude or another assistant you connect. For harder private questions you can connect Venice, which then receives the passages that match, if your settings allow it. Separately, zkAPI can send a frontier model a question Olympus has stripped of identifying details, without your documents, through Tor by default; the question's own content can still identify you. Both are off by default. See the privacy policy for what each choice sends.

Updated 10 November 2026.