WRITING

Ollama: running your own AI on your computer is no longer just for experts

Ollama lets you download and run language models on your own computer with a single command. Why I think it's one of the most important repositories for a small company.

For a long time, using artificial intelligence meant one thing.

Sending your data to another company's server and waiting for the answer.

Ollama changes that with one command.

What it is

Ollama is an open-source tool for downloading, managing and running open language models on your own computer. You type something like ollama run followed by a model name and, within minutes, you have a chat running on your machine. No accounts, nothing sent elsewhere.

It also starts a local API. That means any program you build can talk to the model as if it were a cloud service, without leaving your computer or your server.

Why I find it interesting

Not because of the technology. Because of what it lets you decide.

When AI only exists in someone else's cloud, every idea comes with three questions: how much will each use cost, what happens to my clients' data, and what do I do if they change the price or the terms tomorrow.

With a local model, those questions change. The cost is your machine. The data stays put. And nobody can raise your rate halfway through a project.

The best tool isn't the most powerful one. It's the one that doesn't make you ask permission to use it.

For a small company that matters a lot. It's the same idea we've worked with for years: depend as little as possible on decisions you don't control.

What it's good for, and what it isn't

Let's be honest: a model running on a laptop isn't the smartest in the world. For very complex tasks, the big cloud models are still ahead.

But a lot of work doesn't need the top of the class:

  • Summarising or classifying internal texts.
  • Extracting data from documents you don't want to upload anywhere.
  • Testing ideas without worrying about the API bill.
  • Building internal assistants that work with sensitive information.

And above all, learning. Few things teach you as much about how a model works as having it right there in your terminal and watching how it answers.

What this repository teaches

Ollama didn't invent the models or the way to run them. It builds on other open projects. What it did was remove friction: it turned something that required compiling, configuring and fighting dependencies into an installer and a command.

That's a lesson for any product. Often the value isn't in inventing something new, but in making easy something that already existed and only experts used.

If you've never tried a model locally, this is where I'd start.

P.S. The first time you try it, turn off the Wi-Fi and ask it a question. That "this works without internet" feeling explains why it matters better than any article.