Skip to main content
In this guide, you’ll set up and run your first Large Language Model (LLM) on your local machine using Ollama. We’ll cover prerequisites, compare local versus cloud deployments, walk through Ollama’s setup process, and demonstrate how to chat with a model—all offline and without usage fees.

​
Prerequisites

Before you begin, make sure you have:
  • The Ollama app installed on your computer
  • Access to the Ollama CLI (ollama command)
The image lists prerequisites for a task, including having the Ollama app installed and a CLI on the local machine.
Ensure your machine meets the Ollama system requirements for smooth performance.

​
Local vs. Cloud Deployment

You have two options for running LLMs:
The image compares two methods of running a large language model: executing it on your own machine and relying on a paid cloud service.

​
Ollama Setup Process

Ollama automates:
  1. Downloading the model files
  2. Installing dependencies and preparing the environment
The image outlines a streamlined setup process by Ollama, featuring two steps: downloading necessary model files and setting up an environment with dependencies.

​
Running a Model with Ollama

We’ll start with LLaMA 3.2, Meta’s open-source LLM. To launch:
If the model isn’t already on your system, Ollama will:
  1. Pull the manifest and layers
  2. Verify the SHA-256 digest
  3. Cache metadata for faster future starts
  4. Launch the model
Example output:
The first download can take several minutes depending on your internet speed and disk performance.

​
Chatting with Your Model

Once loaded, Ollama drops you into an interactive chat:
Type /bye to close the session. You now have a fully offline LLM chat interface.

​
Next Steps

In the next lesson, we’ll:
  • Explore other models supported by Ollama
  • Read model descriptions and metadata
  • Run additional LLMs locally
The image is a slide titled "Next Steps" with a list of three items: "Different models offered," "Reading descriptions and details," and "Running different models."

Watch Video