# KodeKloud: Beta Courses Running Local LLMs With Ollama

## Running Local LLMs With Ollama

### Getting Started With Ollama

- [Section Introduction](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Section-Introduction/page.md): Learn how Ollama enables running large language models locally, ensuring privacy, low latency, and offline capability while building AI-powered chatbots.
- [Ollama Introduction](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Ollama-Introduction/page.md): This guide introduces Ollama, an open-source solution for running and developing large language models locally, addressing AI development challenges.
- [Installing Ollama](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Installing-Ollama/page.md): This guide explains how to download, install, and verify Ollama for running large language models on your local machine.
- [Running Your First Model](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Running-Your-First-Model/page.md): This guide helps you set up and run your first Large Language Model on your local machine using Ollama, covering prerequisites and setup processes.
- [Demo Running Your First Model](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Demo-Running-Your-First-Model/page.md): This guide explains how to run Meta's Llama 3.2 large language model locally using the Ollama application and CLI.
- [Models and Model Parameters](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Models-and-Model-Parameters/page.md): This guide explores Ollamas supported models, their specifications, and how to choose the right one for your project.
- [Running Different Models](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Running-Different-Models/page.md): Explore how to run various vision-capable models using Ollama, including browsing the model registry and utilizing CLI and API for local execution.
- [Essential Ollama CLI Commands](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Essential-Ollama-CLI-Commands/page.md): Streamline your local AI model workflow with the Ollama CLI, mirroring Docker syntax for easy command usage.
- [Demo Essential Ollama CLI Commands](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Demo-Essential-Ollama-CLI-Commands/page.md): This guide covers essential Ollama CLI commands for deploying local LLMs with practical examples and usage instructions.
- [Community Integrations for Ollama](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Community-Integrations-for-Ollama/page.md): This guide explores community integrations for Ollama, focusing on setting up Open Web UI, a ChatGPT-like interface for local language models.
- [Demo Setting Up a ChatGPT Like Interface With Ollama](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Getting-Started-With-Ollama/Demo-Setting-Up-a-ChatGPT-Like-Interface-With-Ollama/page.md): This article guides users in setting up a ChatGPT-like interface using the Ollama project and Open Web UI for local language models.

### Building AI Applications

- [Section Introduction](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Building-AI-Applications/Section-Introduction/page.md): This article focuses on using the Ollama REST API for programmatic access to local LLMs over HTTP.
- [Ollama REST API Introduction](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Building-AI-Applications/Ollama-REST-API-Introduction/page.md): This tutorial teaches how to launch and interact with Ollama’s REST API for AI applications.
- [Ollama REST API Endpoints](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Building-AI-Applications/Ollama-REST-API-Endpoints/page.md): Integrate large language models into applications using the Ollama REST API for text generation, chat, and model management over HTTP.
- [Demo Using Ollama API and Interacting With It](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Building-AI-Applications/Demo-Using-Ollama-API-and-Interacting-With-It/page.md): This tutorial explains how to use the Ollama REST API, covering endpoints, request examples, and integration best practices for local LLMs.
- [Leveraging Ollama Models in Application Development](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Building-AI-Applications/Leveraging-Ollama-Models-in-Application-Development/page.md): Learn to build AI applications by integrating local Ollama models into your code, covering workflows from user input to response processing.
- [Demo Creating an App Using Ollama OpenAI Python Client](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Building-AI-Applications/Demo-Creating-an-App-Using-Ollama-OpenAI-Python-Client/page.md): Guide to building a Flask AI Poem Generator using the OpenAI Python client and local Ollama backend, covering setup, example code, environment configuration, and production considerations
- [OpenAI Compatibility for Ollama](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Building-AI-Applications/OpenAI-Compatibility-for-Ollama/page.md): This guide explains how to use Ollamas compatibility with the OpenAI API for seamless local development and production deployment.
- [Demo Migrating an Application to Use the OpenAI API](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Building-AI-Applications/Demo-Migrating-an-Application-to-Use-the-OpenAI-API/page.md): This guide explains how to migrate a Flask-based AI app to use the OpenAI API while developing locally with Ollama.

### Customising Models With Ollama

- [Section Introduction](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Customising-Models-With-Ollama/Section-Introduction/page.md): This article covers customizing pre-trained models using a Modelfile for tailored performance and functionality.
- [Modelfile Introduction](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Customising-Models-With-Ollama/Modelfile-Introduction/page.md): This article explains Modelfiles and their use in customizing open-source models with Ollama.
- [Customizing Models](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Customising-Models-With-Ollama/Customizing-Models/page.md): This guide explains how to create a domain-specific AI assistant using Ollamas base models, focusing on customization for investment contexts.
- [Demo Customizing an Existing Model](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Customising-Models-With-Ollama/Demo-Customizing-an-Existing-Model/page.md): This tutorial teaches how to customize an Ollama model for use as an AI assistant in a financial institution.
- [Uploading Custom Models](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Customising-Models-With-Ollama/Uploading-Custom-Models/page.md): This tutorial explains how to upload and share custom local LLMs using the Ollama model registry.
- [Demo Uploading Custom Models](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Customising-Models-With-Ollama/Demo-Uploading-Custom-Models/page.md): Uploading custom models to the Ollama Model Registry simplifies sharing and version control for your team, similar to using Docker Hub for container images.

### Introduction

- [Course Introduction](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Introduction/Course-Introduction/page.md): This course teaches how to run, experiment, and fine-tune large language models locally using Ollama.

### Prerequisites

- [Prerequisites](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Prerequisites/Prerequisites/page.md): Learn to use Ollama for running large language models locally and integrating them into AI applications while understanding key AI concepts.
- [Large Language Models LLMs Introduction](https://notes.kodekloud.com/docs/Running-Local-LLMs-With-Ollama/Prerequisites/Large-Language-Models-LLMs-Introduction/page.md): This article introduces Large Language Models, their learning process, applications, limitations, and future potential in various fields.