# Running Ollama Locally with Podman on Fedora Linux

DevFeed: [Running Ollama Locally with Podman on Fedora Linux](<https://devfeed.tech/articles/running-ollama-locally-with-podman-on-fedora-linux-12393.md>)

Original publisher: [Read original article](<https://fedoramagazine.org/running-ollama-locally-with-podman-on-fedora-linux/>)

Author: Yazan Monshed

Published: 2026-08-05T08:00:00Z

Content type: article

Language: en

Sources: [Fedora Magazine](<https://devfeed.tech/sources/fedora-magazine.md>)

Topics: [Fedora](<https://devfeed.tech/topics/fedora.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Linux](<https://devfeed.tech/topics/linux.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [API](<https://devfeed.tech/topics/api.md>), [cURL](<https://devfeed.tech/topics/curl.md>), [GPU](<https://devfeed.tech/topics/gpu.md>)

Tags: [ai-development](<https://devfeed.tech/tags/ai-development.md>), [api](<https://devfeed.tech/tags/api.md>), [curl](<https://devfeed.tech/tags/curl.md>), [fedora-project-community](<https://devfeed.tech/tags/fedora-project-community.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [linux](<https://devfeed.tech/tags/linux.md>), [llama](<https://devfeed.tech/tags/llama.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [offline](<https://devfeed.tech/tags/offline.md>), [ollama](<https://devfeed.tech/tags/ollama.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [podman](<https://devfeed.tech/tags/podman.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [python](<https://devfeed.tech/tags/python.md>), [terminal](<https://devfeed.tech/tags/terminal.md>), [using-software](<https://devfeed.tech/tags/using-software.md>)

## AI overview

This article explains how to run Ollama locally in a Podman container on Fedora Linux. It covers installing or verifying Podman, creating persistent storage for model weights, running the Ollama container, downloading Llama 3, optionally enabling Nvidia GPU acceleration, and using Ollama's local REST API with curl.

## Source excerpt

Running Large Language Models (LLMs) locally has become increasingly popular for development, privacy, and offline testing. Ollama makes this incredibly straightforward, allowing you to run models like Llama 3 or Mistral directly on your machine. By leveraging Podman on Fedora Linux, you can isolate Ollama inside a container. This approach keeps your host system clean [...]