Skip to main content

Installation Guide

Detailed installation instructions for all components.

System Requirements​

Operating System​

  • Windows 10 (version 1903 or later) or Windows 11
  • 64-bit only
  • WSL2 optional (for Docker/Podman containers)

Hardware​

ComponentMinimumRecommendedOptimal
GPURTX 3060RTX 4090RTX 5090
VRAM12GB24GB32GB
System RAM16GB32GB64GB
Storage50GB SSD200GB NVMe500GB+ NVMe
CPUAny modern8+ cores16+ cores

NVIDIA Driver Requirements​

CUDA VersionMinimum DriverRecommended
CUDA 12.x525.60+550.0+
CUDA 11.x450.80+470.0+

Check your driver version:

nvidia-smi

Installing Ollama​

.\setup-ollama.ps1

This handles everything automatically.

Manual Installation​

  1. Download from ollama.ai
  2. Run the installer
  3. Verify installation:
ollama --version

Environment Configuration​

For container access, Ollama must listen on all interfaces:

# Set environment variable
[Environment]::SetEnvironmentVariable("OLLAMA_HOST", "0.0.0.0", "User")

# Restart Ollama
ollama serve

Installing Docker or Podman​

Required for Open WebUI and Perplexica.

Docker Desktop (Easier)​

  1. Download Docker Desktop
  2. Enable WSL2 backend during setup
  3. Verify:
docker info

Podman (Lighter, Open Source)​

# Install via winget
winget install RedHat.Podman

# Initialize machine
podman machine init
podman machine start

# Verify
podman info
Podman Networking

Podman on WSL2 has networking quirks. See Podman Networking for details.

Installing Web Search Components​

Open WebUI​

.\setup-ollama-websearch.ps1 -Setup OpenWebUI

Access at: http://localhost:3000

Perplexica + SearXNG​

.\setup-ollama-websearch.ps1 -Setup Perplexica

Access at:

Verifying Installation​

Run the test suite:

.\test-ollama-stack.ps1

Expected output:

[Prerequisites]
  [PASS] Podman is running
  [PASS] NVIDIA GPU detected (NVIDIA GeForce RTX 5090)

[Ollama]
  [PASS] API responding on :11434
  [PASS] 6 models available
  [PASS] Model loaded (qwen3:32b)

[Open WebUI]
  [PASS] Container running
  [PASS] Using CUDA image
  [PASS] UI accessible on :3000

Uninstalling​

Remove Containers​

.\setup-ollama-websearch.ps1 -Uninstall

Remove Ollama​

  1. Uninstall via Windows Settings → Apps
  2. Delete model data:
Remove-Item -Recurse "$env:USERPROFILE\.ollama"

Remove Models Only​

# List models
ollama list

# Remove specific model
ollama rm qwen3:32b

# Remove all (keep Ollama)
Get-ChildItem "$env:USERPROFILE\.ollama\models\manifests" -Recurse | Remove-Item -Recurse