Docs
Setup notes and command logs from building out our local AI infrastructure.
2026-07-17
45-Minute Class Workbook: Open WebUI Configuration
A run-of-show pulling from the admin guide and MCP/tools docs: talk for 2 minutes on a config, make the change live, show the behavior change. Six segments, timed.
2026-07-16
20 Things to Administer in Open WebUI
Controls panel Advanced Params (temperature, top_p, mirostat, and more) plus a tour of Settings, Admin Panel, and every sidebar shortcut, with a one-liner example for each.
2026-07-16
Tool Calling & MCP in Open WebUI
Live-in-class walkthrough: a native Open WebUI tool, then a real MCP server bridged in via mcpo, including every gotcha hit along the way.
2026-07-14
llama.cpp + Open WebUI Setup
GPU-accelerated local inference with llama.cpp and CUDA, fronted by Open WebUI, reachable remotely via Tailscale and SSH.
2026-07-14
HP Laptop: llama.cpp + CUDA Setup
Downloading a Ministral 3B model, rebuilding llama.cpp with CUDA, and tuning GPU layer offload to fit laptop VRAM.
2026-07-15
HP Workstation Deployment (Part 2)
Adding a second, isolated Open WebUI plus two more models (Gemma 3 4B, Qwen2.5 3B) — with every mistake and lesson learned along the way.