My Local Copilot: Gemma 4 + Open WebUI + OpenHands for Coding Without Leaving My Machine

Short summary

The author designs a local AI development stack combining Gemma 4 (with Ollama), Open WebUI for reasoning and multimodal input, and OpenHands for code execution—keeping codebases offline without vendor lock-in. The architecture separates reasoning (chat, images) from code changes, and routes model variants strategically: smaller models for quick answers, larger models for complex reviews. GitHub integration brings real project context directly into the local workspace.

• •Offline AI stack: Gemma 4 + Ollama + Open WebUI + OpenHands
• •Separates concerns: reasoning/chat vs. code changes with model variant routing
• •Keeps codebases local with GitHub integration for real workflow context

Generated with AI, which can make mistakes.