Local AI on CPU Only – Crystal and the Art of Compromise
Crystal, BoarDesign’s AI assistant, runs locally on CPU-only hardware with Google’s Gemma 4 (4B) and Ollama: total privacy, no cloud. Modest hardware comes with real constraints, though, and it takes careful prompt engineering to balance performance and functionality.