CodAI — 100% Offline AI Coding Assistant
Offline AI coding assistant running quantized GGUF models on consumer hardware with zero internet dependency.
An open-source, local AI coding companion designed for university lab environments and air-gapped workstations with strict data privacy constraints. Executes localized GGUF language models directly on CPU with zero internet connection, zero external telemetry, and zero administrative permissions.
-
4-Layer Decoupled Architecture: Separated C++
llama.cppinference core, process supervisor controller, IPC broker, and async streaming UI. - 4-Level Single-Instance Guards: Win32 Named Mutex, socket port binding, PID lockfiles, and OS signal traps eliminating orphan processes and port conflicts.
-
Integer Quantization Optimization: Engineered
Q4_K_Mmodels executing within 2 GB – 4 GB RAM on standard dual-core CPUs via AVX2 SIMD instructions.