#llama-cpp

DeepSeek V4 Flash on 2-bit GGUF: First Frontier-Quality Local Inference

Developers running DeepSeek V4 Flash with 2-bit selective GGUF via llama.cpp describe it as 'the first time I feel I have a frontier model running on my computer' — a milestone for local AI.