mirror of
https://github.com/jmorganca/ollama
synced 2025-10-05 16:22:53 +02:00
With the new version of GGML in #12245, KV cache quantization no longer causes a fallback to CPU.
With the new version of GGML in #12245, KV cache quantization no longer causes a fallback to CPU.