Popular repositories Loading

1. high high Public

   Terminal-based LLM chat interface with low-latency streaming and a syntax highlighting

   C++ 3

2. GGUF-Tool-Suite GGUF-Tool-Suite Public

   Forked from Thireus/GGUF-Tool-Suite

   Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within secon…

   Shell

3. ik_llama.cpp ik_llama.cpp Public

   Forked from ikawrakow/ik_llama.cpp

   llama.cpp fork with additional SOTA quants and improved performance

   C++