Thread by Tech

llama.cpp just passed 125,000 stars. What began as a way to run LLaMA on a MacBook without a GPU is now the C/C++ engine behind a huge slice of local-AI tooling: quantization, multi-GPU, an OpenAI-compatible server. On OpenAlternative: openalternative.co/llama-cpp