llama.cpp

LLM inference in C/C++

Language: C++

License: MIT

Install command: curl -LsSf https://llama.app/install.sh | sh

Links

• Website

Posts about llama.cpp

• Enea Bächler shared llama.cpp: LLM inference written in C and C++. Developers use it to run language models on their own hardware.

Areas

• AI models (local)
• Runtimes