llama.cpp
The industry-standard C++ inference engine for high-performance, local LLM execution across all hardware architectures.
Has API
PricingFree
Free
Quantized LLM Inference
Model Fine-tuning (LoRA)
Text Embeddings
Task Discovery
Quantized LLM Inference
Discover the best AI tools to help you quantized llm inference.
1 tools indexedOther
Top AI Tools for This Task
AI Infrastructure