llama.cpp
The industry-standard C++ inference engine for high-performance, local LLM execution across all hardware architectures.
Has API
PricingFree
Free
Quantized LLM Inference
Model Fine-tuning (LoRA)
Text Embeddings
Task Discovery
Model Fine-tuning (LoRA)
Discover the best AI tools to help you model fine-tuning (lora).
1 tools indexedOther
Top AI Tools for This Task
AI Infrastructure