Tag: localllm
All the articles with the tag "localllm".
-
Why I Switched from Ollama to llama.cpp — and What I Learned
Switching a local LLM from Ollama to llama.cpp on a two-GPU Arch Linux GPD handheld — VRAM budget math, -ngl offloading, tuning, and a two-week verdict