Benchmarking local LLMs: what an RTX 2080Ti can actually do
What happens when you run a 27B model and a 4B model on the same old card — and where each one bends.
What happens when you run a 27B model and a 4B model on the same old card — and where each one bends.