ollama

2 posts

llmI Squeezed a 27B Into 1-bit on 8GB of VRAM. The 8B at 4-bit Won Anyway

llmRunning Cloudflare OS on a Local LLM, and Why One Tic-Tac-Toe Took Five Rounds