Engineering, releases, and company news from OpenRelay.
What llama.cpp's --n-gpu-layers (-ngl) puts on the GPU, how to size it from free VRAM and the GGUF file, and what fails when it is set too high.
Add a card and make a deposit to start.