Adding custom GGUF models from HuggingFace

Beyond the built-in offline models, Grout App lets you add your own. Any sd.cpp-compatible GGUF model from HuggingFace can be plugged in.

What you need

• A model file in GGUF format.

• The model must be sd.cpp-compatible.

Step by step

1. Find an sd.cpp-compatible GGUF model on HuggingFace.

2. Download the GGUF file to your computer.

3. In Grout App, open the offline model section of the image generator.

4. Add the downloaded GGUF as a new model.

5. Select it from the model picker and generate.

Notes

• Custom models run with the same offline guarantees as the built-ins — no Merits, no internet required after the file is on your machine.

• If a download doesn't load, double-check that the file is GGUF and sd.cpp-compatible.

Related

• Downloading and running local image models

• GPU acceleration: Metal, CUDA, and Vulkan