GPU acceleration: Metal, CUDA, and Vulkan

How Grout App automatically uses your GPU for offline image generation.

Written By Grout

Last updated 9 days ago

Offline GPU models like Flux run faster when accelerated by your machine's GPU. Grout App handles this automatically.

Supported backends

  • Metal — used on macOS with Apple Silicon and supported Macs.

  • CUDA — used on machines with supported NVIDIA GPUs.

  • Vulkan — used as a broader cross-platform GPU backend.

How it picks one

You don't have to configure anything. Grout App detects what your machine supports and uses GPU acceleration automatically when available. If you don't have a supported GPU, CPU models like Bonsai and Stable Diffusion still work.

Tips

  • If GPU acceleration isn't kicking in, make sure your system drivers are up to date.

  • For best results with Flux, ensure your GPU has enough VRAM for the model size you're running.

  • CPU models (Bonsai, Stable Diffusion) are a reliable fallback when GPU acceleration isn't available.

Related

  • Offline image generation: overview

  • Downloading and running local image models