Model reference · open weights
stable-diffusion-3.5-medium is an open-weight image model from city96. stable-diffusion-3.5-medium-gguf (GGUF) weighs 1.8 GB; the smallest configuration that runs it is RTX 3060 12 GB.
Summary of the city96/stable-diffusion-3.5-medium-gguf model card, 2026-10-01
What it is
| Released by | city96 |
|---|---|
| Released | 2024-10-30 |
| VRAM | 1.8 GB for the weights |
What it runs on
| Card | One image | Memory |
|---|---|---|
| RTX 3060 12 GB | fits | 11.6 GB |
| RTX 4060 Ti 16 GB | fits | 15.4 GB |
| RTX 3090 24 GB | fits | 23.4 GB |
| RTX 4090 24 GB | fits | 23.4 GB |
| RTX 5090 32 GB | fits | 31.0 GB |
| L40S 48 GB | fits | 44.0 GB |
| A100 80 GB | fits | 78.2 GB |
| H100 80 GB | fits | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | fits | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | fits | 107 GB |
| H200 141 GB | fits | 138 GB |
| B200 180 GB | fits | 176 GB |
From the model card
This is a direct GGUF conversion of stabilityai/stable-diffusion-3.5-medium
As this is a quantized model not a finetune, all the same restrictions/original license terms still apply.
The model files can be used with the ComfyUI-GGUF custom node.
Place model files in ComfyUI/models/unet - see the GitHub readme for further install instructions.
Please refer to this chart for a basic overview of quantization types.
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.
How it works
Running it yourself
Rent a machine by the hour. ComfyUI is installed on it. Open ComfyUI through the tunnel and load the workflow from the model's card on Hugging Face. Its model loader takes .safetensors files: replace it with Unet Loader (GGUF) and choose this model's file there.
# on your rented machine (the ssh line is on its page in the console)
# the GGUF loader nodes, once per machine
git clone https://github.com/city96/ComfyUI-GGUF /opt/ComfyUI/custom_nodes/ComfyUI-GGUF
pip install -r /opt/ComfyUI/custom_nodes/ComfyUI-GGUF/requirements.txt
# get REPO FILE FOLDER: one file into /workspace/models/FOLDER, where ComfyUI loads it from
get() { hf download "$1" "$2" --local-dir /workspace/hf-files && mkdir -p "/workspace/models/$3" && mv "/workspace/hf-files/$2" "/workspace/models/$3/$4"; }
# the model (1.7 GB)
get city96/stable-diffusion-3.5-medium-gguf sd3.5_medium-Q4_K_M.gguf unet
start-comfyui# on your computer, in a second terminal: ComfyUI in your browser at http://localhost:8188
# HOST and PORT are your machine's, from its page in the console
ssh -L 8188:localhost:8188 dev@HOST -p PORT