Model reference · open weights
stable-diffusion-xl-1.0-inpainting-0.1 is an open-weight image model from diffusers, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
SD-XL Inpainting 0.1 Model Card SD-XL Inpainting 0.1 is a latent text-to-image diffusion model capable of generating photo-realistic images given any text input, with the extra capability of inpainting the pictures by using a mask. The SD-XL Inpainting 0.1 was initialized with the stable-diffusion-xl-base-1.0 weights. The model is trained for 40k steps at resolution 1024x1024 and 5% dropping of the text-conditioning to improve classifier-free classifier-free guidance sampling. For inpainting, the UNet has 5 additional input channels (4 for the encoded masked-image and 1 for the mask itself) whose weights were zero-initialized after restoring the non-inpainting checkpoint. During training, we generate synthetic masks and, in 25% mask everything. How to use How it works: image | maskimage :-------------------------:|:-------------------------:| prompt | Output :-------------------------:|:-------------------------:| Model Description - Developed by: The Diffusers team - Model type: Diffusion-based text-to-image generative model - License: CreativeML Open RAIL++-M License - Model Description: This is a model that can be used to generate and modify images based on text prompts. It is a Latent Diffusion Model that uses two fixed, pretrained text encoders (OpenCLIP-ViT/G and CLIP-ViT/L). Uses Direct Use The model is intended for research purposes only. Possible research areas and tasks include - Generation of artworks and use in design and other artistic processes. - Applications in educational or creative tools. - Research on generative models. - Safe deployment of models which have the potential to generate harmful content. - Probing and understanding the limitations and biases of generative models. Excluded uses are described below. Out-of-Scope Use The model was not trained to be factual or true representations of people or events, and therefore using the model to generate such content is out-of-scope for the abilities of this model. Limitations and Bias Limitations - The model does not achieve perfect photorealism - The model cannot render legible text - The model struggles with more difficult tasks which involve compositionality, such as rendering an image corre
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | diffusers |
|---|---|
| Type | Image models |
| Parameters (lead) | 2.6B |
| Variants | 1 |
| Runs with | diffusers |
| Based on | stabilityai/stable-diffusion-xl-base-1.0 |
| Released | 2023-09-01 |
| Popularity | 112k downloads / month |
| Likes | 383 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| stable-diffusion-xl-1.0-inpainting-0.1 | 2.6B | BF16 | ~5.9 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys stable-diffusion-xl-1-0-inpainting-0-1 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (stable-diffusion-xl-1-0-inpainting-0-1 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/images/generations \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"stable-diffusion-xl-1-0-inpainting-0-1","prompt":"a red bicycle","size":"1024x1024"}'
Licence
Open weights under openrail++ — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗