Model reference · open weights
controlnet-inpaint-dreamer-sdxl is an open-weight image model from destitech. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | destitech |
|---|---|
| Type | Image models |
| Task | Image edit |
| Parameters (lead) | 1.3B |
| Runs with | diffusers |
| Released | 2023-09-24 |
| Popularity | 1k downloads / month |
| Licence | Open weights |
About
This ControlNet has been conditioned on Inpainting and Outpainting.
It is an early alpha version made by experimenting in order to learn more about controlnet.
It is designed to work with Stable Diffusion XL. It should work with any model based on it.
The image to inpaint or outpaint is to be used as input of the controlnet in a txt2img pipeline with denoising set to 1.0. The part to in/outpaint should be colors in solid white.
Depending on the prompts, the rest of the image might be kept as is or modified more or less.
Model link Model link - fp16 version - Built by OzzyGT
OzzyGT made a really good guide on how to use this model for outpainting, give it a try Here !
A big thank you to him for pointing me out how to name the files for diffusers compatibility and for the fp16 version, you should be able to use it this way with both normal and fp16 version:
from diffusers import ControlNetModel
import torch
controlnet = ControlNetModel.from_pretrained(
"destitech/controlnet-inpaint-dreamer-sdxl", torch_dtype=torch.float16, variant="fp16"
)
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys controlnet-inpaint-dreamer-sdxl for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (controlnet-inpaint-dreamer-sdxl below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/images/generations \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"controlnet-inpaint-dreamer-sdxl","prompt":"a red bicycle","size":"1024x1024"}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.