Model reference · open weights
stable-video-diffusion-img2vid-xt is an open-weight video model from stabilityai, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Stable Video Diffusion Image-to-Video Model Card Stable Video Diffusion (SVD) Image-to-Video is a diffusion model that takes in a still image as a conditioning frame, and generates a video from it. Please note: For commercial use, please refer to https://stability.ai/license. Model Details Model Description (SVD) Image-to-Video is a latent diffusion model trained to generate short video clips from an image conditioning. This model was trained to generate 25 frames at resolution 576x1024 given a context frame of the same size, finetuned from [SVD Image-to-Video [14 frames]](https://huggingface.co/stabilityai/stable-video-diffusion-img2vid). We also finetune the widely used f8-decoder for temporal consistency. For convenience, we additionally provide the model with the standard frame-wise decoder here. - Developed by: Stability AI - Funded by: Stability AI - Model type: Generative image-to-video model - Finetuned from model: SVD Image-to-Video [14 frames] Model Sources For research purposes, we recommend our generative-models Github repository (https://github.com/Stability-AI/generative-models), which implements the most popular diffusion frameworks (both training and inference). - Repository: https://github.com/Stability-AI/generative-models - Paper: https://stability.ai/research/stable-video-diffusion-scaling-latent-video-diffusion-models-to-large-datasets Evaluation The chart above evaluates user preference for SVD-Image-to-Video over GEN-2 and PikaLabs. SVD-Image-to-Video is preferred by human voters in terms of video quality. For details on the user study, we refer to the research paper Uses Direct Use The model is intended for both non-commercial and commercial usage. You can use this model for non-commercial or research purposes under this license. Possible research areas and tasks include - Research on generative models. - Safe deployment of models which have the potential to generate harmful content. - Probing and understanding the limitations and biases of generative models. - Generation of artworks and use in design and other artistic processes. - Applications in educational or creative tools. For commercial use, please refer to https://stability.ai/lic
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | stabilityai |
|---|---|
| Type | Video models |
| Parameters (lead) | 1.5B |
| Variants | 1 |
| Runs with | diffusers |
| Released | 2023-11-20 |
| Popularity | 180k downloads / month |
| Likes | 3,388 |
| Licence | Commercial licence needed |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| stable-video-diffusion-img2vid-xt | 1.5B | BF16 | ~3.5 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys stable-video-diffusion-img2vid-xt for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (stable-video-diffusion-img2vid-xt below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/videos/generations \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"stable-video-diffusion-img2vid-xt","prompt":"a drone shot over a forest"}'
Details
Tags
Licence
The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗
Sources
Explore