Model reference · open weights
i2vgen-xl is an open-weight video model from ali-vilab, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
VGen VGen is an open-source video synthesis codebase developed by the Tongyi Lab of Alibaba Group, featuring state-of-the-art video generative models. This repository includes implementations of the following methods: - I2VGen-xl: High-quality image-to-video synthesis via cascaded diffusion models - VideoComposer: Compositional Video Synthesis with Motion Controllability - Hierarchical Spatio-temporal Decoupling for Text-to-Video Generation - [A Recipe for Scaling up Text-to-Video Generation with Text-free Videos]() - [InstructVideo: Instructing Video Diffusion Models with Human Feedback]() - DreamVideo: Composing Your Dream Videos with Customized Subject and Motion - VideoLCM: Video Latent Consistency Model - Modelscope text-to-video technical report VGen can produce high-quality videos from the input text, images, desired motion, desired subjects, and even the feedback signals provided. It also offers a variety of commonly used video generation tools such as visualization, sampling, training, inference, join training using images and videos, acceleration, and more. 🔥News!!! - [2023.12] We release the high-efficiency video generation method VideoLCM - [2023.12] We release the code and model of I2VGen-XL and the ModelScope T2V - [2023.12] We release the T2V method HiGen and customizing T2V method DreamVideo. - [2023.12] We write an introduction docment for VGen and compare I2VGen-XL with SVD. - [2023.11] We release a high-quality I2VGen-XL model, please refer to the Webpage TODO - [x] Release the technical papers and webpage of I2VGen-XL - [x] Release the code and pretrained models that can generate 1280x720 videos - [ ] Release models optimized specifically for the human body and faces - [ ] Updated version can fully maintain the ID and capture large and accurate motions simultaneously - [ ] Release other methods and the corresponding models Preparation The main features of VGen are as follows: - Expandability, allowing for easy management of your own experiments. - Completeness, encompassing all common components for video generation. - Excellent performance, featuring powerful pre-trained models in multiple tasks. Installation Datasets We have provided a demo
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | ali-vilab |
|---|---|
| Type | Video models |
| Parameters (lead) | 1.4B |
| Variants | 1 |
| Runs with | diffusers |
| Released | 2023-12-15 |
| Popularity | 36k downloads / month |
| Likes | 186 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| i2vgen-xl | 1.4B | BF16 | ~3.3 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys i2vgen-xl for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (i2vgen-xl below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/videos/generations \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"i2vgen-xl","prompt":"a drone shot over a forest"}'
Details
Tags
Papers
Licence
Open weights under mit — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore