Model reference · open weights

VerseCrafter

Video TencentARC Image→video 1 build Its own licence terms 528 dl/mo

VerseCrafter is an open-weight video model from TencentARC. VerseCrafter (BF16) weighs 34.7 GB; the smallest configuration that runs it is L40S 48 GB.

  • VerseCrafter is an image-to-video model developed by TencentARC that generates dynamic, realistic video with explicit 4D geometric control over camera and multi-object motion.
  • The model features 17.3B parameters and is built on a frozen Wan2.1 backbone with a trainable GeoAdapter.
  • It supports English and is released under a custom license restricted to academic and research purposes.

Summary of the TencentARC/VerseCrafter model card, 2026-10-01

What it is

Released byTencentARC
Released2025-12-08
Parameters17.3B
VRAM34.7 GB for the weights

What it runs on

Memory and cards for VerseCrafter (BF16)

34.7 GBweights, file size
537 MBruntime overhead
CardWeightsMemory
RTX 3060 12 GB … RTX 5090 32 GBdoes not fit
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

From the model card

What TencentARC says about VerseCrafter

Read the model card

VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control

✨ A controllable video world model with explicit 4D geometric control over camera and multi-object motion.

TL;DR

  • Dynamic Realistic Video World Model: VerseCrafter learns a realistic and controllable video world prior from large-scale in-the-wild data, handling challenging dynamic scenes with strong spatial-temporal coherence.
  • 4D Geometric Control: A unified 4D control state provides direct, interpretable control over camera motion, multi-object motion, and their joint coordination, improving geometric faithfulness.
  • Frozen Video Prior + GeoAdapter: We attach a geometry-aware GeoAdapter to a frozen Wan2.1 backbone, injecting 4D controls into diffusion blocks for precise control without sacrificing video quality.
  • VerseControl4D Dataset: We introduce a large-scale real-world dataset with automatically rendered camera trajectories and multi-object 3D Gaussian trajectories to supervise 4D controllable generation.

Model Details

PropertyValue
Base ModelWan2.1-T2V-14B
Resolution720 × 1280
Frames81 frames
Control SignalsCamera trajectory + 3D Gaussian object trajectories
ArchitectureFrozen DiT + Trainable GeoAdapter

Usage

For installation, inference, and the complete pipeline (depth estimation, segmentation, 3D Gaussian fitting, trajectory customization in Blender, and video generation), please refer to our GitHub repository.

Citation

If you find this work useful, please consider citing:

@article{zheng2026versecrafter,
  title={VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control},
  author={Zheng, Sixiao and Yin, Minghao and Hu, Wenbo and Li, Xiaoyu and Shan, Ying and Fu, Yanwei},
  journal={arXiv preprint arXiv:2601.05138},
  year={2026}
}

Acknowledgements

Our work is built upon MoGe, Grounded-SAM-2, VideoX-Fun, Wan2.1 and diffusers.

License

This project is released under the VerseCrafter License. It is intended for academic/research purposes only and commercial use is not permitted.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

Running it yourself

Run it on a rented GPU

Rent a machine by the hour. ComfyUI is installed on it. Open ComfyUI through the tunnel and load the workflow from the model's card on Hugging Face; choose this model's file in its loader.

# on your rented machine (the ssh line is on its page in the console)
# get REPO FILE FOLDER: one file into /workspace/models/FOLDER, where ComfyUI loads it from
get() { hf download "$1" "$2" --local-dir /workspace/hf-files && mkdir -p "/workspace/models/$3" && mv "/workspace/hf-files/$2" "/workspace/models/$3/$4"; }

# the model (8.1 GB)
get TencentARC/VerseCrafter diffusion_pytorch_model-00003-of-00004.safetensors diffusion_models

start-comfyui
Renting a GPU: connect, tunnels, ComfyUI
# on your computer, in a second terminal: ComfyUI in your browser at http://localhost:8188
# HOST and PORT are your machine's, from its page in the console
ssh -L 8188:localhost:8188 dev@HOST -p PORT
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms