Rotate Your Character: Revisiting Video Diffusion Models for High-Quality 3D Character Generation

Logo
Jin Wang*,1,2, Jianxiang Lu*,1, Comi Chen1, Guangzheng Xu1, Haoyu Yang1, Peng Chen1, Na Zhang1, Yifan Xu1, Longhuang Wu1, Shuai Shao1, Qinglin Lu†,1, Ping Luo2
1Hunyuan, Tencent, China
2The University of Hong Kong, China
*Equal contribution   †Corresponding author

Abstract

Generating high-quality 3D characters from single images remains a significant challenge in digital content creation, particularly due to complex body poses and self-occlusion. In this paper, we present RCM (Rotate your Character Model), an advanced image-to-video diffusion framework tailored for high-quality novel view synthesis (NVS). Compared to existing diffusion-based approaches, RCM offers several key advantages: (1) transferring characters with any complex poses into a canonical pose, enabling consistent novel view synthesis across the entire viewing orbit, (2) high-resolution orbital video generation at 1024×1024 resolution, (3) controllable observation positions given different initial camera poses, and (4) multi-view conditioning supporting up to 4 input images, accommodating diverse user scenarios. Extensive experiments demonstrate that RCM outperforms state-of-the-art methods in novel view synthesis on character generations.

🎭 360° Character Showcase

Input
Single view
Single view
Single view + Camera
Single view with camera
Multi view
Multi view
Multi view + Camera
Multi view with camera
Character with background
Character with background
360° Rotation

🖼️ Qualitative Comparisons

Prompt: The character rotates 360 degrees counterclockwise, and the details of the back include: a heavily armored, segmented black and dark metallic suit with layered shoulder plates extending down the spine, a wide utility belt with hanging pouches and straps, and reinforced back plates that follow the curvature of the torso, all matching the rugged, battle-worn aesthetic of the front.
Input
Single view
AR-1-to-3
Hi3D
CharacterGen
Wan 2.1
SV3D
EpiDiff
SyncDreamer
Wan 2.2
Ours (RCM)
Prompt: The character rotates 360 degrees counterclockwise, and the details of the back include: a pair of large, feathered white wings spread wide from the shoulder blades, a flowing off-white cape billowing behind with golden trim, and the back of the armored torso featuring dark metallic plates with ornate gold buckles and straps, all set against a dark, dusty ground.
Input
Single view
AR-1-to-3
Hi3D
CharacterGen
Wan 2.1
SV3D
EpiDiff
SyncDreamer
Wan 2.2
Ours (RCM)
Prompt: The character rotates 360 degrees counterclockwise, and the details of the back include: a flowing dark cape with vibrant blue and purple accents, a sleek black cowl with pointed bat ears, and a suit with matching blue highlights along the arms and legs, all set against a dynamic crouched pose.
Input
Single view
AR-1-to-3
Hi3D
CharacterGen
Wan 2.1
SV3D
EpiDiff
SyncDreamer
Wan 2.2
Ours (RCM)
Prompt: The character rotates 360 degrees counterclockwise, and the details of the back include: the green scarf draping elegantly over her shoulders with tassels flowing freely, the white blouse with puffed sleeves and green trim visible from behind, the long green skirt adorned with golden patterns along the hem and side seams, and the brown belt with a decorative buckle cinching her waist, all complemented by her long brown hair cascading down her back.
Input
Single view
AR-1-to-3
Hi3D
CharacterGen
Wan 2.1
SV3D
EpiDiff
SyncDreamer
Wan 2.2
Ours (RCM)

📸 More Results

Input
Output