RTX PRO 5000浅尝MiniMax H3 I2V(图生视频)
-
工作流:ComfyUI官方的Minimax H3 图生视频模板。
选用的模型权重如下:

实测,9:16(竖屏分辨率)的0.5M像素,也就是大概540P视频,15秒长度。总耗时750秒左右:

期间显存占用35GB(包含2GB左右的游戏负载):

个人评价:
目前的最强开源I2V模型。优势:
1、视频精准度质量优于wan2.2的同时,兼具音频能力。
2、帧率、总长度远高于wan2.2(15秒24fps/5秒16fps)。
3、提示词遵循能力强,且有非常强的泛化能力。(比如正面角色让其转身,模型脑补的背面服装精度相当高)
4、人物脸部刻画能力远超wan2.2,不会出现五官漂浮感,不会出现眨眼恐怖谷效应。
5、在RTX PRO 5000上,生成性能和原生wan2.2几乎持平。劣势:
1、目前没有4步加速Lora(类似LightX2V),无法实现低成本的预览。
2、提示词的格式有一定限制,强遵循的前提是,用户要遵循官方的提示词模板。
3、官方只给了英文提示词模板,但通过hermes等agent对中文分镜设计转英文提示词模板时,会有一定的信息损失。以上。
另附我的测试素材供坛友进行复现与性能调试对比:
原图片:

提示词:
For the target video, at 0.00 seconds into the target video, <Picture 1> (from [Shot 1]) is fully referenced. integrated_multimodal_description: [Shot 1] Live-action, cinematic, slow motion, the young woman shown in <Picture 1> remains in the scene, preserving her appearance, dress, hairstyle, and the garden-path surroundings. A full-body tracking shot frames her walking forward, the camera tracking backward at slow speed to keep her entire figure in frame. She lifts one hand and gently brushes a strand of hair behind her ear as she walks, her skirt swaying softly with each step; her high heels produce crisp rhythmic taps on the stone path. The camera arcs around her with small amplitude at slow speed, swinging to a position directly behind her back. [Shot 2] At 00:05.000, the camera cuts to a view from directly behind her, framing her full figure as she pauses, places both hands on her waist, and tilts her head slightly to showcase the back details of her dress. The camera slowly trucks right with small amplitude at slow speed, keeping her entire body in frame as she turns her upper body slightly to display the silhouette. The camera then settles into a static shot, slowly framing the wooden bench beside the path in a medium-wide full-body composition. [Shot 3] At 00:10.000, the camera cuts to a medium-wide static shot framing the wooden bench, as the young woman steps into frame, turns, and sits down gracefully in slow motion, crossing one leg over the other. As she crosses her legs, her skirt lifts slightly, unintentionally revealing a brief glimpse of white underwear; she gently tugs at her collar with one hand, a subtle hint of décolletage briefly visible, then smooths the fabric of her skirt with a slow, soft hand movement. The camera holds the full-body framing as she settles into a poised seated pose, her dress draping elegantly over the bench. (3/4) overall_soundscape: Gentle wind rustles through the leaves with faint insect chirps in the background. Crisp high-heeled footsteps tap rhythmically on the stone path, followed by the soft rustle of her skirt and the subtle sound of fabric brushing against her hands as she sits and touches her clothing. non_diegetic_music: N/A -
T terry 于 将此主题固定
-
可以用加速节点,提速45% https://github.com/xmarre/ComfyUI-Spectrum-MiniMax-H3
-
系统 于 取消固定此主题