Skip to content
Open
Show file tree
Hide file tree
Changes from 9 commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
Empty file modified .pre-commit-config.yaml
100755 → 100644
Empty file.
Empty file modified README.md
100755 → 100644
Empty file.
Empty file modified README_zh.md
100755 → 100644
Empty file.
Empty file modified assets/inputs/imgs/img_0.jpg
100755 → 100644
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Empty file modified assets/inputs/imgs/snake.png
100755 → 100644
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Empty file modified configs/attentions/wan_i2v_draft_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_flash.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_nbhd_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_nbhd_720p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_nbhd_sla_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_radial.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sage.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sla_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sla_fa4_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sla_flashinfer_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sla_flex_block_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sla_magi_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sla_sage2_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sla_sage3_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sparge_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sparge_fa4_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sparge_sage2_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_sparge_sage3_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_spas_flash_attn4_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_spas_sage_attn2_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_spas_sage_attn3_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_svg.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_svg2.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_i2v_svg_magi_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_t2v_draft.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_t2v_sla_480p.json
100755 → 100644
Empty file.
Empty file modified configs/attentions/wan_t2v_sparge.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_1.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_2.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_3.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_3_distill.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_4.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_5.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_5_distill.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_6.json
100755 → 100644
Empty file.
Empty file modified configs/bench/lightx2v_6_distill.json
100755 → 100644
Empty file.
Empty file modified configs/caching/adacache/wan_i2v_ada.json
100755 → 100644
Empty file.
Empty file modified configs/caching/adacache/wan_t2v_ada.json
100755 → 100644
Empty file.
Empty file modified configs/caching/custom/wan_i2v_custom_480p.json
100755 → 100644
Empty file.
Empty file modified configs/caching/custom/wan_i2v_custom_720p.json
100755 → 100644
Empty file.
Empty file modified configs/caching/custom/wan_t2v_custom_14b.json
100755 → 100644
Empty file.
Empty file modified configs/caching/custom/wan_t2v_custom_1_3b.json
100755 → 100644
Empty file.
Empty file modified configs/caching/magcache/wan_i2v_dist_cfg_ulysses_mag_480p.json
100755 → 100644
Empty file.
Empty file modified configs/caching/magcache/wan_i2v_mag_480p.json
100755 → 100644
Empty file.
Empty file modified configs/caching/magcache/wan_i2v_mag_calibration_480p.json
100755 → 100644
Empty file.
Empty file modified configs/caching/taylorseer/wan_t2v_taylorseer.json
100755 → 100644
Empty file.
Empty file modified configs/caching/teacache/wan_i2v_tea_480p.json
100755 → 100644
Empty file.
Empty file modified configs/caching/teacache/wan_i2v_tea_720p.json
100755 → 100644
Empty file.
Empty file modified configs/caching/teacache/wan_t2v_1_3b_tea_480p.json
100755 → 100644
Empty file.
Empty file modified configs/caching/teacache/wan_ti2v_tea_720p.json
100755 → 100644
Empty file.
Empty file modified configs/causvid/wan_i2v_causvid.json
100755 → 100644
Empty file.
Empty file modified configs/causvid/wan_t2v_causvid.json
100755 → 100644
Empty file.
Empty file modified configs/changing_resolution/wan_i2v.json
100755 → 100644
Empty file.
Empty file modified configs/changing_resolution/wan_i2v_U.json
100755 → 100644
Empty file.
Empty file modified configs/changing_resolution/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/changing_resolution/wan_t2v_U.json
100755 → 100644
Empty file.
Empty file modified configs/changing_resolution/wan_t2v_U_teacache.json
100755 → 100644
Empty file.
Empty file modified configs/deploy/wan_i2v.json
100755 → 100644
Empty file.
Empty file modified configs/deploy/wan_t2v.json
100755 → 100644
Empty file.
32 changes: 32 additions & 0 deletions configs/dist_infer/hunyuan_image3_t2i_dist_cfg.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
{
"infer_steps": 50,
"sample_guide_scale": 5.0,
"flow_shift": 1.0,
"target_height": 1024,
"target_width": 1024,
"feature_caching": "NoCaching",
"enable_kv_cache": true,
"enable_text_kv_cache": true,
"use_taylor_cache": false,
"taylor_cache_interval": 5,
"taylor_cache_order": 2,
"taylor_cache_enable_first_enhance": false,
"taylor_cache_first_enhance_steps": 3,
"taylor_cache_enable_tailing_enhance": false,
"taylor_cache_tailing_enhance_steps": 1,
"taylor_cache_low_freqs_order": 2,
"taylor_cache_high_freqs_order": 2,
"pipeline_parallel": true,
"enable_cfg": true,
Comment on lines +19 to +20

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

The configuration specifies "hunyuan_cfg_mode": "parallel" and a "cfg_p_size" of 2, but "cfg_parallel": true is missing. Without this flag, CFG parallel inference will not be enabled.

Suggested change
"pipeline_parallel": true,
"enable_cfg": true,
"pipeline_parallel": true,
"cfg_parallel": true,
"enable_cfg": true,

"hunyuan_cfg_mode": "parallel",
"parallel": {
"cfg_p_size": 2
},
"bot_task": "think_recaption",
"use_system_prompt": "en_unified",
"max_new_tokens": 2048,
"text_do_sample": true,
"text_top_k": 1024,
"text_top_p": 0.95,
"text_temperature": 0.6
}
30 changes: 30 additions & 0 deletions configs/dist_infer/hunyuan_image3_t2i_dist_cfg_kv_all_gather.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
{
"infer_steps": 50,
"sample_guide_scale": 5.0,
"flow_shift": 1.0,
"target_height": 1024,
"target_width": 1024,
"feature_caching": "NoCaching",
"enable_kv_cache": true,
"enable_text_kv_cache": true,
"use_taylor_cache": false,
"pipeline_parallel": true,
"hunyuan_image3_pipeline_layout": "interleaved",
"enable_cfg": true,
Comment on lines +11 to +13

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

This configuration is intended for hybrid CFG and Sequence Parallel inference (using kv_all_gather), but both "cfg_parallel": true and "seq_parallel": true are missing. Without these flags, the parallel features will not be enabled.

Suggested change
"pipeline_parallel": true,
"hunyuan_image3_pipeline_layout": "interleaved",
"enable_cfg": true,
"pipeline_parallel": true,
"cfg_parallel": true,
"seq_parallel": true,
"hunyuan_image3_pipeline_layout": "interleaved",
"enable_cfg": true,

"hunyuan_cfg_mode": "parallel",
"moe_impl": "flashinfer",
"attn_impl": "flash_attention_2",
"flashinfer_autotune_mode": "tune",
"parallel": {
"cfg_p_size": 2,
"seq_p_size": 2,
"seq_p_attn_type": "kv_all_gather"
},
"bot_task": "think_recaption",
"use_system_prompt": "en_unified",
"max_new_tokens": 2048,
"text_do_sample": true,
"text_top_k": 1024,
"text_top_p": 0.95,
"text_temperature": 0.6
}
30 changes: 30 additions & 0 deletions configs/dist_infer/hunyuan_image3_t2i_dist_cfg_ulysses.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
{
"infer_steps": 50,
"sample_guide_scale": 5.0,
"flow_shift": 1.0,
"target_height": 1024,
"target_width": 1024,
"feature_caching": "NoCaching",
"enable_kv_cache": true,
"enable_text_kv_cache": true,
"use_taylor_cache": false,
"pipeline_parallel": true,
"hunyuan_image3_pipeline_layout": "interleaved",
"enable_cfg": true,
Comment on lines +11 to +13

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

This configuration is intended for hybrid CFG and Sequence Parallel inference (using ulysses), but both "cfg_parallel": true and "seq_parallel": true are missing. Without these flags, the parallel features will not be enabled.

Suggested change
"pipeline_parallel": true,
"hunyuan_image3_pipeline_layout": "interleaved",
"enable_cfg": true,
"pipeline_parallel": true,
"cfg_parallel": true,
"seq_parallel": true,
"hunyuan_image3_pipeline_layout": "interleaved",
"enable_cfg": true,

"hunyuan_cfg_mode": "parallel",
"moe_impl": "flashinfer",
"attn_impl": "sdpa",
"flashinfer_autotune_mode": "tune",
"parallel": {
"cfg_p_size": 2,
"seq_p_size": 2,
"seq_p_attn_type": "ulysses"
},
"bot_task": "think_recaption",
"use_system_prompt": "en_unified",
"max_new_tokens": 2048,
"text_do_sample": true,
"text_top_k": 1024,
"text_top_p": 0.95,
"text_temperature": 0.6
}
29 changes: 29 additions & 0 deletions configs/dist_infer/hunyuan_image3_t2i_dist_kv_all_gather.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"infer_steps": 50,
"sample_guide_scale": 5.0,
"flow_shift": 1.0,
"target_height": 1024,
"target_width": 1024,
"feature_caching": "NoCaching",
"enable_kv_cache": true,
"enable_text_kv_cache": true,
"use_taylor_cache": false,
"pipeline_parallel": true,
"enable_cfg": true,
Comment on lines +11 to +12

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

This configuration is intended for Sequence Parallel inference (using kv_all_gather), but "seq_parallel": true is missing. Without this flag, sequence parallel will not be enabled.

Suggested change
"pipeline_parallel": true,
"enable_cfg": true,
"pipeline_parallel": true,
"seq_parallel": true,
"enable_cfg": true,

"hunyuan_cfg_mode": "serial",
"moe_impl": "flashinfer",
"attn_impl": "sdpa",
"flashinfer_autotune_mode": "tune",
"parallel": {
"cfg_p_size": 1,
"seq_p_size": 2,
"seq_p_attn_type": "kv_all_gather"
},
"bot_task": "think_recaption",
"use_system_prompt": "en_unified",
"max_new_tokens": 2048,
"text_do_sample": true,
"text_top_k": 1024,
"text_top_p": 0.95,
"text_temperature": 0.6
}
29 changes: 29 additions & 0 deletions configs/dist_infer/hunyuan_image3_t2i_dist_ulysses.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"infer_steps": 50,
"sample_guide_scale": 5.0,
"flow_shift": 1.0,
"target_height": 1024,
"target_width": 1024,
"feature_caching": "NoCaching",
"enable_kv_cache": true,
"enable_text_kv_cache": true,
"use_taylor_cache": false,
"pipeline_parallel": true,
"enable_cfg": true,
Comment on lines +11 to +12

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

This configuration is intended for Sequence Parallel inference (using ulysses), but "seq_parallel": true is missing. Without this flag, sequence parallel will not be enabled.

Suggested change
"pipeline_parallel": true,
"enable_cfg": true,
"pipeline_parallel": true,
"seq_parallel": true,
"enable_cfg": true,

"hunyuan_cfg_mode": "serial",
"moe_impl": "flashinfer",
"attn_impl": "sdpa",
"flashinfer_autotune_mode": "tune",
"parallel": {
"cfg_p_size": 1,
"seq_p_size": 2,
"seq_p_attn_type": "ulysses"
},
"bot_task": "think_recaption",
"use_system_prompt": "en_unified",
"max_new_tokens": 2048,
"text_do_sample": true,
"text_top_k": 1024,
"text_top_p": 0.95,
"text_temperature": 0.6
}
Empty file modified configs/dist_infer/wan22_moe_i2v_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_moe_i2v_cfg_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_moe_i2v_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_moe_t2v_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_moe_t2v_cfg_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_moe_t2v_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_ti2v_i2v_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_ti2v_i2v_cfg_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_ti2v_i2v_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_ti2v_t2v_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_ti2v_t2v_cfg_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan22_ti2v_t2v_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan_t2v_dist_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan_t2v_dist_cfg_ring.json
100755 → 100644
Empty file.
Empty file modified configs/dist_infer/wan_t2v_dist_cfg_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan21/wan_i2v_distill_lora_4step_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan21/wan_t2v_distill_lora_4step_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan22/wan_moe_i2v_distill_4090.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan22/wan_moe_i2v_distill_5090.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan22/wan_moe_i2v_distill_model.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan22/wan_moe_i2v_distill_quant.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan22/wan_moe_i2v_distill_with_lora.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan22/wan_moe_t2v_distill_lora.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan_i2v_distill_4step_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan_i2v_distill_4step_cfg_4090.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan_i2v_distill_lora_4step_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan_i2v_distill_lora_4step_cfg_4090.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan_t2v_distill_4step_cfg_4090.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan_t2v_distill_4step_cfg_dynamic.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan_t2v_distill_lora_4step_cfg.json
100755 → 100644
Empty file.
Empty file modified configs/distill/wan_t2v_distill_lora_4step_cfg_4090.json
100755 → 100644
Empty file.
28 changes: 28 additions & 0 deletions configs/hunyuan_image3/hunyuan_image3_i2i.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
{
"infer_steps": 50,
"sample_guide_scale": 5.0,
"flow_shift": 1.0,
"image_size": "auto",
"feature_caching": "NoCaching",
"enable_kv_cache": true,
"enable_text_kv_cache": true,
"use_taylor_cache": false,
"taylor_cache_interval": 5,
"taylor_cache_order": 2,
"taylor_cache_enable_first_enhance": false,
"taylor_cache_first_enhance_steps": 3,
"taylor_cache_enable_tailing_enhance": false,
"taylor_cache_tailing_enhance_steps": 1,
"taylor_cache_low_freqs_order": 2,
"taylor_cache_high_freqs_order": 2,
"pipeline_parallel": true,
"enable_cfg": true,
"infer_align_image_size": true,
"bot_task": "think_recaption",
"use_system_prompt": "en_unified",
"max_new_tokens": 2048,
"text_do_sample": true,
"text_top_k": 1024,
"text_top_p": 0.95,
"text_temperature": 0.6
}
28 changes: 28 additions & 0 deletions configs/hunyuan_image3/hunyuan_image3_t2i.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
{
"infer_steps": 50,
"sample_guide_scale": 5.0,
"flow_shift": 1.0,
"target_height": 1024,
"target_width": 1024,
"feature_caching": "NoCaching",
"enable_kv_cache": true,
"enable_text_kv_cache": true,
"use_taylor_cache": false,
"taylor_cache_interval": 5,
"taylor_cache_order": 2,
"taylor_cache_enable_first_enhance": false,
"taylor_cache_first_enhance_steps": 3,
"taylor_cache_enable_tailing_enhance": false,
"taylor_cache_tailing_enhance_steps": 1,
"taylor_cache_low_freqs_order": 2,
"taylor_cache_high_freqs_order": 2,
"pipeline_parallel": true,
"enable_cfg": true,
"bot_task": "think_recaption",
"use_system_prompt": "en_unified",
"max_new_tokens": 2048,
"text_do_sample": true,
"text_top_k": 1024,
"text_top_p": 0.95,
"text_temperature": 0.6
}
Empty file modified configs/hunyuan_video_15/4090/hy15_t2v_480p_bf16_dist.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/cache/hy_15_i2v_480p_teacache.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/cache/hy_15_i2v_720p_teacache.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/cache/hy_15_t2v_480p_teacache.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/cache/hy_15_t2v_720p_teacache.json
100755 → 100644
Empty file.
Empty file.
Empty file modified configs/hunyuan_video_15/hunyuan_video_i2v_480p.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/hunyuan_video_i2v_720p.json
100755 → 100644
Empty file.
Empty file.
Empty file modified configs/hunyuan_video_15/hunyuan_video_t2v_480p.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/hunyuan_video_t2v_480p_distill.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/hunyuan_video_t2v_720p.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/lightae/hy15_t2v_480p_bf16.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/offload/hy15_t2v_480p_bf16.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/quant/hy15_t2v_480p_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/hunyuan_video_15/vsr/hy15_i2v_480p.json
100755 → 100644
Empty file.
Empty file modified configs/infinitetalk/4090/infinitetalk_mutli_distilled.json
100755 → 100644
Empty file.
Empty file modified configs/infinitetalk/4090/infinitetalk_single_distilled.json
100755 → 100644
Empty file.
Empty file modified configs/infinitetalk/5090/infinitetalk_mutli_distilled.json
100755 → 100644
Empty file.
Empty file modified configs/infinitetalk/5090/infinitetalk_single_distilled.json
100755 → 100644
Empty file.
Empty file modified configs/infinitetalk/h100/infinitetalk_mutli_distilled.json
100755 → 100644
Empty file.
Empty file modified configs/infinitetalk/h100/infinitetalk_single_distilled.json
100755 → 100644
Empty file.
Empty file modified configs/lingbot/lingbot_i2v.json
100755 → 100644
Empty file.
Empty file modified configs/lingbot_fast/lingbot_fast_i2v_kv_kiviquant.json
100755 → 100644
Empty file.
Empty file modified configs/longcat_image/longcat_image_i2i_cfg_parallel.json
100755 → 100644
Empty file.
Empty file modified configs/longcat_image/longcat_image_t2i_cfg_parallel.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_3.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_3_distill_offload.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_3_distill_upsample_offload.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_3_offload.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_cfg_parallel.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_distill_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_lora.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_offload.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_tp.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_ulysses.json
100755 → 100644
Empty file.
Empty file modified configs/ltx2/ltx2_upsample.json
100755 → 100644
Empty file.
Empty file modified configs/meanflow/wan_t2v_meanflow_distill_2step.json
100755 → 100644
Empty file.
Empty file modified configs/offload/block/qwen_image_i2i_2509_block.json
100755 → 100644
Empty file.
Empty file modified configs/offload/block/qwen_image_i2i_block.json
100755 → 100644
Empty file.
Empty file modified configs/offload/block/qwen_image_t2i_block.json
100755 → 100644
Empty file.
Empty file modified configs/offload/block/wan_i2v_block.json
100755 → 100644
Empty file.
Empty file modified configs/offload/block/wan_t2v_1_3b.json
100755 → 100644
Empty file.
Empty file modified configs/offload/block/wan_t2v_block.json
100755 → 100644
Empty file.
Empty file modified configs/offload/disk/wan_i2v_phase_lazy_load_480p.json
100755 → 100644
Empty file.
Empty file modified configs/offload/disk/wan_i2v_phase_lazy_load_720p.json
100755 → 100644
Empty file.
Empty file modified configs/offload/phase/wan_i2v_phase.json
100755 → 100644
Empty file.
Empty file modified configs/offload/phase/wan_t2v_phase.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/amd_rocm/qwen_image_i2i_2511.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/amd_rocm/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/ascend_npu/qwen_image_i2i_2511.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/ascend_npu/qwen_image_t2i_2512.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/ascend_npu/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/ascend_npu/wan_ti2v_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/ascend_npu/z_image_turbo_t2i.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/hygon_dcu/qwen_image_i2i_2511.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/hygon_dcu/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/iluvatar_cuda/z_image_turbo_t2i.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/iluvatar_cuda/z_image_turbo_t2i_int8.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/metax/qwen_image_i2i_2511.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/metax/qwen_image_t2i_2512.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/metax/wan22_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/metax/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/mlu/qwen_image_i2i_2511.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/mlu/qwen_image_t2i_2512_distill.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/mlu/qwen_image_t2i_2512_distill_dist.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/mlu/wan_animate.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/mlu/wan_animate_dist.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/mlu/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/mthreads_musa/qwen_image_i2i_2511.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/mthreads_musa/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/nvidia/qwen_image_i2i_2511.json
100755 → 100644
Empty file.
Empty file modified configs/platforms/nvidia/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/quantization/gguf/wan_i2v_q4_k.json
100755 → 100644
Empty file.
Empty file modified configs/quantization/wan_i2v.json
100755 → 100644
Empty file.
Empty file modified configs/quantization/wan_i2v_q8f.json
100755 → 100644
Empty file.
Empty file modified configs/quantization/wan_i2v_torchao.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/5090/qwen_image_i2i_preview_2511_bf16.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/5090/qwen_image_i2i_preview_2511_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_i2i_2511.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_i2i_2511_dist.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_i2i_2511_distill.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_i2i_2511_distill_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_i2i_2511_trt.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_i2i_layered.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_t2i_2512.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_t2i_2512_distill.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_t2i_2512_distill_dist.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_t2i_2512_distill_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_t2i_2512_distill_zoe.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_t2i_2512_distill_zoe_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/qwen_image/qwen_image_t2i_2512_trt.json
100755 → 100644
Empty file.
Empty file modified configs/seedvr/4090/seedvr2_3b.json
100755 → 100644
Empty file.
Empty file modified configs/seedvr/seedvr2_3b.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/5090/seko_talk_5090_bf16.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/5090/seko_talk_5090_int8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/5090/seko_talk_5090_int8_8gpu.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/A800/seko_talk_A800_int8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/A800/seko_talk_A800_int8_dist_2gpu.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/A800/seko_talk_A800_int8_dist_4gpu.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/A800/seko_talk_A800_int8_dist_8gpu.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/L40s/1gpu/seko_talk_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/L40s/2gpu/seko_talk_bf16.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/L40s/2gpu/seko_talk_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/L40s/4gpu/seko_talk_bf16.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/L40s/4gpu/seko_talk_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/L40s/8gpu/seko_talk_bf16.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/L40s/8gpu/seko_talk_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/multi_person/02_base_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/multi_person/03_dist.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/multi_person/04_dist_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_02_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_03_dist.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_04_fp8_dist.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_05_offload_fp8_4090.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_05_offload_fp8_4090_dist.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_06_offload_fp8_H100.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_07_dist_offload.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_08_5B_base.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_10_fp8_dist_fixed_min_area.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_11_fp8_dist_fixed_shape.json
100755 → 100644
Empty file.
Empty file.
Empty file.
Empty file.
Empty file modified configs/seko_talk/seko_talk_16_fp8_dist_compile.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_24_fp8_dist_compile_nbhd_attn.json
100755 → 100644
Empty file.
Empty file modified configs/seko_talk/seko_talk_25_int8_dist_fp8_comm.json
100755 → 100644
Empty file.
Empty file modified configs/self_forcing/wan_t2v_sf.json
100755 → 100644
Empty file.
Empty file modified configs/self_forcing/wan_t2v_sf_14b.json
100755 → 100644
Empty file.
Empty file modified configs/self_forcing/wan_t2v_sf_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/self_forcing/wan_t2v_sf_kv_kiviquant.json
100755 → 100644
Empty file.
Empty file modified configs/self_forcing/wan_t2v_sf_kv_kiviquant_14b.json
100755 → 100644
Empty file.
Empty file modified configs/self_forcing/wan_t2v_sf_nvfp4.json
100755 → 100644
Empty file.
Empty file modified configs/video_frame_interpolation/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan/wan_flf2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan/wan_i2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan/wan_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan/wan_t2v_enhancer.json
100755 → 100644
Empty file.
Empty file modified configs/wan/wan_vace.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_animate.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_animate_4090.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_animate_8gpu.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_animate_lora.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_animate_lora_dist.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_animate_replace.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_animate_replace_4090.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_animate_replace_lora.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_distill_moe_flf2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_distill_moe_flf2v_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_distill_moe_flf2v_int8.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_distill_moe_flf2v_with_lora.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_moe_flf2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_moe_i2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_moe_i2v_4090.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_moe_i2v_audio.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_moe_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_moe_t2v_distill.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_ti2v_i2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_ti2v_i2v_4090.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_ti2v_t2v.json
100755 → 100644
Empty file.
Empty file modified configs/wan22/wan_ti2v_t2v_4090.json
100755 → 100644
Empty file.
Empty file modified configs/wan22_vace/a800/bf16/wan22_moe_vace.json
100755 → 100644
Empty file.
Empty file modified configs/wan22_vace/a800/bf16/wan22_moe_vace_cfg_parallel.json
100755 → 100644
Empty file.
Empty file.
Empty file modified configs/wan22_vace/a800/int8/wan22_moe_vace.json
100755 → 100644
Empty file.
Empty file modified configs/wan22_vace/a800/int8/wan22_moe_vace_cfg_parallel.json
100755 → 100644
Empty file.
Empty file.
Empty file modified configs/z_image/z_image_turbo_t2i.json
100755 → 100644
Empty file.
Empty file modified configs/z_image/z_image_turbo_t2i_fp8.json
100755 → 100644
Empty file.
Empty file modified configs/z_image/z_image_turbo_t2i_offload.json
100755 → 100644
Empty file.
Empty file modified dockerfiles/Dockerfile
100755 → 100644
Empty file.
Empty file modified dockerfiles/Dockerfile_5090
100755 → 100644
Empty file.
Empty file modified docs/EN/Makefile
100755 → 100644
Empty file.
Empty file modified docs/EN/make.bat
100755 → 100644
Empty file.
Empty file modified docs/EN/source/conf.py
100755 → 100644
Empty file.
Empty file modified docs/EN/source/deploy_guides/for_low_latency.md
100755 → 100644
Empty file.
Empty file modified docs/EN/source/deploy_guides/for_low_resource.md
100755 → 100644
Empty file.
Empty file modified docs/EN/source/getting_started/quickstart.md
100755 → 100644
Empty file.
Empty file modified docs/EN/source/index.rst
100755 → 100644
Empty file.
Empty file modified docs/PAPERS_ZH_CN/Makefile
100755 → 100644
Empty file.
Empty file modified docs/PAPERS_ZH_CN/make.bat
100755 → 100644
Empty file.
Empty file modified docs/PAPERS_ZH_CN/source/conf.py
100755 → 100644
Empty file.
Empty file modified docs/PAPERS_ZH_CN/source/index.rst
100755 → 100644
Empty file.
Empty file modified docs/PAPERS_ZH_CN/source/papers/models.md
100755 → 100644
Empty file.
Empty file modified docs/ZH_CN/Makefile
100755 → 100644
Empty file.
Empty file modified docs/ZH_CN/make.bat
100755 → 100644
Empty file.
Empty file modified docs/ZH_CN/source/conf.py
100755 → 100644
Empty file.
Empty file modified docs/ZH_CN/source/deploy_guides/for_low_latency.md
100755 → 100644
Empty file.
Empty file modified docs/ZH_CN/source/deploy_guides/for_low_resource.md
100755 → 100644
Empty file.
Empty file modified docs/ZH_CN/source/getting_started/quickstart.md
100755 → 100644
Empty file.
Empty file modified docs/ZH_CN/source/index.rst
100755 → 100644
Empty file.
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
# Hunyuan Image3 Think Recaption Implementation Plan

> **For agentic workers:** REQUIRED SUB-SKILL: Use superpowers:subagent-driven-development (recommended) or superpowers:executing-plans to implement this plan task-by-task. Steps use checkbox (`- [ ]`) syntax for tracking.

**Goal:** Add a native LightX2V text-generation pre-stage for Hunyuan Image3 `recaption` and `think_recaption`, then feed generated COT text into the existing native image generation path.

**Architecture:** Keep the DiT path native. Add small runner-level helpers for text input preparation, autoregressive token generation without KV cache, stage transitions from `</think>` to `<recaption>`, and generated COT injection via tokenizer `batch_cot_text` for `gen_image`.

**Tech Stack:** Python, PyTorch, Hunyuan tokenizer/image processor helpers, LightX2V native HunyuanImage3 model/infer/weights.

---

### Task 1: Regression Tests

**Files:**
- Modify: `tests/test_hunyuan_image3_integration.py`

- [ ] Add tests for resolving bot task, generating COT before image inputs, and stage transition token forcing.
- [ ] Run targeted pytest and verify failures before implementation.

### Task 2: Runner Text Generation Helpers

**Files:**
- Modify: `lightx2v/models/runners/hunyuan_image3/hunyuan_image3_runner.py`

- [ ] Add helpers for system prompt resolution, text template creation, next-token selection, and COT text generation.
- [ ] Preserve existing `bot_task=image` behavior.
- [ ] For `think_recaption`, force `<recaption>` after `</think>` and stop after `</recaption>`.

### Task 3: Feed COT Into Image Generation

**Files:**
- Modify: `lightx2v/models/runners/hunyuan_image3/hunyuan_image3_runner.py`
- Modify: `configs/hunyuan_image3/hunyuan_image3_t2i.json`

- [ ] Pass `batch_cot_text` into `apply_chat_template(..., mode="gen_image")`.
- [ ] Add config keys for `bot_task`, `use_system_prompt`, `max_new_tokens`, and deterministic text generation.

### Task 4: Verification

**Files:**
- Test: `tests/test_hunyuan_image3_integration.py`

- [ ] Run full Hunyuan integration tests.
- [ ] Run ruff and py_compile on touched files.
Empty file modified examples/BeginnerGuide/README.md
100755 → 100644
Empty file.
Empty file modified examples/README.md
100755 → 100644
Empty file.
Empty file modified examples/README_zh.md
100755 → 100644
Empty file.
Empty file modified examples/hunyuan_video/hunyuan_i2v.py
100755 → 100644
Empty file.
Loading