Skip to content

[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8 tp=2 and Qwen/Qwen3.5-35B-A3B-FP8 tp=2 - #79

Open
big-yellow-duck wants to merge 3 commits into
mainfrom
rdna4-moe
Open

[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8 tp=2 and Qwen/Qwen3.5-35B-A3B-FP8 tp=2#79
big-yellow-duck wants to merge 3 commits into
mainfrom
rdna4-moe

update tuned configs for rocm7.2.1

dc44e7b
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar