Skip to content

Gather tensor-parallel sharded parameters on read in a trace#677

Open
khaiwang wants to merge 2 commits into
devfrom
fix/vllm-tp-param-gather
Open

Gather tensor-parallel sharded parameters on read in a trace#677
khaiwang wants to merge 2 commits into
devfrom
fix/vllm-tp-param-gather

feat(vllm): gather tensor-parallel sharded parameters on read in a trace

ed981b8
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar