Skip to content

Vectorize batched sampling for rows that share a sampler - #1540

Closed
pierre427 wants to merge 7 commits into
ml-explore:mainfrom
pierre427:pr/batched-sampler
Closed

pierre427 wants to merge 7 commits into
ml-explore:mainfrom
pierre427:pr/batched-sampler

Key the sampler memo on the plural eos_token_ids contract

4711407
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Update bypass list
succeeded Aug 21, 2026 in 10s