Fix: support TileLang 0.1.9 - #1001
Conversation
|
cc @berlinchen7 |
|
looks reasonable. maybe pin an upper bound too so the next tilelang break doesn't silently install? |
|
@Chessing234 I have added the pin on the upper bound instead of the fixed version. @tridao How can I test the MIMO kernels? What GPU or similar would I need to test and how? |
bvolpato
left a comment
There was a problem hiding this comment.
Could we allow apache-tvm-ffi==0.1.10 here? vLLM v0.26 pins it alongside tilelang==0.1.9, so the current <0.1.10 bound still makes that combination unsatisfiable. I tested TileLang 0.1.9 with tvm-ffi 0.1.10 and sampled MIMO forward/backward cases passed.
Could we also run a broader MIMO perf pass before raising the floor? On SM120 I measured one N64 forward shape about 5.4% slower with TileLang 0.1.9, 0.6369 ms versus 0.6042 ms across three medians, while the smaller N16 case was flat. This looks shape-specific, but seems worth checking.
Summary
This allows Mamba to resolve alongside vLLM releases that require TileLang 0.1.9.
Validation
git diff --checkA CUDA Mamba/MIMO smoke test is still required before publishing a rebuilt wheel.