Skip to content

Fix: support TileLang 0.1.9 - #1001

Open
benglewis wants to merge 2 commits into
state-spaces:mainfrom
Hirundo-io:tilelang-019-compat
Open

Fix: support TileLang 0.1.9#1001
benglewis wants to merge 2 commits into
state-spaces:mainfrom
Hirundo-io:tilelang-019-compat

Conversation

@benglewis

Copy link
Copy Markdown

Summary

This allows Mamba to resolve alongside vLLM releases that require TileLang 0.1.9.

Validation

  • verified pyproject.toml and setup.py carry the same dependency pair
  • git diff --check

A CUDA Mamba/MIMO smoke test is still required before publishing a rebuilt wheel.

@tridao

tridao commented Jul 29, 2026

Copy link
Copy Markdown
Collaborator

cc @berlinchen7
I did try 0.1.9 at some point very briefly and saw some perf regression on some other kernel, so we should check that the MIMO kernels don't regress after updating tilelang.

@Chessing234

Copy link
Copy Markdown
Contributor

looks reasonable. maybe pin an upper bound too so the next tilelang break doesn't silently install?

@benglewis

Copy link
Copy Markdown
Author

@Chessing234 I have added the pin on the upper bound instead of the fixed version. @tridao How can I test the MIMO kernels? What GPU or similar would I need to test and how?

@bvolpato bvolpato left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we allow apache-tvm-ffi==0.1.10 here? vLLM v0.26 pins it alongside tilelang==0.1.9, so the current <0.1.10 bound still makes that combination unsatisfiable. I tested TileLang 0.1.9 with tvm-ffi 0.1.10 and sampled MIMO forward/backward cases passed.

Could we also run a broader MIMO perf pass before raising the floor? On SM120 I measured one N64 forward shape about 5.4% slower with TileLang 0.1.9, 0.6369 ms versus 0.6042 ms across three medians, while the smaller N16 case was flat. This looks shape-specific, but seems worth checking.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants