[RWKV] Align community integration contracts - #10
Merged
Conversation
CI recapDashboard: View test results in Grafana
|
|
[For maintainers] Suggested jobs to run (before merge) run-slow: rwkv |
Author
|
Post-merge CI note: |
3 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Aligns the RWKV-7 integration with the agreed community contracts while keeping the canonical RWKV math, tensor names,
head_size=64, and FlashRWKV2 provider boundary unchanged.prepare_for_inference()lifecycle explicit and test the BF16 training round triptokenizers-rwkvdependency andRwkvTriesave/reload contractQwen2Rwkv remains intentionally out of scope.
Coordination
No repository issue is mapped to this maintenance batch; it was requested and approved directly by the repository owner. Duplicate-work checks found no overlapping open PR or issue in this repository. Upstream already has a separate portable RWKV-7 proposal in huggingface#47780, so this PR is deliberately limited to the rwkv-rs integration branch and does not create a competing upstream PR.
Validation
66 passed, 1 skipped(the skipped case requires the official vocabulary path)rwkv-sha-pro6000x8with the official vocabulary:67 passed, 9 subtests passedmake typingrwkvextramake stylegit diff --checkBefore submitting