Skip to content

Pull requests: huggingface/trl

New pull request New
189 Open 4,098 Closed
189 Open 4,098 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Document that padding_free is currently disabled in DPO
#6972 opened Aug 29, 2026 by behroozazarkhalili Collaborator Loading…
1
fix(data): handle all-empty BFD packing
#6971 opened Aug 29, 2026 by YZJF Loading…
5 of 8 tasks
1
Bump https://github.com/huggingface/doc-builder from 0ab9ea03baf111ed8dd83e88233430b663127368 to 1b16dac5e33043af565fdf4c1b5b0fe81d0891c8 dependencies Pull requests that update a dependency file pre_commit Pull requests that update pre_commit code
#6969 opened Aug 29, 2026 by dependabot Bot Loading…
@albertvillanova
1
Fix mixed-image Online DPO server batches
#6968 opened Aug 29, 2026 by DaoyuanLi2816 Contributor Loading…
5 of 8 tasks
1
2
Stop dependabot from opening ruff pre-commit bumps
#6965 opened Aug 28, 2026 by albertvillanova Member Loading…
1
Use ruff select instead of extend-select to keep the rule set explicit
#6964 opened Aug 28, 2026 by albertvillanova Member Loading…
1
Pin layer_types so the tiny Cohere2 model covers both attention types
#6963 opened Aug 28, 2026 by albertvillanova Member Loading…
1 task
1
Pin layer_types so the tiny Gemma3 and Olmo3 models cover both attention types
#6962 opened Aug 28, 2026 by albertvillanova Member Loading…
1
2
Bump the actions group across 1 directory with 5 updates dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#6958 opened Aug 28, 2026 by dependabot Bot Loading…
@albertvillanova
1
Bump https://github.com/astral-sh/ruff-pre-commit from v0.13.3 to 0.16.4 dependencies Pull requests that update a dependency file pre_commit Pull requests that update pre_commit code
#6957 opened Aug 28, 2026 by dependabot Bot Loading…
@albertvillanova
3
Validate reward model tokenizer matches policy in XPOTrainer/NashMDTrainer
#6955 opened Aug 28, 2026 by amanyagami Loading…
5 of 8 tasks
1
4
Honor reward_processing_classes in XPO and Nash-MD trainers
#6952 opened Aug 27, 2026 by 22elix3r Loading…
5 of 8 tasks
1
9
Compute the loss in prediction_step so Online DPO evaluation runs
#6950 opened Aug 27, 2026 by behroozazarkhalili Collaborator Loading…
1
1
ZeroSyncGRPOTrainer: self-contained minimal trainer, one weight copy, never-idle generation
#6949 opened Aug 27, 2026 by qgallouedec Member • Draft
Remove the experimental Harbor integration (superseded by OpenEnv)
#6948 opened Aug 27, 2026 by adithya-s-k Collaborator Loading…
5
Add AsyncGRPO Harbor example: any harness, any sandbox, any Harbor dataset, served through OpenEnv
#6947 opened Aug 27, 2026 by adithya-s-k Collaborator Loading…
8
Remove the unreachable prepare_multimodal_messages_vllm
#6946 opened Aug 27, 2026 by behroozazarkhalili Collaborator Loading…
1
1
Warn when reshaped sampling biases the AsyncGRPO importance ratio
#6944 opened Aug 27, 2026 by behroozazarkhalili Collaborator Loading…
2
Aggregate metrics at log time only
#6943 opened Aug 27, 2026 by qgallouedec Member • Draft
enable compiled Liger JSD losses
#6942 opened Aug 26, 2026 by mdeff Loading…
4 of 8 tasks
2
Remove the unused TRL dev Docker image
#6933 opened Aug 26, 2026 by albertvillanova Member Loading…
2
Dequantize the bitsandbytes base before the vLLM weight push
#6922 opened Aug 25, 2026 by behroozazarkhalili Collaborator Loading…
1
6
fix(vllm): support IPv6 communicator hosts
#6907 opened Aug 25, 2026 by yikun-c Loading…
4 of 8 tasks
1
6
Support tool-returned images across VLM architectures
#6906 opened Aug 25, 2026 by DaoyuanLi2816 Contributor Loading…
3 of 8 tasks
Add contributor skills at .agents/skills
#6901 opened Aug 25, 2026 by qgallouedec Member Loading…
7
ProTip! What’s not been updated in a month: updated:<2026-07-29.