Skip to content

Pull requests: huggingface/trl

New pull request New
83 Open 2,122 Closed
83 Open 2,122 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

docs: Add RapidFire AI integration guide
#4340 opened Oct 26, 2025 by kamran-rapidfireAI • Draft
5 tasks
[vllm] update comment about communication group host ip
#4337 opened Oct 24, 2025 by kashif Loading…
5 tasks
4
Update SFT QLoRA notebook with **14B** model on free Colab
#4336 opened Oct 24, 2025 by sergiopaniego Loading…
5 tasks
5
Added custom prepare_model_for_kbit_training to save VRAM
#4335 opened Oct 24, 2025 by sergiopaniego Loading…
5 tasks
3
feat(trainer): add PAPOTrainer for preference-based optimization
#4334 opened Oct 24, 2025 by SolarWindRider Loading…
4 tasks done
2
Update Reducing Memory Consumption guide with more details
#4332 opened Oct 24, 2025 by sergiopaniego Loading…
5 tasks
8
Use explicit tiny-Qwen2ForCausalLM-2.5 model_id param in CI tests
#4331 opened Oct 23, 2025 by albertvillanova Loading…
1
Implement CI test workflow for experimental module
#4330 opened Oct 23, 2025 by albertvillanova Loading…
1
Move tests of experimental GRPO with replay buffer to tests/experimental
#4329 opened Oct 23, 2025 by albertvillanova Loading…
1
Use explicit tiny-Qwen2_5_VL model_id parameter in CI tests
#4325 opened Oct 23, 2025 by albertvillanova Loading…
1
wip - env
#4320 opened Oct 22, 2025 by qgallouedec Loading…
5 tasks
1
refactor: simplify parameter freezing in modeling_base.py
#4305 opened Oct 20, 2025 by Ki-Seki Loading…
2 of 5 tasks
2
GRPO: ScaleRL -> Support casting LM Head to FP32
#4303 opened Oct 18, 2025 by pramodith Loading…
4 of 5 tasks
26
[SFT] Log mean token accuracy from Liger kernel
#4302 opened Oct 18, 2025 by kashif Loading…
5 tasks
5
Tool call
#4300 opened Oct 18, 2025 by qgallouedec • Draft
5 tasks
Add CISPO loss option and documentation
#4298 opened Oct 16, 2025 by gustavorubim Loading…
3
feat: Add Multi-Token Prediction (MTP) support to SFTTrainer
#4290 opened Oct 15, 2025 by KLGR123 Loading…
fix CI issue for vlm_gemma_3n model
#4278 opened Oct 15, 2025 by kaixuanliu Loading…
1
[SFT] add support for unified conversion logic for both images and videos
#4264 opened Oct 13, 2025 by kashif Loading…
3
Remove FSDP1 support: use FSDP2 exclusively
#4260 opened Oct 11, 2025 by behroozazarkhalili Loading…
1
Fix DPO Trainer Bug For Qwen2-VL (Issue 2660)
#4257 opened Oct 11, 2025 by FabianSchuetze Loading…
1 of 3 tasks
3
Online-dpo-ben
#4252 opened Oct 10, 2025 by burtenshaw • Draft
5 tasks
[Utils] fix DataCollatorForChatML
#4231 opened Oct 8, 2025 by kashif • Draft
5
Add support for Python 3.14
#4225 opened Oct 8, 2025 by albertvillanova Loading…
4
Update max_length explanation for VLM trainers
#4220 opened Oct 7, 2025 by sergiopaniego Loading…
5 tasks
3
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.