tokenizer 'padding' param is not correct.#669

Merged

NathanHB merged 3 commits intohuggingface:mainfrom

xgwang:xg-fix-greeduntil

Apr 22, 2025

Commits on Apr 7, 2025

change tokenizer to pad to 'longest' sequence, instead of 'max_length'
xgw
committed

Commits on Apr 10, 2025

Merge remote-tracking branch 'origin/main' into xg-fix-greeduntil
xgw
committed

Commits on Apr 17, 2025

Merge branch 'main' into xg-fix-greeduntil
NathanHB
authored