8 Commits

Author SHA1 Message Date
JinZr
01cc307664 fixed loss functions & scaling factors 2024-10-07 01:03:26 +08:00
JinZr
58f6562824 added scheduler w/ warmup 2024-10-06 19:07:07 +08:00
JinZr
d83ce89fca fixed loss normalization & scaling factors 2024-10-06 15:55:49 +08:00
JinZr
f9340cc5d7 refactored loss functions 2024-10-05 23:11:43 +08:00
JinZr
0150961a33 minor fixes 2024-09-06 21:20:45 +08:00
JinZr
91f7b1ce6f sort of fixed DDP training issue 2024-09-06 18:07:50 +08:00
JinZr
6e4a9ea85a a little bit coarse commit 2024-09-05 22:30:07 +08:00
jinzr
dd82686a0f init commit 2024-09-04 22:16:41 +08:00