mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Increase warmup of LR from 500 to 1000 batches

Browse Source
This commit is contained in:
Daniel Povey 2023-02-11 18:15:59 +08:00
parent db543866d8
commit b0c87a93d2
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
egs/librispeech/ASR/pruned_transducer_stateless7/train.py
View File

@ -1119,7 +1119,8 @@ def run(rank, world_size, args):
clipping_scale=2.0,
)
scheduler = Eden(optimizer, params.lr_batches, params.lr_epochs)
scheduler = Eden(optimizer, params.lr_batches, params.lr_epochs,
warmup_batches=1000.0)
if checkpoints and "optimizer" in checkpoints:
logging.info("Loading optimizer state dict")