11 Commits

Author SHA1 Message Date
Daniel Povey
dcab1aee4e make biases learn faster in a different way. 2022-05-21 17:47:30 +08:00
Daniel Povey
992f922f81 Make biases learn at twice the speed 2022-05-21 17:30:45 +08:00
Daniel Povey
b7adb6d738 Slow down learning of simple_am_proj.weight by 0.5 2022-05-21 17:06:24 +08:00
Daniel Povey
e44edf99a4 Merge branch 'master' into knowledge_base_1b_L2_ng_orth2feat_cain 2022-05-19 12:42:50 +08:00
Daniel Povey
c736b39c7d Remove unnecessary option for diagnostics code, collect on more batches 2022-05-19 11:35:54 +08:00
Daniel Povey
668d01cc7a Replace Eve with Cain in pruned_transducer_stateless4 2022-05-18 10:16:50 +08:00
Daniel Povey
995371ad95 Move train.py changes to the right dir 2022-05-15 22:17:08 +08:00
Daniel Povey
cee5396058 Orthogonalize every 2k iters 2022-05-15 21:50:40 +08:00
Daniel Povey
0989aec741 Replace Eve optimizer with Abel. 2022-05-15 14:33:08 +08:00
Zengwei Yao
c059ef3169
Keep model_avg on cpu (#348)
* keep model_avg on cpu

* explicitly convert model_avg to cpu

* minor fix

* remove device convertion for model_avg

* modify usage of the model device in train.py

* change model.device to next(model.parameters()).device for decoding

* assert params.start_epoch>0

* assert params.start_epoch>0, params.start_epoch
2022-05-07 10:42:34 +08:00
Zengwei Yao
00c48ec1f3
Model average (#344)
* First upload of model average codes.

* minor fix

* update decode file

* update .flake8

* rename pruned_transducer_stateless3 to pruned_transducer_stateless4

* change epoch number counter starting from 1 instead of 0

* minor fix of pruned_transducer_stateless4/train.py

* refactor the checkpoint.py

* minor fix, update docs, and modify the epoch number to count from 1 in the pruned_transducer_stateless4/decode.py

* update author info

* add docs of the scaling in function average_checkpoints_with_averaged_model
2022-05-05 21:20:04 +08:00