31 Commits

Author SHA1 Message Date
Fangjun Kuang
02e409b6ce Replace warmup with lr scheduler. 2021-08-16 00:00:53 +08:00
Fangjun Kuang
0be42bef69 Replace warmup with lr scheduler. 2021-08-15 22:59:51 +08:00
Fangjun Kuang
21292066ec Fix OOM handling when using DDP.
We have to disable batch norm layers. Otherwise,
the process will hang indefinitely.
2021-08-15 18:49:12 +08:00
Fangjun Kuang
14e0886559 Minor fixes. 2021-08-15 11:45:53 +08:00
Fangjun Kuang
72c0220830 Fix oom handling. 2021-08-15 09:52:17 +08:00
Fangjun Kuang
36ac512d00 Add madam optimizer from Dan. 2021-08-14 23:12:19 +08:00
Fangjun Kuang
f0ee6cf0dc Minor fixes after review. 2021-08-12 10:33:50 +08:00
Fangjun Kuang
b7133f30bd fix typos 2021-08-10 20:26:37 +08:00
Fangjun Kuang
55be10534d Add readme. 2021-08-10 20:08:23 +08:00
Fangjun Kuang
5a0b9bcb23
Refactoring (#4)
* Fix an error in TDNN-LSTM training.

* WIP: Refactoring

* Refactor transformer.py

* Remove unused code.

* Minor fixes.
2021-08-04 14:53:02 +08:00
Fangjun Kuang
398ed80d7a Minor fixes to support DDP training. 2021-07-31 15:26:57 +08:00
Fangjun Kuang
b94d97da37 Disable gradient computation in evaluation mode. 2021-07-29 20:37:31 +08:00
Fangjun Kuang
acc63a9172 WIP: Add BPE training code. 2021-07-29 20:23:52 +08:00
Fangjun Kuang
bd69e4be32 Use attention decoder for rescoring. 2021-07-28 12:22:09 +08:00
Fangjun Kuang
f65854cca5 Add BPE decoding results. 2021-07-27 17:38:47 +08:00
Fangjun Kuang
4ccae509d3 WIP: Begin to add BPE decoding 2021-07-26 20:06:58 +08:00
Fangjun Kuang
d3101fb005 Fix loading checkpoint in DDP training. 2021-07-26 08:08:14 +08:00
Fangjun Kuang
78bb65ed78 Fix an error in DDP training. 2021-07-25 22:33:09 +08:00
Fangjun Kuang
8055bf31a0 Support DDP training. 2021-07-25 21:40:09 +08:00
Fangjun Kuang
4a66712406 Add LM rescoring. 2021-07-25 18:21:26 +08:00
Fangjun Kuang
6f9fe5b906 Refactor decoding code. 2021-07-24 22:23:50 +08:00
Fangjun Kuang
00f8371f37 begin to add LM rescoring. 2021-07-24 18:24:04 +08:00
Fangjun Kuang
2e33e24348 Add CI test. 2021-07-24 17:47:41 +08:00
Fangjun Kuang
f3542c7793 Add CTC training. 2021-07-24 17:13:20 +08:00
Fangjun Kuang
a01d08f73c Add self-loops to propagate disambiguation symbols. 2021-07-21 13:12:20 +08:00
Fangjun Kuang
8a72901f3a Minor fixes. 2021-07-20 19:54:12 +08:00
Fangjun Kuang
d5e0408698 Add prepare_lang.py based on prepare_lang.sh 2021-07-20 19:41:21 +08:00
Fangjun Kuang
e005ea062c Minor fixes after review. 2021-07-20 10:02:20 +08:00
Fangjun Kuang
f25eedf2d4 Fixes after review. 2021-07-20 00:14:24 +08:00
Fangjun Kuang
0b19aa09c1 Compute features of librispeech and musan. 2021-07-19 23:35:32 +08:00
Fangjun Kuang
40eed74460 Download LM for LibriSpeech. 2021-07-15 21:09:14 +08:00