17 Commits

Author SHA1 Message Date
Fangjun Kuang
2f1e23cde1
Narrower and deeper conformer (#330)
* Copy files for editing.

* Add random combine from #229.

* Minor fixes.

* Pass model parameters from the command line.

* Fix warnings.

* Fix warnings.

* Update readme.

* Rename to avoid conflicts.

* Update results.

* Add CI for pruned_transducer_stateless5

* Typo fixes.

* Remove random combiner.

* Update decode.py and train.py to use periodically averaged models.

* Minor fixes.

* Revert to use random combiner.

* Update results.

* Minor fixes.
2022-05-23 14:39:11 +08:00
Mingshuang Luo
93c60a9d30
Code style check for librispeech pruned transducer stateless2 (#308) 2022-04-11 22:15:18 +08:00
Wei Kang
7012fd65b5
Support mix precision training on the reworked model (#305)
* Add mix precision support

* Minor fixes

* Minor fixes

* Minor fixes
2022-04-11 16:49:54 +08:00
Daniel Povey
a5bbcd7b71 Make training more efficient, avoid redoing some projections. 2022-04-04 14:14:03 +08:00
Daniel Povey
807fcada68 Change learning speed of simple_lm_proj 2022-04-02 20:15:11 +08:00
Daniel Povey
8be10d3d6c First draft of model rework 2022-04-02 20:03:21 +08:00
Daniel Povey
49bc761ba1 Merge branch 'rework2i_restoredrop_scaled_warmup' into rework2i_restoredrop_scaled_warmup_2proj
# Conflicts:
#	egs/librispeech/ASR/pruned_transducer_stateless2/model.py
2022-03-31 14:45:55 +08:00
Daniel Povey
e663713258 Change how warmup is applied. 2022-03-31 14:43:49 +08:00
Daniel Povey
fcb0dba2cf Reduce initial_speed from 0.5 to 0.25 2022-03-31 13:47:28 +08:00
Daniel Povey
025d690995 Reduce initial_speed further from 0.5 to 0.25 2022-03-31 13:39:56 +08:00
Daniel Povey
ec54fa85cc Use initial_speed=0.5 2022-03-31 13:04:09 +08:00
Daniel Povey
e59db01b7c Reduce initial_speed 2022-03-31 13:03:26 +08:00
Daniel Povey
c67ae0f3a1 Make 2 projections.. 2022-03-31 13:02:40 +08:00
Daniel Povey
f75d40c725 Replace nn.Linear with ScaledLinear in simple joiner 2022-03-31 12:18:31 +08:00
Daniel Povey
709c387ce6 Initial refactoring to remove unnecessary vocab_size 2022-03-30 21:40:22 +08:00
Daniel Povey
9a8aa1f54a Change how warmup works. 2022-03-22 15:36:20 +08:00
Daniel Povey
11bea4513e Add remaining files in pruned_transducer_stateless2 2022-03-17 11:17:52 +08:00