574 Commits

Author SHA1 Message Date
Daniel Povey
c67ae0f3a1 Make 2 projections.. 2022-03-31 13:02:40 +08:00
Daniel Povey
f75d40c725 Replace nn.Linear with ScaledLinear in simple joiner 2022-03-31 12:18:31 +08:00
Daniel Povey
9a0c2e7fee Merge branch 'rework2i' into rework2i_restoredrop 2022-03-31 12:17:02 +08:00
Daniel Povey
f47fe8337a Remove some un-used code 2022-03-31 12:16:08 +08:00
Daniel Povey
0599f38281 Add final dropout to conformer 2022-03-31 11:53:54 +08:00
Daniel Povey
a2aca9f643 Bug-fix 2022-03-30 21:42:15 +08:00
Daniel Povey
f87811e65c Fix RE identity 2022-03-30 21:41:46 +08:00
Daniel Povey
709c387ce6 Initial refactoring to remove unnecessary vocab_size 2022-03-30 21:40:22 +08:00
Daniel Povey
74121ac478 Merge branch 'rework2h_randloader_pow0.333_conv_8' into rework2h_randloader_pow0.333_conv_8_lessdrop_speed
# Conflicts:
#	egs/librispeech/ASR/pruned_transducer_stateless2/conformer.py
2022-03-30 12:24:15 +08:00
Daniel Povey
37ab0bcfa5 Reduce speed of some components 2022-03-30 11:46:23 +08:00
Daniel Povey
7c46c3b0d4 Remove dropout in output layer 2022-03-30 11:20:04 +08:00
Daniel Povey
21a099b110 Fix padding bug 2022-03-30 11:18:04 +08:00
Daniel Povey
ca6337b78a Add another convolutional layer 2022-03-30 11:12:35 +08:00
Daniel Povey
1b8d7defd0 Reduce 1st conv channels from 64 to 32 2022-03-30 00:44:18 +08:00
Daniel Povey
4e453a4bf9 Rework conformer, remove some code. 2022-03-29 23:41:13 +08:00
Daniel Povey
11124b03ea Refactoring and simplifying conformer and frontend 2022-03-29 20:32:14 +08:00
Daniel Povey
57f943b25c Merge branch 'rework2h_randloader' into rework2h_pow0.333 2022-03-29 19:05:39 +08:00
Daniel Povey
2cde99509f Change max-keep-prob to 0.95 2022-03-27 23:21:42 +08:00
Daniel Povey
262388134d Increase model_warm_step to 4k 2022-03-27 11:18:16 +08:00
Daniel Povey
8a8134b9e5 Change power of lr-schedule from -0.5 to -0.333 2022-03-27 00:31:08 +08:00
Daniel Povey
953aecf5e3 Reduce layer-drop prob after warmup to 1 in 100 2022-03-27 00:25:32 +08:00
Daniel Povey
b43468bb67 Reduce layer-drop prob 2022-03-26 19:36:33 +08:00
Daniel Povey
8a38d9a855 Fix/patch how fix_random_seed() is imported. 2022-03-26 15:43:47 +08:00
Daniel Povey
26a1730392 Add random-number-setting function in dataloader 2022-03-26 14:53:23 +08:00
Daniel Povey
0e694739f2 Fix test mode with random layer dropout 2022-03-25 23:28:52 +08:00
Daniel Povey
d2ed3dfc90 Fix bug 2022-03-25 20:35:11 +08:00
Daniel Povey
4b650e9f01 Make warmup work by scaling layer contributions; leave residual layer-drop 2022-03-25 20:34:33 +08:00
Daniel Povey
1f548548d2 Simplify the warmup code; max_abs 10->6 2022-03-24 15:06:11 +08:00
Daniel Povey
aab72bc2a5 Add changes from master to decode.py, train.py 2022-03-24 13:10:54 +08:00
Daniel Povey
5d9dae3064 Merge changes from master 2022-03-24 12:59:36 +08:00
Fangjun Kuang
395a3f952b
Batch decoding for models trained with optimized_transducer (#267)
* Add greedy search in batch mode.
* Add modified beam search in batch mode.
2022-03-23 19:11:34 +08:00
Fangjun Kuang
3ae7265737
More fixes to the checkpoint code. (#266) 2022-03-23 14:37:54 +08:00
Fangjun Kuang
6a091da0b0
Minor fixes for saving checkpoints. (#265)
* Minor fixes for saving checkpoints.

* Fix loading checkpoints saved by previous code.
2022-03-23 12:22:05 +08:00
Daniel Povey
9a8aa1f54a Change how warmup works. 2022-03-22 15:36:20 +08:00
Fangjun Kuang
8c7995d493
Support modified beam search in batch mode. (#264)
* Support modified beam search in batch mode.
* Update k2 versions in GitHub CI.
2022-03-22 15:14:04 +08:00
Daniel Povey
cef6348703 Change max-abs from 6 to 10 2022-03-22 13:50:54 +08:00
Daniel Povey
4004ca81d8 Increase warm_step (and valid_interval) 2022-03-22 13:32:24 +08:00
Daniel Povey
b82a505dfc Reduce initial pruned_loss scale from 0.01 to 0.0 2022-03-22 12:30:48 +08:00
Fangjun Kuang
d5c78a2238
Implement greedy search in batch mode for transducer decoding. (#262) 2022-03-22 10:32:22 +08:00
Daniel Povey
b7e84d5d77 Whitespace fix 2022-03-21 23:59:53 +08:00
Daniel Povey
2eef001d39 Fix balancer code 2022-03-21 23:59:26 +08:00
Daniel Povey
11a04c50ae Change 0.025,0.05 to 0.01 in initializations 2022-03-21 21:29:24 +08:00
Daniel Povey
05e30d0c46 Add max-abs=6, debugged version 2022-03-21 21:15:00 +08:00
Daniel Povey
d844655a63 Merge remote-tracking branch 'upstream/master' into rework2e_ws30k_16k_0.025_ma6 2022-03-21 21:13:25 +08:00
Daniel Povey
ccbf8ba086 Incorporate changes from master into pruned_transducer_stateless2. 2022-03-21 21:12:43 +08:00
Wei Kang
b2b4d9e0b6
Add fast beam search decoding (#250)
* Add fast beam search decoding

* Minor fixes

* Minor fixes

* Minor fixes

* Fix comments

* Fix comments
2022-03-21 16:22:25 +08:00
Daniel Povey
05b5e78d8f Add norm+balancer to VggSubsampling 2022-03-21 15:55:11 +08:00
Fangjun Kuang
ae564f91e6
Periodically saving checkpoint after processing given number of batches (#259)
* Periodically saving checkpoint after processing given number of batches.
2022-03-20 23:51:33 +08:00
Daniel Povey
0ee2404ff0 Remove logging code that broke with newer Lhotse; fix bug with pruned_loss 2022-03-19 14:01:45 +08:00
Daniel Povey
8cff994cd7 Set also scale for embedding to 0.025. 2022-03-18 21:30:05 +08:00