Daniel Povey
|
262388134d
|
Increase model_warm_step to 4k
|
2022-03-27 11:18:16 +08:00 |
|
Daniel Povey
|
8a8134b9e5
|
Change power of lr-schedule from -0.5 to -0.333
|
2022-03-27 00:31:08 +08:00 |
|
Daniel Povey
|
953aecf5e3
|
Reduce layer-drop prob after warmup to 1 in 100
|
2022-03-27 00:25:32 +08:00 |
|
Daniel Povey
|
b43468bb67
|
Reduce layer-drop prob
|
2022-03-26 19:36:33 +08:00 |
|
Daniel Povey
|
0e694739f2
|
Fix test mode with random layer dropout
|
2022-03-25 23:28:52 +08:00 |
|
Daniel Povey
|
d2ed3dfc90
|
Fix bug
|
2022-03-25 20:35:11 +08:00 |
|
Daniel Povey
|
4b650e9f01
|
Make warmup work by scaling layer contributions; leave residual layer-drop
|
2022-03-25 20:34:33 +08:00 |
|
Daniel Povey
|
1f548548d2
|
Simplify the warmup code; max_abs 10->6
|
2022-03-24 15:06:11 +08:00 |
|
Daniel Povey
|
aab72bc2a5
|
Add changes from master to decode.py, train.py
|
2022-03-24 13:10:54 +08:00 |
|
Daniel Povey
|
5d9dae3064
|
Merge changes from master
|
2022-03-24 12:59:36 +08:00 |
|
Fangjun Kuang
|
395a3f952b
|
Batch decoding for models trained with optimized_transducer (#267)
* Add greedy search in batch mode.
* Add modified beam search in batch mode.
|
2022-03-23 19:11:34 +08:00 |
|
Fangjun Kuang
|
3ae7265737
|
More fixes to the checkpoint code. (#266)
|
2022-03-23 14:37:54 +08:00 |
|
Fangjun Kuang
|
6a091da0b0
|
Minor fixes for saving checkpoints. (#265)
* Minor fixes for saving checkpoints.
* Fix loading checkpoints saved by previous code.
|
2022-03-23 12:22:05 +08:00 |
|
Daniel Povey
|
9a8aa1f54a
|
Change how warmup works.
|
2022-03-22 15:36:20 +08:00 |
|
Fangjun Kuang
|
8c7995d493
|
Support modified beam search in batch mode. (#264)
* Support modified beam search in batch mode.
* Update k2 versions in GitHub CI.
|
2022-03-22 15:14:04 +08:00 |
|
Daniel Povey
|
cef6348703
|
Change max-abs from 6 to 10
|
2022-03-22 13:50:54 +08:00 |
|
Daniel Povey
|
4004ca81d8
|
Increase warm_step (and valid_interval)
|
2022-03-22 13:32:24 +08:00 |
|
Daniel Povey
|
b82a505dfc
|
Reduce initial pruned_loss scale from 0.01 to 0.0
|
2022-03-22 12:30:48 +08:00 |
|
Fangjun Kuang
|
d5c78a2238
|
Implement greedy search in batch mode for transducer decoding. (#262)
|
2022-03-22 10:32:22 +08:00 |
|
Daniel Povey
|
b7e84d5d77
|
Whitespace fix
|
2022-03-21 23:59:53 +08:00 |
|
Daniel Povey
|
2eef001d39
|
Fix balancer code
|
2022-03-21 23:59:26 +08:00 |
|
Daniel Povey
|
11a04c50ae
|
Change 0.025,0.05 to 0.01 in initializations
|
2022-03-21 21:29:24 +08:00 |
|
Daniel Povey
|
05e30d0c46
|
Add max-abs=6, debugged version
|
2022-03-21 21:15:00 +08:00 |
|
Daniel Povey
|
d844655a63
|
Merge remote-tracking branch 'upstream/master' into rework2e_ws30k_16k_0.025_ma6
|
2022-03-21 21:13:25 +08:00 |
|
Daniel Povey
|
ccbf8ba086
|
Incorporate changes from master into pruned_transducer_stateless2.
|
2022-03-21 21:12:43 +08:00 |
|
Wei Kang
|
b2b4d9e0b6
|
Add fast beam search decoding (#250)
* Add fast beam search decoding
* Minor fixes
* Minor fixes
* Minor fixes
* Fix comments
* Fix comments
|
2022-03-21 16:22:25 +08:00 |
|
Daniel Povey
|
05b5e78d8f
|
Add norm+balancer to VggSubsampling
|
2022-03-21 15:55:11 +08:00 |
|
Fangjun Kuang
|
ae564f91e6
|
Periodically saving checkpoint after processing given number of batches (#259)
* Periodically saving checkpoint after processing given number of batches.
|
2022-03-20 23:51:33 +08:00 |
|
Fangjun Kuang
|
910e6c9306
|
Minor fixes to tedlimu3 to make ./prepare.sh working. (#258)
|
2022-03-20 20:26:03 +08:00 |
|
Daniel Povey
|
0ee2404ff0
|
Remove logging code that broke with newer Lhotse; fix bug with pruned_loss
|
2022-03-19 14:01:45 +08:00 |
|
Daniel Povey
|
8cff994cd7
|
Set also scale for embedding to 0.025.
|
2022-03-18 21:30:05 +08:00 |
|
Daniel Povey
|
188eada7ac
|
Change initial std from 0.05 to 0.025.
|
2022-03-18 21:28:34 +08:00 |
|
Daniel Povey
|
c9f1aeb7d1
|
Fix bug with import
|
2022-03-18 16:40:24 +08:00 |
|
Daniel Povey
|
2dfcd8f117
|
Double warm_step
|
2022-03-18 16:38:36 +08:00 |
|
Daniel Povey
|
ba3611cefd
|
Cosmetic changes to swish
|
2022-03-18 16:35:48 +08:00 |
|
Daniel Povey
|
6769087d70
|
Remove scale_speed, make swish deriv more efficient.
|
2022-03-18 16:31:25 +08:00 |
|
Mingshuang Luo
|
ad28c8c5eb
|
Tedlium3 transducer stateless (#233)
* add tedlium3 transducer-stateless
|
2022-03-18 11:39:06 +08:00 |
|
Daniel Povey
|
cbe6b175d1
|
Reduce warmup scale on pruned loss form 0.1 to 0.01.
|
2022-03-17 16:46:59 +08:00 |
|
Daniel Povey
|
acc0eda5b0
|
Scale down pruned loss in warmup mode
|
2022-03-17 16:09:35 +08:00 |
|
Daniel Povey
|
13db33ffa2
|
Fix diagnostics-getting code
|
2022-03-17 15:53:53 +08:00 |
|
Daniel Povey
|
11bea4513e
|
Add remaining files in pruned_transducer_stateless2
|
2022-03-17 11:17:52 +08:00 |
|
Daniel Povey
|
e3ad8f63e7
|
update decode.py file type
|
2022-03-16 22:22:10 +08:00 |
|
Daniel Povey
|
cc8e4412f7
|
Add more files..
|
2022-03-16 22:16:40 +08:00 |
|
Daniel Povey
|
1f3a15f3c4
|
Start adding some files..
|
2022-03-16 22:14:30 +08:00 |
|
Daniel Povey
|
87c92efbfe
|
Changes from upstream/master
|
2022-03-16 21:49:15 +08:00 |
|
Mingshuang Luo
|
518ec6414a
|
Update diagnostics.py (#254)
* update diagnostics.py
* do some changes
|
2022-03-16 20:17:45 +08:00 |
|
Daniel Povey
|
e838c192ef
|
Cosmetic changes/renaming things
|
2022-03-16 19:27:45 +08:00 |
|
Daniel Povey
|
dfc75752c4
|
Remove some dead code.
|
2022-03-16 18:06:01 +08:00 |
|
Daniel Povey
|
c82db4184a
|
Remove xscale from pos_embedding
|
2022-03-16 15:50:11 +08:00 |
|
Daniel Povey
|
6561743d7b
|
bug fix re sqrt
|
2022-03-16 14:55:17 +08:00 |
|