Daniel Povey
117d348f70
This time get it right, last time was starting from wrong base.
2022-06-24 19:00:58 +08:00
Daniel Povey
6002e19836
Change max_fullcov_size back to 1023.. doing it this way because I forgot to commit the changes on this branch
2022-06-24 18:59:34 +08:00
Daniel Povey
c2ec901e73
Change param_pow from 0.75 to 0.5
2022-06-24 17:14:41 +08:00
Daniel Povey
f327407308
Avoid error if svd fails
2022-06-24 13:20:20 +08:00
Daniel Povey
2233c852fd
Increase max_fullcov_size from 1023 to 2048
2022-06-24 13:02:17 +08:00
Mingshuang Luo
c391bfd100
fix errors for soft connection ( #443 )
2022-06-24 10:40:46 +08:00
ezerhouni
0475d75d15
[Ready to be merged] Add RNN-LM to Conformer-CTC decoding ( #439 )
2022-06-23 19:37:03 +08:00
Daniel Povey
683b8e1504
Some code reworking and fixes, rationalizing how speedup is done and fix an issue affecting learning rate.
2022-06-23 15:40:51 +08:00
Daniel Povey
c34344e98f
Change param_pow,grad_pow to 0.75,0.95
2022-06-23 14:04:11 +08:00
Daniel Povey
3767f3d616
Reducd param_pow from 0.8 to 0.7
2022-06-23 11:12:12 +08:00
Daniel Povey
ca17f23da3
Reduce powers to 0.8,0.85
2022-06-23 11:09:27 +08:00
Daniel Povey
09282ca28c
Reduce some print statements, convert some to info
2022-06-23 10:41:08 +08:00
Daniel Povey
7f756b2910
Introduce grad_pow option, set it to 0.9 and param_pow to 0.85
2022-06-23 10:33:14 +08:00
Fangjun Kuang
dc89b61b80
Add fast_beam_search_nbest. ( #420 )
...
* Add fast_beam_search_nbest.
* Fix CI errors.
* Fix CI errors.
* More fixes.
* Small fixes.
* Support using log_add in LG decoding with fast_beam_search.
* Support LG decoding in pruned_transducer_stateless
* Support LG for pruned_transducer_stateless2.
* Support LG for fast beam search.
* Minor fixes.
2022-06-22 00:09:25 +08:00
Fangjun Kuang
7100c33820
Add pruned RNN-T for aishell. ( #436 )
...
* Add pruned RNN-T for aishell.
* support torch script.
* Update CI.
* Minor fixes.
* Add links to sherpa.
2022-06-21 21:17:22 +08:00
Zengwei Yao
d3daeaf5cd
Upload extracted codebook indexes ( #429 )
...
* save only vq-related info to manifest
* support to join manifest files
* support using extracted codebook indexes
* fix doc
* minor fix
* add enable-distillation argument option, fix monir typos
* fix style
* fix typo
2022-06-21 19:16:59 +08:00
2xwwx2
91b2765cfd
Fixs spelling mistake ( #438 )
2022-06-20 16:41:04 +08:00
Mingshuang Luo
998091ef52
do some changes for export.py ( #437 )
2022-06-20 14:57:08 +08:00
Daniel Povey
4124cd7241
Reduce debug frequencies
2022-06-20 13:48:42 +08:00
Daniel Povey
c10a9889fa
Reduce grad_eps to 1e-14
2022-06-20 13:45:53 +08:00
Zengwei Yao
a42d96dfe0
Fix warmup ( #435 )
...
* fix warmup when scan_pessimistic_batches_for_oom
* delete comments
2022-06-20 13:40:01 +08:00
Daniel Povey
b560221eea
Change param_pow to 0.75
2022-06-20 00:29:07 +08:00
Daniel Povey
cf816a9138
Change param_pow to 0.0
2022-06-19 22:44:17 +08:00
Daniel Povey
ad5337fe95
Set param_pow to 0.5
2022-06-19 22:14:34 +08:00
Daniel Povey
8acc398428
Reduce debug freq
2022-06-19 11:21:48 +08:00
Daniel Povey
29dfe37f22
Implement min,max param rms
2022-06-18 22:22:23 +08:00
yaozengwei
74c14f5f5d
Merge remote-tracking branch 'k2-fsa/master'
2022-06-18 17:48:51 +08:00
Daniel Povey
3fb3cc4e23
Make random cov have correct diagonal; reset grad_min_rand to 0.
2022-06-18 17:04:44 +08:00
Daniel Povey
3f0b57403e
Min-rand-scale 0.2 for grad cov
2022-06-18 16:26:37 +08:00
Daniel Povey
e996f7f371
First version I am running, of the speedup code
2022-06-18 15:17:51 +08:00
Daniel Povey
a6bf32c3e0
Fast code seems to pass tests.
2022-06-18 12:56:16 +08:00
Fangjun Kuang
ab788980c9
Fix an error introduced by supporting torchscript for torch 1.6.0 ( #434 )
2022-06-18 08:57:20 +08:00
Fangjun Kuang
d53f69108f
Support torch 1.6.0 ( #433 )
2022-06-17 22:24:47 +08:00
Daniel Povey
ea5cd69e3b
Possibly fix bug RE learning rate
2022-06-17 20:50:00 +08:00
Daniel Povey
cbccc1dd91
Fix bias_correction2, power of 0.5
2022-06-17 20:20:16 +08:00
Daniel Povey
2d13b682fe
Revert param_rel_eps to old value
2022-06-17 18:22:27 +08:00
Daniel Povey
92fb1c52c8
Reduce debug statement frequency
2022-06-17 16:03:50 +08:00
Daniel Povey
d9a3eba370
Fix bug that caused it to use too much memory
2022-06-17 16:02:47 +08:00
Daniel Povey
6873aa1a13
Bug fix to print statement
2022-06-17 15:35:07 +08:00
Daniel Povey
90622f88ad
Decrease param_rel_eps default from 1e-4 to 1e-2
2022-06-17 15:10:46 +08:00
Daniel Povey
7f0756e156
Implement structured version of conformer
2022-06-17 15:10:21 +08:00
Daniel Povey
2fe4af8c99
Prevent crash due to error in C_diff
2022-06-17 12:35:55 +08:00
Daniel Povey
6c499dcd66
Augment debug output
2022-06-17 12:32:09 +08:00
Daniel Povey
5c3e4f506f
Reduce debug frequency
2022-06-17 12:17:48 +08:00
Daniel Povey
47df144253
Bug fix for scalar case
2022-06-17 12:16:12 +08:00
Daniel Povey
9e92d13a33
Some bug fixes.. seems to be working.
2022-06-17 12:04:21 +08:00
Daniel Povey
827a37c7fc
Closer to finished
2022-06-17 11:10:43 +08:00
Wei Kang
5379c8e9fa
Disable drop_last in testing time ( #427 )
2022-06-16 15:43:48 +08:00
Daniel Povey
94e48ff07e
Some code improvements...
2022-06-16 10:43:26 +08:00
Daniel Povey
f9bb745cf3
Use exp_avg_sq as ref_exp_avg_sq
2022-06-15 14:03:26 +08:00
