Daniel Povey
|
146d7c5a93
|
Bug fix
|
2022-06-24 19:49:13 +08:00 |
|
Daniel Povey
|
117d348f70
|
This time get it right, last time was starting from wrong base.
|
2022-06-24 19:00:58 +08:00 |
|
Daniel Povey
|
6002e19836
|
Change max_fullcov_size back to 1023.. doing it this way because I forgot to commit the changes on this branch
|
2022-06-24 18:59:34 +08:00 |
|
Daniel Povey
|
c2ec901e73
|
Change param_pow from 0.75 to 0.5
|
2022-06-24 17:14:41 +08:00 |
|
Daniel Povey
|
f327407308
|
Avoid error if svd fails
|
2022-06-24 13:20:20 +08:00 |
|
Daniel Povey
|
2233c852fd
|
Increase max_fullcov_size from 1023 to 2048
|
2022-06-24 13:02:17 +08:00 |
|
Daniel Povey
|
683b8e1504
|
Some code reworking and fixes, rationalizing how speedup is done and fix an issue affecting learning rate.
|
2022-06-23 15:40:51 +08:00 |
|
Daniel Povey
|
c34344e98f
|
Change param_pow,grad_pow to 0.75,0.95
|
2022-06-23 14:04:11 +08:00 |
|
Daniel Povey
|
3767f3d616
|
Reducd param_pow from 0.8 to 0.7
|
2022-06-23 11:12:12 +08:00 |
|
Daniel Povey
|
ca17f23da3
|
Reduce powers to 0.8,0.85
|
2022-06-23 11:09:27 +08:00 |
|
Daniel Povey
|
09282ca28c
|
Reduce some print statements, convert some to info
|
2022-06-23 10:41:08 +08:00 |
|
Daniel Povey
|
7f756b2910
|
Introduce grad_pow option, set it to 0.9 and param_pow to 0.85
|
2022-06-23 10:33:14 +08:00 |
|
Daniel Povey
|
4124cd7241
|
Reduce debug frequencies
|
2022-06-20 13:48:42 +08:00 |
|
Daniel Povey
|
c10a9889fa
|
Reduce grad_eps to 1e-14
|
2022-06-20 13:45:53 +08:00 |
|
Daniel Povey
|
b560221eea
|
Change param_pow to 0.75
|
2022-06-20 00:29:07 +08:00 |
|
Daniel Povey
|
cf816a9138
|
Change param_pow to 0.0
|
2022-06-19 22:44:17 +08:00 |
|
Daniel Povey
|
ad5337fe95
|
Set param_pow to 0.5
|
2022-06-19 22:14:34 +08:00 |
|
Daniel Povey
|
8acc398428
|
Reduce debug freq
|
2022-06-19 11:21:48 +08:00 |
|
Daniel Povey
|
29dfe37f22
|
Implement min,max param rms
|
2022-06-18 22:22:23 +08:00 |
|
Daniel Povey
|
3fb3cc4e23
|
Make random cov have correct diagonal; reset grad_min_rand to 0.
|
2022-06-18 17:04:44 +08:00 |
|
Daniel Povey
|
3f0b57403e
|
Min-rand-scale 0.2 for grad cov
|
2022-06-18 16:26:37 +08:00 |
|
Daniel Povey
|
e996f7f371
|
First version I am running, of the speedup code
|
2022-06-18 15:17:51 +08:00 |
|
Daniel Povey
|
a6bf32c3e0
|
Fast code seems to pass tests.
|
2022-06-18 12:56:16 +08:00 |
|
Daniel Povey
|
ea5cd69e3b
|
Possibly fix bug RE learning rate
|
2022-06-17 20:50:00 +08:00 |
|
Daniel Povey
|
cbccc1dd91
|
Fix bias_correction2, power of 0.5
|
2022-06-17 20:20:16 +08:00 |
|
Daniel Povey
|
2d13b682fe
|
Revert param_rel_eps to old value
|
2022-06-17 18:22:27 +08:00 |
|
Daniel Povey
|
92fb1c52c8
|
Reduce debug statement frequency
|
2022-06-17 16:03:50 +08:00 |
|
Daniel Povey
|
d9a3eba370
|
Fix bug that caused it to use too much memory
|
2022-06-17 16:02:47 +08:00 |
|
Daniel Povey
|
6873aa1a13
|
Bug fix to print statement
|
2022-06-17 15:35:07 +08:00 |
|
Daniel Povey
|
90622f88ad
|
Decrease param_rel_eps default from 1e-4 to 1e-2
|
2022-06-17 15:10:46 +08:00 |
|
Daniel Povey
|
7f0756e156
|
Implement structured version of conformer
|
2022-06-17 15:10:21 +08:00 |
|
Daniel Povey
|
2fe4af8c99
|
Prevent crash due to error in C_diff
|
2022-06-17 12:35:55 +08:00 |
|
Daniel Povey
|
6c499dcd66
|
Augment debug output
|
2022-06-17 12:32:09 +08:00 |
|
Daniel Povey
|
5c3e4f506f
|
Reduce debug frequency
|
2022-06-17 12:17:48 +08:00 |
|
Daniel Povey
|
47df144253
|
Bug fix for scalar case
|
2022-06-17 12:16:12 +08:00 |
|
Daniel Povey
|
9e92d13a33
|
Some bug fixes.. seems to be working.
|
2022-06-17 12:04:21 +08:00 |
|
Daniel Povey
|
827a37c7fc
|
Closer to finished
|
2022-06-17 11:10:43 +08:00 |
|
Daniel Povey
|
94e48ff07e
|
Some code improvements...
|
2022-06-16 10:43:26 +08:00 |
|
Daniel Povey
|
f9bb745cf3
|
Use exp_avg_sq as ref_exp_avg_sq
|
2022-06-15 14:03:26 +08:00 |
|
Daniel Povey
|
860322bf30
|
Make it less verbose; fix scale_speed setting; testing min_diag_smooth=1.0 for debug
|
2022-06-15 13:02:04 +08:00 |
|
Daniel Povey
|
bc5d72b0f3
|
Fix potential bug re scale change
|
2022-06-15 12:49:47 +08:00 |
|
Daniel Povey
|
57957cc049
|
Add diagnostics
|
2022-06-15 12:39:16 +08:00 |
|
Daniel Povey
|
0679b363b0
|
Some debug stuff, modify cond_eps for param_cov
|
2022-06-14 22:38:51 +08:00 |
|
Daniel Povey
|
932cedce59
|
Bug fix RE eps*eps; add/tune diagnostics
|
2022-06-14 21:43:27 +08:00 |
|
Daniel Povey
|
2615e48779
|
Some cleanup and configuration changes.
|
2022-06-14 21:17:50 +08:00 |
|
Daniel Povey
|
c6f62dfc08
|
Version that is passing the tests
|
2022-06-14 20:45:57 +08:00 |
|
Daniel Povey
|
e597b68160
|
Improve roundoff properties of algorithm for getting C, use randomized testing.
|
2022-06-14 12:59:41 +08:00 |
|
Daniel Povey
|
d729e970e1
|
Some changes for stability
|
2022-06-14 10:25:17 +08:00 |
|
Daniel Povey
|
d1e96afce2
|
Improve speed by messing with configuration, removing asserts.
|
2022-06-13 17:27:34 +08:00 |
|
Daniel Povey
|
a41c4b6c9b
|
Bug fixes
|
2022-06-13 17:20:46 +08:00 |
|