64 Commits

Author SHA1 Message Date
Daniel Povey
8a0277d493 Increase param_reverse_cutoff from 4 to 16 2022-06-25 18:02:00 +08:00
Daniel Povey
2ccc7ccbeb Make the application of param_reverse_cutoff conditional, not applied when rank is a problem 2022-06-25 17:56:04 +08:00
Daniel Povey
146d7c5a93 Bug fix 2022-06-24 19:49:13 +08:00
Daniel Povey
117d348f70 This time get it right, last time was starting from wrong base. 2022-06-24 19:00:58 +08:00
Daniel Povey
6002e19836 Change max_fullcov_size back to 1023.. doing it this way because I forgot to commit the changes on this branch 2022-06-24 18:59:34 +08:00
Daniel Povey
c2ec901e73 Change param_pow from 0.75 to 0.5 2022-06-24 17:14:41 +08:00
Daniel Povey
f327407308 Avoid error if svd fails 2022-06-24 13:20:20 +08:00
Daniel Povey
2233c852fd Increase max_fullcov_size from 1023 to 2048 2022-06-24 13:02:17 +08:00
Daniel Povey
683b8e1504 Some code reworking and fixes, rationalizing how speedup is done and fix an issue affecting learning rate. 2022-06-23 15:40:51 +08:00
Daniel Povey
c34344e98f Change param_pow,grad_pow to 0.75,0.95 2022-06-23 14:04:11 +08:00
Daniel Povey
3767f3d616 Reducd param_pow from 0.8 to 0.7 2022-06-23 11:12:12 +08:00
Daniel Povey
ca17f23da3 Reduce powers to 0.8,0.85 2022-06-23 11:09:27 +08:00
Daniel Povey
09282ca28c Reduce some print statements, convert some to info 2022-06-23 10:41:08 +08:00
Daniel Povey
7f756b2910 Introduce grad_pow option, set it to 0.9 and param_pow to 0.85 2022-06-23 10:33:14 +08:00
Daniel Povey
4124cd7241 Reduce debug frequencies 2022-06-20 13:48:42 +08:00
Daniel Povey
c10a9889fa Reduce grad_eps to 1e-14 2022-06-20 13:45:53 +08:00
Daniel Povey
b560221eea Change param_pow to 0.75 2022-06-20 00:29:07 +08:00
Daniel Povey
cf816a9138 Change param_pow to 0.0 2022-06-19 22:44:17 +08:00
Daniel Povey
ad5337fe95 Set param_pow to 0.5 2022-06-19 22:14:34 +08:00
Daniel Povey
8acc398428 Reduce debug freq 2022-06-19 11:21:48 +08:00
Daniel Povey
29dfe37f22 Implement min,max param rms 2022-06-18 22:22:23 +08:00
Daniel Povey
3fb3cc4e23 Make random cov have correct diagonal; reset grad_min_rand to 0. 2022-06-18 17:04:44 +08:00
Daniel Povey
3f0b57403e Min-rand-scale 0.2 for grad cov 2022-06-18 16:26:37 +08:00
Daniel Povey
e996f7f371 First version I am running, of the speedup code 2022-06-18 15:17:51 +08:00
Daniel Povey
a6bf32c3e0 Fast code seems to pass tests. 2022-06-18 12:56:16 +08:00
Daniel Povey
cbccc1dd91 Fix bias_correction2, power of 0.5 2022-06-17 20:20:16 +08:00
Daniel Povey
2d13b682fe Revert param_rel_eps to old value 2022-06-17 18:22:27 +08:00
Daniel Povey
92fb1c52c8 Reduce debug statement frequency 2022-06-17 16:03:50 +08:00
Daniel Povey
d9a3eba370 Fix bug that caused it to use too much memory 2022-06-17 16:02:47 +08:00
Daniel Povey
6873aa1a13 Bug fix to print statement 2022-06-17 15:35:07 +08:00
Daniel Povey
90622f88ad Decrease param_rel_eps default from 1e-4 to 1e-2 2022-06-17 15:10:46 +08:00
Daniel Povey
2fe4af8c99 Prevent crash due to error in C_diff 2022-06-17 12:35:55 +08:00
Daniel Povey
6c499dcd66 Augment debug output 2022-06-17 12:32:09 +08:00
Daniel Povey
5c3e4f506f Reduce debug frequency 2022-06-17 12:17:48 +08:00
Daniel Povey
47df144253 Bug fix for scalar case 2022-06-17 12:16:12 +08:00
Daniel Povey
9e92d13a33 Some bug fixes.. seems to be working. 2022-06-17 12:04:21 +08:00
Daniel Povey
827a37c7fc Closer to finished 2022-06-17 11:10:43 +08:00
Daniel Povey
94e48ff07e Some code improvements... 2022-06-16 10:43:26 +08:00
Daniel Povey
f9bb745cf3 Use exp_avg_sq as ref_exp_avg_sq 2022-06-15 14:03:26 +08:00
Daniel Povey
860322bf30 Make it less verbose; fix scale_speed setting; testing min_diag_smooth=1.0 for debug 2022-06-15 13:02:04 +08:00
Daniel Povey
bc5d72b0f3 Fix potential bug re scale change 2022-06-15 12:49:47 +08:00
Daniel Povey
57957cc049 Add diagnostics 2022-06-15 12:39:16 +08:00
Daniel Povey
0679b363b0 Some debug stuff, modify cond_eps for param_cov 2022-06-14 22:38:51 +08:00
Daniel Povey
932cedce59 Bug fix RE eps*eps; add/tune diagnostics 2022-06-14 21:43:27 +08:00
Daniel Povey
2615e48779 Some cleanup and configuration changes. 2022-06-14 21:17:50 +08:00
Daniel Povey
c6f62dfc08 Version that is passing the tests 2022-06-14 20:45:57 +08:00
Daniel Povey
e597b68160 Improve roundoff properties of algorithm for getting C, use randomized testing. 2022-06-14 12:59:41 +08:00
Daniel Povey
d729e970e1 Some changes for stability 2022-06-14 10:25:17 +08:00
Daniel Povey
d1e96afce2 Improve speed by messing with configuration, removing asserts. 2022-06-13 17:27:34 +08:00
Daniel Povey
a41c4b6c9b Bug fixes 2022-06-13 17:20:46 +08:00