10 Commits

Author	SHA1	Message	Date
Daniel Povey	a9a172aa69	Multiply lr by 10; simplify Cain.	2022-06-04 15:48:33 +08:00
Daniel Povey	679972b905	Fix bug; make epsilon work both ways (small+large); increase epsilon to 0.1	2022-06-03 19:37:48 +08:00
Daniel Povey	8085ed6ef9	Turn off natural gradient update for biases.	2022-06-03 18:40:14 +08:00
Daniel Povey	3fff0c75bb	Code cleanup	2022-06-03 11:54:12 +08:00
Daniel Povey	a66a0d84d5	Natural gradient, with power -0.5 (halfway; -1 would be NG)	2022-06-02 14:01:03 +08:00
Daniel Povey	b1f6797af1	Remove some rebalancing code that I am now not going to use.	2022-06-01 22:19:28 +08:00
Daniel Povey	0c73664aef	Reduce threshold to 1024	2022-06-01 14:42:56 +08:00
Daniel Povey	03e07e80ce	More drafts for rebalancing code	2022-06-01 13:58:42 +08:00
Daniel Povey	9c9bf4f1e3	Some drafts of rebalancing code in optim.py	2022-06-01 11:34:19 +08:00
Daniel Povey	741dcd1d6d	Move pruned_transducer_stateless4 to pruned_transducer_stateless7	2022-05-31 12:45:28 +08:00