21 Commits

Author	SHA1	Message	Date
Daniel Povey	15b91c12d6	Reduce stats period from 10 to 4.	2022-10-14 15:14:06 +08:00
Daniel Povey	23d6bf7765	Fix bug when channel_dim < 0	2022-10-13 13:52:28 +08:00
Daniel Povey	49c6b6943d	Change scale_factor_scale from 0.5 to 0.8	2022-10-12 20:55:52 +08:00
Daniel Povey	b736bb4840	Cosmetic improvements	2022-10-12 19:34:48 +08:00
Daniel Povey	12323025d7	Make ActivationBalancer and MaxEig more efficient.	2022-10-12 18:44:52 +08:00
Daniel Povey	d7f6e8eb51	Only apply ActivationBalancer with prob 0.25.	2022-10-10 00:26:31 +08:00
Daniel Povey	00841f0f49	Remove unused code LearnedScale.	2022-10-09 16:07:31 +08:00
Daniel Povey	3e137dda5b	Decrease frequency of logging variance_proportion	2022-10-09 12:05:52 +08:00
Daniel Povey	93dff29243	Introduce a scale dependent on the masking value	2022-10-03 14:34:37 +08:00
Daniel Povey	76e66408c5	Some cosmetic improvements	2022-09-27 11:08:44 +08:00
Daniel Povey	ceadfad48d	Reduce debug freq	2022-09-22 12:30:49 +08:00
Daniel Povey	db1f4ccdd1	4x scale on max-eig constraint	2022-09-20 14:20:13 +08:00
Daniel Povey	3d72a65de8	Implement max-eig-proportion..	2022-09-19 10:26:37 +08:00
Daniel Povey	0f567e27a5	Add max_var_per_eig in self-attn	2022-09-18 21:22:01 +08:00
Daniel Povey	4a2b940321	Remove StructuredLinear,StructuredConv1d	2022-09-17 13:14:08 +08:00
Daniel Povey	1a184596b6	A little code refactoring	2022-09-16 20:56:21 +08:00
Daniel Povey	9d7af4be20	Modify scaling.py to prevent constant values	2022-07-29 09:34:13 +08:00
Daniel Povey	7f0756e156	Implement structured version of conformer	2022-06-17 15:10:21 +08:00
Daniel Povey	ca7cffcb42	Remove Decorrelate() class	2022-06-13 16:08:32 +08:00
Daniel Povey	d301f8ac6c	Merge Decorrelate work, and simplification to RandomCombine, into pruned_transducer_stateless7	2022-06-11 11:07:07 +08:00
Daniel Povey	741dcd1d6d	Move pruned_transducer_stateless4 to pruned_transducer_stateless7	2022-05-31 12:45:28 +08:00