11 Commits

Author	SHA1	Message	Date
Daniel Povey	e1182da6ac	Restoring min_abs and max_abs defaults for the linear_pos proj.	2022-07-31 05:07:50 +08:00
Daniel Povey	3857a87b47	Merge branch 'merge_refactor_param_cov_norank1_iter_batch_max4.0_pow0.5_fix2r_lrupdate200_2k_ns' into merge2_refactor_max4.0_pow0.5_200_1k_ma3.0	2022-07-17 15:32:43 +08:00
Daniel Povey	f36ebad618	Remove 2/3 StructuredLinear/StructuredConv1d modules, use linear/conv1d	2022-07-17 06:40:19 +08:00
Daniel Povey	de1fd91435	Adding max_abs=3.0 to ActivationBalancer modules inside feedoforward modules.	2022-07-16 07:19:26 +08:00
Daniel Povey	7f0756e156	Implement structured version of conformer	2022-06-17 15:10:21 +08:00
Daniel Povey	7338c60296	Remove Decorrelate()	2022-06-13 16:07:15 +08:00
Daniel Povey	d301f8ac6c	Merge Decorrelate work, and simplification to RandomCombine, into pruned_transducer_stateless7	2022-06-11 11:07:07 +08:00
Daniel Povey	bc5c782294	Limit magnitude of linear_pos	2022-06-01 10:40:54 +08:00
Daniel Povey	61619c031e	Add activation balancer to stop activations in self_attn from getting too large	2022-06-01 00:40:45 +08:00
Daniel Povey	1651fe0d42	Merge changes from pruned_transducer_stateless4->5	2022-05-31 13:00:11 +08:00
Daniel Povey	741dcd1d6d	Move pruned_transducer_stateless4 to pruned_transducer_stateless7	2022-05-31 12:45:28 +08:00