Reduce param_pow from 0.5 to 0.4.

This commit is contained in:
Daniel Povey 2022-07-17 15:35:07 +08:00
parent 3857a87b47
commit 198cf2635c

View File

@ -143,7 +143,7 @@ param_rms_smooth1: Smoothing proportion for parameter matrix, if assumed rank of
lr=3e-02, lr=3e-02,
betas=(0.9, 0.98), betas=(0.9, 0.98),
size_lr_scale=0.1, size_lr_scale=0.1,
param_pow=0.5, param_pow=0.4,
param_rms_smooth0=0.75, param_rms_smooth0=0.75,
param_rms_smooth1=0.25, param_rms_smooth1=0.25,
param_cov_freshness=1.0, param_cov_freshness=1.0,