Reduce param_pow from 0.75 to 0.5

This commit is contained in:
Daniel Povey 2022-07-14 06:08:06 +08:00
parent 7f6fe02db9
commit 689441b237

View File

@ -139,7 +139,7 @@ param_rms_smooth1: Smoothing proportion for parameter matrix, if assumed rank of
lr=3e-02,
betas=(0.9, 0.98),
size_lr_scale=0.1,
param_pow=0.75,
param_pow=0.5,
param_rms_smooth0=0.75,
param_rms_smooth1=0.25,
param_cov_freshness=1.0,