mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-09-18 21:44:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

Max eig of Q limited to 5 times the mean

Browse Source
This commit is contained in:
Daniel Povey 2022-07-09 14:30:03 +08:00
parent ffeef4ede4
commit d139c18f22
1 changed files with 8 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
egs/librispeech/ASR/pruned_transducer_stateless7/optim.py
View File

@ -604,8 +604,15 @@ param_rms_smooth1: Smoothing proportion for parameter matrix, if assumed rank of
mean = rms.mean()
rms += eps + smooth * mean
new_mean = (eps + (smooth + 1) * mean)
return rms / new_mean
ans = rms / new_mean
# Apply max_rms
max_rms = 5.0
ans.clamp_(max=max_eig*2)
ans /= ans.mean()
ans.clamp_(max=max_eig)
ans /= ans.mean()
return ans