mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-09-09 00:54:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

Reduce scale on bias from 4 to 2

Browse Source
This commit is contained in:
Daniel Povey 2022-05-21 20:07:41 +08:00
parent dcab1aee4e
commit cbdddbe670
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
egs/librispeech/ASR/pruned_transducer_stateless2/scaling.py
View File

@ -179,7 +179,7 @@ class ScaledLinear(nn.Linear):
with torch.no_grad(): with torch.no_grad():
self.weight[:] *= initial_scale self.weight[:] *= initial_scale
if self.bias is not None: if self.bias is not None:
self.bias[:] *= initial_scale * 4.0 self.bias[:] *= 2.0 * initial_scale
def get_weight(self): # not needed any more but kept for back compatibility def get_weight(self): # not needed any more but kept for back compatibility
return self.weight return self.weight