mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Make norm_final apply to delta, not src

Browse Source
This commit is contained in:
Daniel Povey 2022-12-24 18:44:42 +08:00
parent 2b50ce2247
commit 43f2a8d50b
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
egs/librispeech/ASR/pruned_transducer_stateless7/zipformer.py
View File

@ -573,9 +573,8 @@ class ZipformerEncoderLayer(nn.Module):
src = src + self.feed_forward2(src)
src = self.balancer(src)
src = self.norm_final(src)
delta = src - src_orig
delta = self.norm_final(src - src_orig)
src = src_orig + delta * self.get_bypass_scale(src.shape[1])
src = self.whiten(src)