mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Cosmetic fix

Browse Source
This commit is contained in:
Daniel Povey 2023-01-01 21:43:14 +08:00
parent dadeb3feec
commit 977d412690
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
egs/librispeech/ASR/pruned_transducer_stateless7/zipformer.py
View File

@ -1336,7 +1336,7 @@ class AttentionSqueeze(nn.Module):
self.to_bottleneck_proj = nn.Linear(embed_dim, self.to_bottleneck_proj = nn.Linear(embed_dim,
bottleneck_dim) bottleneck_dim)
# bottleneck_balancer is before the actiation. Mostly, for well-trained # bottleneck_balancer is before the activation. Mostly, for well-trained
# instances of this module, the mean absolute values per channel are in # instances of this module, the mean absolute values per channel are in
# the range 0.1 to 0.4. We apply the upper limit of 0.4 at the # the range 0.1 to 0.4. We apply the upper limit of 0.4 at the
# beginning, and make it looser over time. # beginning, and make it looser over time.