mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Reduce min_abs on NonlinAttentionModule balancer2 to default from 0.5.

Browse Source
This commit is contained in:
Daniel Povey 2022-12-06 15:32:56 +08:00
parent 8f841e5b2b
commit 51d8e64d66
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
egs/librispeech/ASR/pruned_transducer_stateless7/zipformer.py
View File

@ -1501,7 +1501,6 @@ class NonlinAttentionModule(nn.Module):
self.balancer2 = ActivationBalancer(
hidden_channels // ratio, channel_dim=-1,
min_positive=0.4, max_positive=0.6,
min_abs=0.5,
)
self.whiten = Whiten(num_groups=1,