mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Double limit of penalize_abs_values_gt in AttentionDownsample from 10 to 20.

Browse Source
This commit is contained in:
Daniel Povey 2022-12-09 21:00:24 +08:00
parent 6e598cb18d
commit 958d9b929d
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
egs/librispeech/ASR/pruned_transducer_stateless7/zipformer.py
View File

@ -829,7 +829,7 @@ class AttentionDownsample(torch.nn.Module):
scores = (src * self.query).sum(dim=-1, keepdim=True) scores = (src * self.query).sum(dim=-1, keepdim=True)
scores = penalize_abs_values_gt(scores, scores = penalize_abs_values_gt(scores,
limit=10.0, limit=20.0,
penalty=1.0e-04) penalty=1.0e-04)
weights = scores.softmax(dim=1) weights = scores.softmax(dim=1)