mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Tweak formula for widths

Browse Source
This commit is contained in:
Daniel Povey 2022-11-10 13:04:56 +08:00
parent 6091146e91
commit fd26b890d2
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
egs/librispeech/ASR/pruned_transducer_stateless7/zipformer.py
View File

@ -1019,7 +1019,7 @@ class RelPositionalEncoding(torch.nn.Module):
centers[:, 1] *= -1.0
centers = centers.reshape(self.embed_dim)
widths = (centers.abs() * width_factor).clamp(min=1.0)
widths = (centers.abs() * width_factor) + 1.0
# shape: (2*T - 1, embed_dim)
pe = ((x - centers) / widths).tanh()