mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-09-19 05:54:20 +00:00
Code Issues Packages Projects Releases Wiki Activity

modify the doc of RelPositionMultiheadAttention

Browse Source
This commit is contained in:
yaozengwei 2022-07-26 22:31:06 +08:00
parent 6fa0ef1e8d
commit 9cf447646d
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
egs/librispeech/ASR/pruned_transducer_stateless7/conformer.py
View File

@ -405,7 +405,7 @@ class RelPositionalEncoding(torch.nn.Module):
class RelPositionMultiheadAttention(nn.Module):
r"""Multi-Head Attention layer with relative position encoding
r"""Multi-Head Attention layer with simplified relative position encoding
See reference: "Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context"