mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Make layer-skip-dropout-prob decrease to 0.0

Browse Source
This commit is contained in:
Daniel Povey 2023-02-20 16:33:04 +08:00
parent e0b8a0cfd0
commit 90180ce5e7
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
egs/librispeech/ASR/pruned_transducer_stateless7/zipformer.py
View File

@ -142,7 +142,8 @@ class Zipformer(EncoderInterface):
# encoder stacks; when it's dropped out like this, it means we are forced
# to take the "direct" (non-bypass) path.
self.layer_skip_dropout_prob = ScheduledFloat((0.0, 0.5),
(warmup_batches, 0.025))
(warmup_batches, 0.025),
(20000.0, 0.0))
def _to_tuple(x):
""" Converts a single int or a 1-tuple of an int to a tuple with the same length