mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Revert "Increase layerdrop_prob of ConvNeXt, and make it warm up faster."

Browse Source 
This reverts commit 111a0aa3c73618eee7986291780383f166aac85d.
This commit is contained in:
Daniel Povey 2022-12-18 14:31:59 +08:00
parent f439399ced
commit c7d15dacc6
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
egs/librispeech/ASR/pruned_transducer_stateless7/zipformer.py
View File

@ -1680,7 +1680,7 @@ class ConvNeXt(nn.Module):
pad = (kernel_size - 1) // 2
hidden_channels = channels * hidden_ratio
if layerdrop_prob is None:
layerdrop_prob = ScheduledFloat((0.0, 0.2), (4000.0, 0.025))
layerdrop_prob = ScheduledFloat((0.0, 0.1), (16000.0, 0.01))
self.layerdrop_prob = layerdrop_prob
self.depthwise_conv = nn.Conv2d(