icefall

mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00

History

Daniel Povey 1d0252d420 Merge branch 'scaled_adam_exp466' into scaled_adam_exp472.

Below is a more complete list of the changes I am making, although some of
these may be counted in the last

  numbers XXX below correspond to branches numbered scaled_adam_expXXX.
    - from 412/413 (cherry-picked): dropout for attention in attention_squeeze and nonlin_attention modules,
      but simplified this a little to use the same dropout schedule and drop them out all together
      also have all 3 submodules use separate heads.
    - from 460->461, which is in the history of 464, revert the part about balancing output out attention_squeeze module.
    - merge from 462->467, about using TanSwish not tanh.
    - merge 462->465, remove whitening in self-attention module
    - merge the part of 465->466  that was about diagnostics (name in Whiten module)

2022-11-23 14:41:09 +08:00

__init__.py

Merge changes from pruned_transducer_stateless4->5

2022-05-31 13:00:11 +08:00

asr_datamodule.py

Move pruned_transducer_stateless4 to pruned_transducer_stateless7

2022-05-31 12:45:28 +08:00

beam_search.py

Move pruned_transducer_stateless4 to pruned_transducer_stateless7

2022-05-31 12:45:28 +08:00

decode.py

Update decode.py by copying from pruned_transducer_stateless5 and changing directory name