Wei Kang
6e609c67a2
Using streaming conformer as transducer encoder ( #380 )
...
* support streaming in conformer
* Add more documents
* support streaming on pruned_transducer_stateless2; add delay penalty; fixes for decode states
* Minor fixes
* streaming for pruned_transducer_stateless4
* Fix conv cache error, support async streaming decoding
* Fix style
* Fix style
* Fix style
* Add torch.jit.export
* mask the initial cache
* Cutting off invalid frames of encoder_embed output
* fix relative positional encoding in streaming decoding for compution saving
* Minor fixes
* Minor fixes
* Minor fixes
* Minor fixes
* Minor fixes
* Fix jit export for torch 1.6
* Minor fixes for streaming decoding
* Minor fixes on decode stream
* move model parameters to train.py
* make states in forward streaming optional
* update pretrain to support streaming model
* update results.md
* update tensorboard and pre-models
* fix typo
* Fix tests
* remove unused arguments
* add streaming decoding ci
* Minor fix
* Minor fix
* disable right context by default
2022-06-28 00:18:54 +08:00
Jun Wang
d792bdc9bc
fix typo ( #445 )
2022-06-25 11:00:53 +08:00
Fangjun Kuang
f6ce135608
Various fixes to support torch script. ( #371 )
...
* Various fixes to support torch script.
* Add tests to ensure that the model is torch scriptable.
* Update tests.
2022-05-16 21:46:59 +08:00
Mingshuang Luo
93c60a9d30
Code style check for librispeech pruned transducer stateless2 ( #308 )
2022-04-11 22:15:18 +08:00
Daniel Povey
61486a0f76
Remove initial_speed
2022-04-06 13:17:26 +08:00
Daniel Povey
72f4a673b1
First draft of new approach to learning rates + init
2022-04-04 20:21:34 +08:00
Daniel Povey
8be10d3d6c
First draft of model rework
2022-04-02 20:03:21 +08:00
Daniel Povey
eec597fdd5
Merge changes from master
2022-04-02 18:45:20 +08:00
Daniel Povey
e0ba4ef3ec
Make layer dropout rate 0.075, was 0.1.
2022-04-02 17:48:54 +08:00
Daniel Povey
45f872c27d
Remove final dropout
2022-04-01 19:33:20 +08:00
Daniel Povey
92ec2e356e
Fix test-mode
2022-04-01 12:22:12 +08:00
Daniel Povey
8caa18e2fe
Bug fix to warmup_scale
2022-03-31 17:30:51 +08:00
Daniel Povey
e663713258
Change how warmup is applied.
2022-03-31 14:43:49 +08:00
Daniel Povey
9a0c2e7fee
Merge branch 'rework2i' into rework2i_restoredrop
2022-03-31 12:17:02 +08:00
Daniel Povey
f47fe8337a
Remove some un-used code
2022-03-31 12:16:08 +08:00
Daniel Povey
0599f38281
Add final dropout to conformer
2022-03-31 11:53:54 +08:00
Daniel Povey
f87811e65c
Fix RE identity
2022-03-30 21:41:46 +08:00
Daniel Povey
709c387ce6
Initial refactoring to remove unnecessary vocab_size
2022-03-30 21:40:22 +08:00
Daniel Povey
74121ac478
Merge branch 'rework2h_randloader_pow0.333_conv_8' into rework2h_randloader_pow0.333_conv_8_lessdrop_speed
...
# Conflicts:
# egs/librispeech/ASR/pruned_transducer_stateless2/conformer.py
2022-03-30 12:24:15 +08:00
Daniel Povey
37ab0bcfa5
Reduce speed of some components
2022-03-30 11:46:23 +08:00
Daniel Povey
7c46c3b0d4
Remove dropout in output layer
2022-03-30 11:20:04 +08:00
Daniel Povey
21a099b110
Fix padding bug
2022-03-30 11:18:04 +08:00
Daniel Povey
ca6337b78a
Add another convolutional layer
2022-03-30 11:12:35 +08:00
Daniel Povey
1b8d7defd0
Reduce 1st conv channels from 64 to 32
2022-03-30 00:44:18 +08:00
Daniel Povey
4e453a4bf9
Rework conformer, remove some code.
2022-03-29 23:41:13 +08:00
Daniel Povey
11124b03ea
Refactoring and simplifying conformer and frontend
2022-03-29 20:32:14 +08:00
Daniel Povey
2cde99509f
Change max-keep-prob to 0.95
2022-03-27 23:21:42 +08:00
Daniel Povey
953aecf5e3
Reduce layer-drop prob after warmup to 1 in 100
2022-03-27 00:25:32 +08:00
Daniel Povey
b43468bb67
Reduce layer-drop prob
2022-03-26 19:36:33 +08:00
Daniel Povey
0e694739f2
Fix test mode with random layer dropout
2022-03-25 23:28:52 +08:00
Daniel Povey
4b650e9f01
Make warmup work by scaling layer contributions; leave residual layer-drop
2022-03-25 20:34:33 +08:00
Daniel Povey
1f548548d2
Simplify the warmup code; max_abs 10->6
2022-03-24 15:06:11 +08:00
Daniel Povey
9a8aa1f54a
Change how warmup works.
2022-03-22 15:36:20 +08:00
Daniel Povey
cef6348703
Change max-abs from 6 to 10
2022-03-22 13:50:54 +08:00
Daniel Povey
11a04c50ae
Change 0.025,0.05 to 0.01 in initializations
2022-03-21 21:29:24 +08:00
Daniel Povey
05e30d0c46
Add max-abs=6, debugged version
2022-03-21 21:15:00 +08:00
Daniel Povey
6769087d70
Remove scale_speed, make swish deriv more efficient.
2022-03-18 16:31:25 +08:00
Daniel Povey
11bea4513e
Add remaining files in pruned_transducer_stateless2
2022-03-17 11:17:52 +08:00
Daniel Povey
cc8e4412f7
Add more files..
2022-03-16 22:16:40 +08:00
