509 Commits

Author SHA1 Message Date
yaozengwei
e011812bab minor fix doc 2022-06-11 22:31:55 +08:00
yaozengwei
f2974e0df5 fix style 2022-06-11 22:24:12 +08:00
yaozengwei
86b9210d7b modify doc 2022-06-11 22:22:46 +08:00
yaozengwei
8c03d6079a minor fix 2022-06-11 22:12:37 +08:00
yaozengwei
ce008aa2ca delete other test functions 2022-06-11 22:09:53 +08:00
yaozengwei
448a94c00a add author info 2022-06-11 22:09:16 +08:00
yaozengwei
626a2912ca modify export.py 2022-06-11 22:03:19 +08:00
yaozengwei
1a9af61497 copy from pruned_transducer_stateless4 2022-06-11 21:40:19 +08:00
yaozengwei
f57f1b8a44 use torch.div 2022-06-11 21:21:49 +08:00
yaozengwei
c8adbcce64 support torch.jit.export 2022-06-11 21:04:30 +08:00
yaozengwei
aaabe9f611 Merge branch 'emformer_conv_scale_new' into emformer_conv_scale 2022-06-11 18:34:14 +08:00
yaozengwei
eadd0f6aa7 Merge remote-tracking branch 'k2-fsa/master' into emformer_conv_scale_new 2022-06-11 18:32:49 +08:00
yaozengwei
f233b16974 add modify_beam_search, fast_beam_search 2022-06-10 22:10:43 +08:00
yaozengwei
026fb22076 fix bugs, no grad, and num_proccessed_frames 2022-06-10 17:17:03 +08:00
Fangjun Kuang
9f6c748b30
Add links to sherpa. (#417)
* Add links to sherpa.
2022-06-10 12:19:18 +08:00
Fangjun Kuang
bfeab319c9
Fix aishell. (#416) 2022-06-10 11:47:43 +08:00
yaozengwei
507d7c13f4 test states stack and unstack 2022-06-09 22:17:03 +08:00
yaozengwei
7f09720403 refactor streaming decoding 2022-06-09 20:37:16 +08:00
yaozengwei
734d97c47b remane streaming_feature_extractor.py 2022-06-09 13:05:06 +08:00
yaozengwei
acc8a36b5e refactor Stream class 2022-06-09 13:00:22 +08:00
Fangjun Kuang
dbda1644b5
Replace load_manifest_lazy with load_manifest for MUSAN. (#412) 2022-06-09 11:42:18 +08:00
Fangjun Kuang
ed66877694
Replace ChunkedLilcomHdf5Writer with LilcomChunkyWriter. (#411) 2022-06-09 11:18:52 +08:00
Quandwang
8512aaf585
fix typos (#409) 2022-06-08 20:08:44 +08:00
Mingshuang Luo
5079d99ee2
a correction for text2segmentation.py (#407) 2022-06-08 12:06:57 +08:00
yaozengwei
f8071e9373 modify emformer states stack and unstack, streaming decoding, to be continued 2022-06-07 23:57:20 +08:00
Fangjun Kuang
1094a3cb37
Replace LilcomChunkyWriter with ChunkedLilcomHdf5Writer. (#404) 2022-06-07 18:14:25 +08:00
Fangjun Kuang
80c46f0abd
Fix exporting emformer with torchscript using torch 1.6.0 (#402) 2022-06-07 09:19:37 +08:00
yaozengwei
5df1406684 copy from streaming branch 2022-06-06 21:51:47 +08:00
yaozengwei
124ad1db8b copy from streaming branch 2022-06-06 21:20:55 +08:00
yaozengwei
13899dff51 refactor, use fixed-length cache for batch decoding 2022-06-06 21:19:25 +08:00
Fangjun Kuang
29fa878fff
Fix Emformer for torchscript using torch 1.6.0 (#401) 2022-06-06 17:08:07 +08:00
Mingshuang Luo
0a21eaae7f
do a change for decode.py (#400) 2022-06-06 15:44:04 +08:00
Fangjun Kuang
f1abce72f8
Use jsonl for CutSet in the LibriSpeech recipe. (#397)
* Use jsonl for cutsets in the librispeech recipe.

* Use lazy cutset for all recipes.

* More fixes to use lazy CutSet.

* Remove force=True from logging to support Python < 3.8

* Minor fixes.

* Fix style issues.
2022-06-06 10:19:16 +08:00
Mingshuang Luo
e5884f82e0
[Ready to merge] Add prefix for compute fbank (#398)
* add prefix

* add prefix
2022-06-05 18:17:52 +08:00
fanlu
8a3068ead8
Update decode.py (#392)
* Update decode.py

fix bug ```TypeError: greedy_search_batch() missing 1 required positional argument: 'encoder_out_lens'```

* fix modified_beam_search

Co-authored-by: fanlu3 <fanlu@jd.com>
2022-06-04 19:08:17 +08:00
Zengwei Yao
148f69d8d9
Update RESULTS.md (#388)
* update RESULT.md about pruned_transducer_stateless4

* Update RESULT.md

This PR is only to update RESULT.md about pruned_transducer_stateless4.

* set default value of --use-averaged-model to True

* update RESULTS.md and add decode command

* minor fix

* update export.py

* add uploaded files links

* update link

* fix typos
2022-06-04 15:52:35 +08:00
Mingshuang Luo
beab229fd7
[Ready to merge] Pruned_transducer_stateless2 for alimeeting dataset (#378)
* add pruned-rnnt2 recipe for alimeeting dataset

* update code for merging

* change LilcomHdf5Writer to ChunkedLilcomHdf5Writer

* change for test.yml

* change for test.yml

* change for test.yml

* change for workflow yml

* change for yml

* change for yml

* change for README.md

* change for yml

* solve the conflicts

* solve the conflicts
2022-06-04 13:47:46 +08:00
Fangjun Kuang
fbfc98f1d3
Add streaming Emformer stateless RNN-T. (#390)
* Add streaming Emformer stateless RNN-T.

* Update results for streaming Emformer.

* Minor fixes.
2022-06-01 14:31:47 +08:00
yaozengwei
10998bef69 add tail padding 2022-05-31 18:53:20 +08:00
yaozengwei
7307f1c6bc fix typos 2022-05-30 22:37:47 +08:00
yaozengwei
603b707fa8 monir style fix 2022-05-28 19:17:19 +08:00
yaozengwei
26b443eac3 add rule in .flake8 2022-05-28 19:11:04 +08:00
yaozengwei
66b8636878 copy files from existing branch 2022-05-28 18:16:22 +08:00
LIyong.Guo
c4ee2bc0af
[Ready to merge]stateless6: states4 + hubert distillation. (#387)
* a copy of stateless4 as base

* distillation with hubert

* fix typo

* example usage

* usage

* Update egs/librispeech/ASR/pruned_transducer_stateless6/hubert_xlarge.py

Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>

* fix comment

* add results of 100hours

* Update egs/librispeech/ASR/pruned_transducer_stateless6/hubert_xlarge.py

Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>

* Update egs/librispeech/ASR/pruned_transducer_stateless6/hubert_xlarge.py

Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>

* check fairseq and quantization

* a short intro to distillation framework

* Update egs/librispeech/ASR/pruned_transducer_stateless6/hubert_xlarge.py

Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>

* add intro of statless6 in README

* fix type error of dst_manifest_dir

* Update egs/librispeech/ASR/pruned_transducer_stateless6/hubert_xlarge.py

Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>

* make export.py call stateless6/train.py instead of stateless2/train.py

* update results by stateless6

* adjust results format

* fix typo

Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>
2022-05-28 12:37:50 +08:00
yaozengwei
545316636b Merge remote-tracking branch 'origin/master' 2022-05-26 21:55:56 +08:00
yaozengwei
fbbc24f941 Merge remote-tracking branch 'k2-fsa/master' 2022-05-26 21:54:40 +08:00
Mingshuang Luo
c8c8645081
[Ready to merge] Pruned-transducer-stateless2 recipe for aidatatang_200zh (#375)
* add pruned-rnnt2 model for aidatatang_200zh

* do some changes

* change for README.md

* do some changes
2022-05-24 23:07:40 +08:00
Ewald Enzinger
8c5722de8c
[egs] Add prefix when reading manifests due to recent lhotse changes (#382)
* [egs] Add prefix when reading manifests due to recent lhotse changes

* Fix wenetspeech

* Fix style issues
2022-05-23 23:37:35 +08:00
Mingshuang Luo
0e57b30495
[Ready to merge] Pruned Transducer Stateless2 for WenetSpeech (char-based) (#349)
* add char-based pruned-rnnt2 for wenetspeech

* style check

* style check

* change for export.py

* do some changes

* do some changes

* a small change for .flake8

* solve the conflicts
2022-05-23 17:13:01 +08:00
Fangjun Kuang
2f1e23cde1
Narrower and deeper conformer (#330)
* Copy files for editing.

* Add random combine from #229.

* Minor fixes.

* Pass model parameters from the command line.

* Fix warnings.

* Fix warnings.

* Update readme.

* Rename to avoid conflicts.

* Update results.

* Add CI for pruned_transducer_stateless5

* Typo fixes.

* Remove random combiner.

* Update decode.py and train.py to use periodically averaged models.

* Minor fixes.

* Revert to use random combiner.

* Update results.

* Minor fixes.
2022-05-23 14:39:11 +08:00