793 Commits

Author SHA1 Message Date
Yifan Yang
5cd1636cb3
Fix a bug in decode.py (#893)
Co-authored-by: yifanyang <yifanyeung@yifanyangs-MacBook-Pro.local>
2023-02-09 12:12:23 +08:00
Fangjun Kuang
e916027bfe
Fix doc typos for onnx export (#891) 2023-02-09 10:33:40 +08:00
Karel Vesely
35e5a2475c
Librispeech, validate_manifest.py (#890) 2023-02-09 07:57:02 +08:00
Fangjun Kuang
2b995639b7
Add ONNX support for Zipformer and ConvEmformer (#884) 2023-02-09 00:02:38 +08:00
Zengwei Yao
af735eb75b
Get alignments using lhotse workflows align-with-torchaudio (#888)
* add lhotse workflow align-with-torchaudio

* modify related decode.py files
2023-02-08 21:54:35 +08:00
Zengwei Yao
d12e6f098c
Get (start, end) timestamps for CTC models (#876)
* parse timestamps and texts for BPE-based models

* parse timestamps (frame indexes) and texts for other cases

* add test functions

* add parse_fsa_timestamps_and_texts function, test in conformer_ctc3/decode.py

* calculate symbol delay for (start, end) timestamps
2023-02-07 21:43:16 +08:00
Fangjun Kuang
7ae03f6c88
Add onnx export support for pruned_transducer_stateless5 (#883) 2023-02-07 17:47:08 +08:00
Yifan Yang
ffbf6d9199
Add generate_averaged_model.py (#882) 2023-02-07 16:19:08 +08:00
Fangjun Kuang
8d3810e289
Simplify ONNX export (#881)
* Simplify ONNX export

* Fix ONNX CI tests
2023-02-07 15:01:59 +08:00
Fangjun Kuang
52f3a747be
Refactor onnx export for streaming zipformer (#879) 2023-02-07 12:12:26 +08:00
Zengwei Yao
5a05b95730
add params.hlg_scale (#880) 2023-02-06 23:21:46 +08:00
Yifan Yang
caf23546ed
No more T < S after frame_reducer (#875)
* No more T < S after frame_reducer

* Fix for style check

* Adjust the permissions

* Add support for inference to frame_reducer

* Fix for flake8 check

---------

Co-authored-by: yifanyang <yifanyeung@yifanyangs-MacBook-Pro.local>
2023-02-06 12:17:45 +08:00
Yuekai Zhang
bf5f0342a2
Add streaming onnx export for zipformer (#831)
* add streaming onnx export for zipformer

* update triton support

* add comments

* add ci test

* add onnxmltools for fp16 onnx export
2023-02-06 10:37:07 +08:00
Yifan Yang
029c8566e4
Small fix for frame_reducer.py (#871) 2023-02-03 17:49:54 +08:00
Yifan Yang
bffce413f0
Fix filename ctc_guild_decode_bs.py -> ctc_guide_decode_bs.py (#870)
* fix filename ctc_guild_decode_bs.py -> ctc_guide_decode_bs.py

---------

Co-authored-by: yifanyang <yifanyeung@yifanyangs-MacBook-Pro.local>
2023-02-03 12:32:06 +08:00
Zengwei Yao
1e6d6f8160
shuffle full Librispeech for zipformer recipes (#869)
* shuffle libri
2023-02-03 11:54:57 +08:00
Yifan Yang
e36ea89112
update result.md for pruned_transducer_stateless7_ctc_bs (#865) 2023-02-01 21:04:56 +08:00
Yifan Yang
d8234e199c
Add export to ONNX for Zipformer+CTC using blank skip (#861)
* Add export to ONNX for Zipformer+CTC using blank skip

---------

Co-authored-by: yifanyang <yifanyeung@yifanyangs-MacBook-Pro.local>
2023-01-31 15:57:03 +08:00
BuaaAlban
e9019511eb
Fix bug in streaming_conformer_ctc egs (#862)
* Update train.py

Fix transducer lstm egs bug as mentioned in issue 579

* Update train.py

fix dataloader bug
2023-01-31 15:19:50 +08:00
Yifan Yang
e277e31e37
update huggingface link of zipformer_ctc_blankskip.rst (#858)
* update huggingface link

* update link

---------

Co-authored-by: yifanyang <yifanyeung@yifanyangs-MacBook-Pro.local>
2023-01-29 15:35:36 +08:00
Meng Wei
74a2069f94
fix expired links (#856) 2023-01-28 14:43:47 +08:00
Teo Wen Shen
1ce2bc1ee0
edit comments (#852) 2023-01-28 13:47:21 +08:00
Zengwei Yao
6b1ab71dc9
hardcode --filter-uneven-sized-batch (#854) 2023-01-27 21:24:12 +08:00
Wei Kang
f5ff7a18eb
Fix the unclear description for streaming model (#849) 2023-01-17 11:28:59 +08:00
Fangjun Kuang
0af3e7beda
fix export for stateless4 (#844) 2023-01-16 20:26:36 +08:00
Zengwei Yao
2a463a420d
Filter uneven-sized batch (#843)
* add filter_uneven_sized_batch fucntion

* set --filter-uneven-sized-batch=True as default
2023-01-16 20:15:35 +08:00
Fangjun Kuang
5c8e9628cc
update faq for libpython3.10.so not found (#838) 2023-01-13 15:21:29 +08:00
Fangjun Kuang
958dbb3a1d
add doc for int8 quantization with sherpa-ncnn (#832)
* add doc for int8 quantization with sherpa-ncnn

* typo fixes
2023-01-11 20:29:36 +08:00
marcoyang1998
142420b3af
Add docs for distillation (#812)
* add README to docs

* update documents for distillation

* upload png files
2023-01-11 16:45:24 +08:00
Fangjun Kuang
8582b6e41a
Add doc about converting conv-emformer to sherpa-ncnn (#830) 2023-01-11 15:34:30 +08:00
Fangjun Kuang
c05f5d76df
fix decoding for ncnn (#828) 2023-01-10 20:52:13 +08:00
Fangjun Kuang
fcffa593f0
Add FAQs to doc (#827)
* Add FAQs

* small fixes
2023-01-10 15:38:33 +08:00
marcoyang1998
42cc10117e
Fix ncnn install (#824)
* add README to docs

* fix ncnn installation
2023-01-09 15:08:39 +08:00
Fangjun Kuang
9453eb1c70
Fix doc for building ncnn (#822) 2023-01-06 17:00:27 +08:00
kobenaxie
9a9c5a0f9b
remove unused codes. (#821) 2023-01-06 11:16:22 +08:00
Yifan Yang
b9626f2e06
fix typo for ctc-decode.py (#815)
Co-authored-by: yifanyang <yifanyeung@yifanyangs-MacBook-Pro.local>
2023-01-05 17:18:43 +08:00
Fangjun Kuang
8642dbc0bd
Fix setup_dist (#806) 2023-01-04 12:21:19 +08:00
Yunusemre
0f26edfde9
Add Zipformer Onnx Support (#778)
* add export script

* add zipformer onnx pretrained script

* add onnx zipformer test

* fix style

* add zipformer onnx to workflow

* replace is_in_onnx_export with is_tracing

* add github.event.label.name == 'onnx'

* add is_tracing to necessary conditions

* fix pooling_mask

* add onnx_check

* add onnx_check to scripts

* add is_tracing to scaling.py
2023-01-03 16:59:44 +08:00
marcoyang1998
80cce141b4
Full libri fix manifest (#804)
* modify the name of the directory of vq manifest

* fix missing manifest in full libri training
2023-01-03 15:40:53 +08:00
Daniil
2fd970b682
not removing result_dir in tedlium conformer ctc2 + add lm stem to compile_hlg_using_openfst.py + add MASTER_ADDR to be prvided to setup_dist (#801) 2023-01-02 08:08:32 +08:00
Zengwei Yao
67ae5fdf2b
Doc streaming zipformer (#798)
* add doc for streaming_zipformer

* update README.md
2022-12-30 15:21:18 +08:00
behnamasefi
a54b748a02
check for utterance len (#795)
Co-authored-by: behnam <basefisaray@roku.com>
2022-12-30 11:06:09 +08:00
Zengwei Yao
d167aad4ab
Add streaming zipformer (#787)
* add streaming zipformer codes

* add test_model.py

* add export.py, pretrained.py, jit_pretrained.py

* add cached_len for pooling module

* add jit_trace_export.py and jit_trace_pretrained.py

* fix bug in jit.trace

* update RESULTS.md

* add CI test

* minor fix in pruned_transducer_stateless7/zipformer.py

* update README.md
2022-12-30 10:52:18 +08:00
marcoyang1998
aa0fe4e4ac
Fix typos in RESULTS.md (#797) 2022-12-29 11:54:42 +08:00
marcoyang1998
1f0408b103
Support Transformer LM (#750)
* support transformer LM

* show number of parameters during training

* update docstring

* testing files for ppl calculation

* add lm wrampper for rnn and transformer LM

* apply lm wrapper in lm shallow fusion

* small updates

* update decode.py to support LM fusion and LODR

* add export.py

* update CI and workflow

* update decoding results

* fix CI

* remove transformer LM from CI test
2022-12-29 10:53:36 +08:00
Yuekai Zhang
3c54333b06
fix bug (#796) 2022-12-28 11:20:38 +08:00
marcoyang1998
05dfd5e630
Fix distillation with HuBERT (#790)
* update vq huggingface url

* remove hard lhotse version requirement

* resolve ID mismatch

* small fixes


* Update egs/librispeech/ASR/pruned_transducer_stateless6/vq_utils.py

Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>

* update version check

Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>
2022-12-27 15:26:11 +08:00
Yifan Yang
a24a1cbfa9
small fix for zipformer_ctc_blankskip.rst (#792)
Co-authored-by: yifanyang <yifanyeung@yifanyangs-MacBook-Pro.local>
2022-12-27 15:06:53 +08:00
Fangjun Kuang
88b7895adf
fix librispeech.py in multi-dataset setup (#791) 2022-12-27 13:59:55 +08:00
Fangjun Kuang
dfbcf606e7
small fixes to prepare.sh (#789) 2022-12-27 09:25:42 +08:00