mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-12-11 06:55:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
860 Commits 5 Branches 3 Tags
Commit Graph

607 Commits

Author SHA1 Message Date
danqing fu
15c7035dad small fixes 2023-06-11 21:39:24 +08:00
danqing fu
d932ed0928 onnx streaming decode 2023-06-11 13:42:16 +08:00
danqing fu
0b63b87092 stream onnx export suc 2023-06-08 13:33:38 +08:00
danqing fu
1378f833bd small fixes 2023-06-08 10:40:15 +08:00
danqing fu
851bb50cb8 small fixes 2023-06-08 09:47:00 +08:00
danqing fu
4d4188aa81 streaming zipformer onnx export 2023-06-07 21:23:11 +08:00
Fangjun Kuang
26f3049f4c minor fixes 2023-06-06 15:30:14 +08:00
Fangjun Kuang
97b7e34dc5 small fixes 2023-06-06 15:27:23 +08:00
Fangjun Kuang
d9e7f02225 Use torch.jit.script() for positional encoding 2023-06-06 15:25:11 +08:00
Fangjun Kuang
4cb2395186 Support longer input for the offline model 2023-06-06 14:20:12 +08:00
danqing fu
acbc4b5808 minor fixes 2023-06-06 11:13:04 +08:00
danqing fu
e609dfee29 minor fixes 2023-06-06 11:12:21 +08:00
danqing fu
09c4946c15 modify max_len to allow longer input audio 2023-06-06 11:09:00 +08:00
danqing fu
8f8b09498f remove if-branch at downsampling pad 2023-06-06 10:05:59 +08:00
Fangjun Kuang
7b00b34617 minor fixes 2023-06-02 14:23:47 +08:00
Fangjun Kuang
dd91c89f28 Fix exporting non-streaming zipformer to ONNX via torch.jit.trace() 2023-06-02 14:21:28 +08:00
danqing fu
f43c44236f add updated zipformer nonstreaming onnx export 2023-06-01 03:36:11 +00:00
Fangjun Kuang
7b0afbdc16
Remove cur_batch_idx (#1102) 2023-05-30 14:49:54 +08:00
Fangjun Kuang
1aeffa73bc
remove outdated code in train.py (#1096) 2023-05-25 07:47:38 +08:00
Zengwei Yao
6826b076d4
add flops profiler, support for Zipformer encoder and Conformer encoder (#1093) 
* add flops profiler, support for Zipformer encoder and Conformer encoder

* support for reworked conformer and old zipformer

* skip black check
 2023-05-24 19:10:45 +08:00
Fangjun Kuang
dbcf0b41db
Fix stateless7 training error (#1082) 2023-05-23 12:52:02 +08:00
Yifan Yang
90c392b7b3
Add docs for Fine-tune with mux (#1074) 
* Update RESULTS.md
 2023-05-22 12:39:51 +08:00
Zengwei Yao
8070258ec5
fix conv_emformer2, when using right_context_length=0 (#1076) 2023-05-21 20:31:54 +08:00
Zengwei Yao
30fcd16c7d
rm zipformer/__init__.py (#1075) 2023-05-20 23:12:11 +08:00
Zengwei Yao
a7e142b7ff
Support long audios recognition (#980) 
* support long file transcription

* rename recipe as long_file_recog

* add docs

* support multi-gpu decoding

* style fix
 2023-05-19 20:27:55 +08:00
Zengwei Yao
f18b539fbc
Add the upgraded Zipformer model (#1058) 
* add the zipformer codes, copied from branch from_dan_scaled_adam_exp1119

* support model export with torch.jit.script

* update RESULTS.md

* support exporting streaming model with torch.jit.script

* add results of streaming models, with some minor changes

* update README.md

* add CI test

* update k2 version in requirements-ci.txt

* update pyproject.toml
 2023-05-19 16:47:59 +08:00
Fangjun Kuang
ae1949ddcc
Support using the latest master from tencent/ncnn (#1070) 
* Support using the latest master from tencent/ncnn

* small fixes
 2023-05-18 20:56:58 +08:00
Yifan Yang
562bda91e4
Add adaption recipe for pruned_transducer_stateless7 (#1059) 
* Add mux for finetune

* Add comments

* Fix for black

* Update finetune.py
 2023-05-17 16:02:27 +08:00
Fangjun Kuang
6c326427a0
Support exporting streaming conformer to ONNX (#1047) 2023-05-10 14:47:37 +08:00
Fangjun Kuang
5b50ffda54
support using mini librispeech in training (#1048) 
* support mini librispeech in training

* update onnx export doc
 2023-05-09 15:10:06 +08:00
Fangjun Kuang
ebbab37776
Fix broken code in download_lm.py (#1046) 2023-05-08 20:48:17 +08:00
Fangjun Kuang
efbb577b88
fix compiling HLG (#1039) 2023-05-07 16:26:13 +08:00
Yifan Yang
98569b2607
Update RESULTS.md (#1036) 
* Update RESULTS.md
 2023-05-06 17:51:55 +08:00
Wei Kang
80156dda09
Training with byte level BPE (AIShell) (#986) 
* copy files from zipformer librispeech

* Add byte bpe training for aishell

* compile LG graph

* Support LG decoding

* Minor fixes

* black

* Minor fixes

* export & fix pretrain.py

* fix black

* Update RESULTS.md

* Fix export.py
 2023-05-04 19:16:17 +08:00
Yuanhang Zhang
b0228c536e
Fix typo in librispeech OpenFST-based HLG preparation script (#1028) 2023-04-28 19:52:32 +08:00
marcoyang1998
45c13e90e4
RNNLM rescore + Low-order density ratio (#1017) 
* add rnnlm rescore + LODR

* add LODR in decode.py

* update RESULTS
 2023-04-24 15:00:02 +08:00
Yifan Yang
2096e69bda
Use CutSet.mux for multidataset (#1020) 
* Use CutSet.mux

* Remove mischange

* Fix for style check
 2023-04-23 18:41:44 +08:00
Yifan Yang
d67a49afe4
Add multidataset (#1010) 
* Add Common Voice for multidataset

* Add prepare_multidataset.sh

* Add dataset mixing


* Update prepare_multidataset.sh

* Update prepare_giga_speech.sh

* update comments

* Add split and shuffle mechanism

* Add multi-dataset train

* Fix for deleting

* Fix for modifying

* Add comments

* Change type for perturb_speed

* Fix for style check

* Small fix

* Add filter

* Remove warning
 2023-04-21 18:09:41 +08:00
marcoyang1998
57d6482a79
Streaming Zipformer with multi-dataset (#984) 
* modify train.py

* add right padding option in decode.py

* update RESULTS.md
 2023-04-21 15:43:28 +08:00
Wen Ding
78b9dcc936
Support exporting BS Zipformer models to ONNX, used in Triton Server (#1008) 
* Support export BS Zipformer models to ONNX in Tritron

* Update copyright

* Update exporting codes for BS zipformer models

* Code format

* Update comments

* Update export_onnx.py

---------

Co-authored-by: Yifan Yang <64255737+yfyeung@users.noreply.github.com>
 2023-04-18 17:05:08 +08:00
marcoyang1998
34d1b07c3d
Modified beam search with RNNLM rescoring (#1002) 
* add RNNLM rescore

* add shallow fusion and lm rescore for streaming zipformer

* minor fix

* update RESULTS.md

* fix yesno workflow, change from ubuntu-18.04 to ubuntu-latest
 2023-04-17 16:43:00 +08:00
Fangjun Kuang
e32658e620
Fix torch.jit.script() export for streaming zipformer. (#1005) 2023-04-17 16:13:30 +08:00
Zengwei Yao
7c7d9ab042
add @torch.jit.export for streaming_forward func in Zipformer class (#1004) 2023-04-17 12:03:52 +08:00
Zengwei Yao
5f066d3d53
support decoding and computing RTF on test sets with onnx models (#995) 
* support decode and compute RTF on test sets with onnx models

* support onnx export and decode in pruned_transducer_stateless
 2023-04-12 19:04:50 +08:00
Yifan Yang
33578cca48
Fix filter_cuts in compute_fbank_librispeech.py (#993) 2023-04-11 11:12:05 +08:00
Zengwei Yao
136aa94d57
remove duplicated lines (#988) 2023-04-06 17:47:33 +08:00
Yifan Yang
c90f57afdb
Remove simulate streaming from stateless8 (#985) 2023-04-04 11:04:00 +08:00
marcoyang1998
d337398d29
Shallow fusion for Aishell (#954) 
* add shallow fusion and LODR for aishell

* update RESULTS

* add save by iterations
 2023-04-03 16:20:29 +08:00
Yifan Yang
46bf6df62f
Remove simulate streaming from stateless7 (#983) 
* Remove simulate streaming from stateless7
 2023-04-03 14:55:45 +08:00
Fangjun Kuang
a632b24c35
Export int8 quantized models for non-streaming Zipformer. (#977) 
* Export int8 quantized models for non-streaming Zipformer.

* Delete export-onnx.py

* Export int8 models for other folders
 2023-03-31 22:46:19 +08:00