Yifan Yang
54d0a2b499
Merge branch 'k2-fsa:master' into dev/k2ssl
2025-01-11 15:28:03 +08:00
Han Zhu
ab91112909
Improve infinity-check ( #1862 )
...
1. Attach the inf-check hooks if the grad scale is getting too small.
2. Add try-catch to avoid OOM in the inf-check hooks.
3. Set warmup_start=0.1 to reduce chances of divergence
2025-01-09 15:05:38 +08:00
Yifan Yang
dcc4730219
Merge branch 'k2-fsa:master' into dev/k2ssl
2025-01-06 17:31:34 +08:00
Seonuk Kim
8d602806c3
Update conformer.py ( #1859 )
...
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
Swich -? Swish
2025-01-06 17:31:13 +08:00
Yifan Yang
ab44ac0f9e
Merge branch 'k2-fsa:master' into dev/k2ssl
2025-01-06 17:30:59 +08:00
Seonuk Kim
3b6d54007b
Update conformer.py ( #1857 )
...
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
* Update conformer.py
feedforward dimention -> feedforward dimension
2025-01-06 13:17:02 +08:00
Yifan Yang
e8fa10e53a
Merge branch 'k2-fsa:master' into dev/k2ssl
2024-12-31 09:09:45 +08:00
Han Zhu
48088cb807
Refactor optimizer ( #1837 )
...
* Print indexes of largest grad
2024-12-30 15:30:02 +08:00
Fangjun Kuang
d4d4f281ec
Revert "Replace deprecated pytorch methods ( #1814 )" ( #1841 )
...
This reverts commit 3e4da5f78160d3dba3bdf97968bd7ceb8c11631f.
2024-12-18 16:49:57 +08:00
Li Peng
3e4da5f781
Replace deprecated pytorch methods ( #1814 )
...
* Replace deprecated pytorch methods
- torch.cuda.amp.GradScaler(...) => torch.amp.GradScaler("cuda", ...)
- torch.cuda.amp.autocast(...) => torch.amp.autocast("cuda", ...)
* Replace `with autocast(...)` with `with autocast("cuda", ...)`
Co-authored-by: Li Peng <lipeng@unisound.ai>
2024-12-16 10:24:16 +08:00
Yifan Yang
277b261e09
Merge branch 'k2-fsa:master' into dev/k2ssl
2024-10-31 11:18:51 +08:00
zr_jin
87cadfcd2e
fixed formatting issue ( #1791 )
...
* isort fixed formatting issue
2024-10-30 21:14:12 +08:00
Wei Kang
d513d456b8
Add prefix beam search and corresponding decoding methods ( #1786 )
...
* Add prefix beam search / shallow fussion / hotwords in librispeech ctc decode
* Add librispeech cr-ctc prefix beam search results
2024-10-30 10:14:34 +08:00
Your Name
1b89c6dac4
skipping batch counts hurts performance
2024-10-28 22:59:27 -07:00
Yifan Yang
d4b6cb09ad
Merge branch 'k2-fsa:master' into dev/k2ssl
2024-10-28 12:19:52 +08:00
Fangjun Kuang
05f756390c
Avoid using lr from checkpoint. ( #1781 )
2024-10-28 00:59:04 +08:00
Yifan Yang
c9207356af
Merge branch 'k2-fsa:master' into dev/k2ssl
2024-10-21 15:19:05 +08:00
zr_jin
88bacfb9e6
minor fixes for the repo ( #1775 )
...
* minor fixes for the repo
Co-authored-by: Fangjun Kuang <csukuangfj@gmail.com>
2024-10-21 13:51:56 +08:00
Yifan Yang
e80b9dc279
Merge branch 'k2-fsa:master' into dev/k2ssl
2024-10-21 13:27:22 +08:00
zr_jin
e8b6b920c0
A LibriTTS recipe on both ASR & Neural Codec Tasks ( #1746 )
...
* added ASR & CODEC recipes for LibriTTS corpus
2024-10-21 11:30:14 +08:00
Zengwei Yao
693d84a301
Add Consistency-Regularized CTC ( #1766 )
...
* support consistency-regularized CTC
* update arguments of cr-ctc
* set default value of cr_loss_masked_scale to 1.0
* minor fix
* refactor codes
* update RESULTS.md
2024-10-21 10:35:26 +08:00
Zengwei Yao
fbba712887
Fix issue with eval mode in ActivationDropoutLinear ( #1770 )
...
* Fix issue with eval mode in ActivationDropoutLinear
---------
Co-authored-by: Daniel Povey <dpovey@gmail.com>
2024-10-12 19:09:05 +08:00
Yifan Yang
25b6dd26ac
Merge branch 'k2-fsa:master' into dev/k2ssl
2024-09-24 15:35:12 +08:00
Fangjun Kuang
6f1abd832d
Fix exporting streaming zipformer models. ( #1755 )
2024-09-11 21:04:52 +08:00
Yifan Yang
f05b3b1701
Update finetune.py
2024-09-07 23:13:41 +08:00
Yifan Yang
19cc5bab65
Update finetune_ce.py
2024-09-07 23:13:15 +08:00
Yifan Yang
2d3452fa32
Update finetune.py
2024-09-07 23:12:38 +08:00
Yifan Yang
2e52cbf1fe
Update finetune_ctc.py
2024-09-07 23:12:07 +08:00
Yifan Yang
13c6e81189
Delete egs/librispeech/SSL/pretrain.sh
2024-09-05 12:57:42 +08:00
Yifan Yang
ef5cf0250d
Update finetune_ctc.py
2024-09-02 14:11:22 +08:00
Yifan Yang
26b2a5703a
Merge branch 'k2-fsa:master' into dev/k2ssl
2024-08-28 13:00:34 +08:00
Xiaoyu Yang
a6c02a4d8c
zipformer BF16 training recipe ( #1700 )
...
Support Zipformer AMP +BF16 training
2024-08-23 09:42:22 +08:00
Yuekai Zhang
3b434fe83c
fix triton onnx export ( #1730 )
2024-08-23 09:33:46 +08:00
Yifan Yang
cce86a3943
Merge branch 'k2-fsa:master' into dev/k2ssl
2024-08-14 15:20:26 +08:00
Karel Vesely
1730fce688
split save_results() -> save_asr_output() + save_wer_results() ( #1712 )
...
- the idea is to support `--skip-scoring` argument passed to a decoding
script
- created for Transducer decoding (non-streaming, streaming)
- it can be done also for CTC decoding... (not yet)
- also added `--label` for extra label in `streaming_decode.py`
- and also added `set_caching_enabled(True)`, which has no effect on
librispeech, but it leads to faster runtime on DBs with long
recordings (assuming `librispeech/zipformer` scripts are the
example scripts for other setups)
2024-08-13 23:02:14 +08:00
Your Name
8e296b7047
add librilight ssl recipe
...
update
Update ssl_datamodule.py
Update pretrain.py
Update pretrain.sh
Update pretrain.sh
Update hubert_ce.py
Update pretrain.py
2024-08-10 22:44:20 +08:00
zzasdf
11151415f3
fix error in accum_grad ( #1693 )
2024-07-17 17:47:43 +08:00
Zengwei Yao
d47c078286
add decoding method of ctc-greedy-search in zipformer recipe ( #1690 )
2024-07-14 17:30:13 +08:00
Zengwei Yao
334beed2af
fix usages of returned losses after adding attention-decoder in zipformer ( #1689 )
2024-07-12 16:50:58 +08:00
Teo Wen Shen
19048e155b
Cast grad_scale in whiten to float ( #1663 )
...
* cast grad_scale in whiten to float
* fix cast in zipformer_lora
2024-07-11 15:12:30 +08:00
Yifan Yang
d65187ec52
Small fix ( #1686 )
2024-07-11 14:45:35 +08:00
Zengwei Yao
785f3f0bcf
Update RESULTS.md, adding results and model links of zipformer-small/medium CTC/AED models ( #1683 )
2024-07-09 20:04:47 +08:00
zr_jin
2d64228efa
Update attention_decoder.py ( #1681 )
2024-07-06 09:01:34 +08:00
Zengwei Yao
f76afff741
Support CTC/AED option for Zipformer recipe ( #1389 )
...
* add attention-decoder loss option for zipformer recipe
* add attention-decoder-rescoring
* update export.py and pretrained_ctc.py
* update RESULTS.md
2024-07-05 20:19:18 +08:00
Yifan Yang
cbcac23d26
Fix typos, remove unused packages, normalize comments ( #1678 )
2024-07-04 14:19:45 +08:00
Manix
eaab2c819f
Zipformer Onnx FP16 ( #1671 )
...
Signed-off-by: manickavela29 <manickavela1998@gmail.com>
2024-06-27 16:08:24 +08:00
Fangjun Kuang
3059eb4511
Fix doc URLs ( #1660 )
2024-06-21 11:10:14 +08:00
Fangjun Kuang
b88062292b
Typo fixes ( #1643 )
2024-06-03 16:49:21 +08:00
Zengwei Yao
0df406c5da
Initialize BiasNorm bias with small random values ( #1630 )
2024-05-20 22:32:02 +08:00
zr_jin
68980c5d0a
Fix an error occured during mmi preparation ( #1626 )
...
* init commit
* updated
2024-05-17 19:45:15 +08:00
