mirror of https://github.com/k2-fsa/icefall.git synced 2025-08-08 09:32:20 +00:00

Whisper large fine-tuning on wenetspeech, mutli-hans-zh (#1483 )

* add whisper fbank for wenetspeech

* add whisper fbank for other dataset

* add str to bool

* add decode for wenetspeech

* add requirments.txt

* add original model decode with 30s

* test feature extractor speed

* add aishell2 feat

* change compute feature batch

* fix overwrite

* fix executor

* regression

* add kaldifeatwhisper fbank

* fix io issue

* parallel jobs

* use multi machines

* add wenetspeech fine-tune scripts

* add monkey patch codes

* remove useless file

* fix subsampling factor

* fix too long audios

* add remove long short

* fix whisper version to support multi batch beam

* decode all wav files

* remove utterance more than 30s in test_net

* only test net

* using soft links

* add kespeech whisper feats

* fix index error

* add manifests for whisper

* change to licomchunky writer

* add missing option

* decrease cpu usage 

* add speed perturb for kespeech

* fix kespeech speed perturb

* add dataset

* load checkpoint from specific path

* add speechio

* add speechio results

---------

Co-authored-by: zr_jin <peter.jin.cn@gmail.com>

2024-03-07 19:04:27 +08:00

809 B

Raw Blame History

Introduction

This recipe includes some different pretrained ASR models' decoding results with SpeechIO test sets.

./RESULTS.md contains the latest results.

Pretrained Models

The following table lists the pretrained models.

	Huggingface	Comment
`zipformer`	zrjin/icefall-asr-multi-zh-hans-zipformer-ctc-2023-10-24	Using multi-hans-zh recipe training
`whisper`	yuekai/icefall_asr_wenetspeech_whisper	Using wenetspeech recipe training

809 B Raw Blame History

Introduction

Pretrained Models

809 B

Raw Blame History