mirror of
https://github.com/k2-fsa/icefall.git
synced 2025-09-06 23:54:17 +00:00
Update RESULTS.md
This commit is contained in:
parent
bce81394a4
commit
13541424a9
@ -2,9 +2,61 @@
|
|||||||
|
|
||||||
### Aishell training result (Stateless Transducer)
|
### Aishell training result (Stateless Transducer)
|
||||||
|
|
||||||
|
#### Zipformer (Byte-level BPE)
|
||||||
|
|
||||||
|
[./zipformer_bbpe](./zipformer_bbpe/)
|
||||||
|
|
||||||
|
It's reworked Zipformer with Pruned RNNT loss, trained with Byte-level BPE.
|
||||||
|
|
||||||
|
##### normal-scaled model, number of model parameters: 65549011, i.e., 65.55 M
|
||||||
|
|
||||||
|
| | test | dev | comment |
|
||||||
|
|------------------------|------|------|-----------------------------------------|
|
||||||
|
| greedy search | 4.54 | 4.31 | --epoch 40 --avg 10 |
|
||||||
|
| modified beam search | 4.37 | 4.11 | --epoch 40 --avg 10 |
|
||||||
|
| fast beam search | 4.43 | 4.17 | --epoch 40 --avg 10 |
|
||||||
|
|
||||||
|
```bash
|
||||||
|
./prepare.sh
|
||||||
|
|
||||||
|
export CUDA_VISIBLE_DEVICES="0,1"
|
||||||
|
|
||||||
|
./zipformer_bbpe/train.py \
|
||||||
|
--world-size 2 \
|
||||||
|
--num-epochs 40 \
|
||||||
|
--start-epoch 1 \
|
||||||
|
--use-fp16 1 \
|
||||||
|
--context-size 2 \
|
||||||
|
--enable-musan 0 \
|
||||||
|
--exp-dir zipformer/exp \
|
||||||
|
--max-duration 1000 \
|
||||||
|
--enable-musan 0 \
|
||||||
|
--base-lr 0.045 \
|
||||||
|
--lr-batches 7500 \
|
||||||
|
--lr-epochs 10 \
|
||||||
|
--spec-aug-time-warp-factor 20
|
||||||
|
```
|
||||||
|
|
||||||
|
Command for decoding is:
|
||||||
|
```bash
|
||||||
|
for m in greedy_search modified_beam_search fast_beam_search ; do
|
||||||
|
./zipformer/decode.py \
|
||||||
|
--epoch 40 \
|
||||||
|
--avg 10 \
|
||||||
|
--exp-dir ./zipformer_bbpe/exp \
|
||||||
|
--lang-dir data/lang_bbpe_500 \
|
||||||
|
--context-size 2 \
|
||||||
|
--decoding-method $m
|
||||||
|
done
|
||||||
|
```
|
||||||
|
Pretrained models, training logs, decoding logs, tensorboard and decoding results
|
||||||
|
are available at
|
||||||
|
<https://huggingface.co/zrjin/icefall-asr-aishell-zipformer-bbpe-2024-01-16>
|
||||||
|
|
||||||
|
|
||||||
#### Zipformer (Non-streaming)
|
#### Zipformer (Non-streaming)
|
||||||
|
|
||||||
[./zipformer](./zipformer)
|
[./zipformer](./zipformer/)
|
||||||
|
|
||||||
It's reworked Zipformer with Pruned RNNT loss.
|
It's reworked Zipformer with Pruned RNNT loss.
|
||||||
**Caution**: It uses `--context-size=1`.
|
**Caution**: It uses `--context-size=1`.
|
||||||
@ -260,7 +312,7 @@ done
|
|||||||
Pretrained models, training logs, decoding logs, and decoding results
|
Pretrained models, training logs, decoding logs, and decoding results
|
||||||
are available at
|
are available at
|
||||||
<https://huggingface.co/marcoyang/icefall-asr-aishell-zipformer-pruned-transducer-stateless7-2023-03-21>
|
<https://huggingface.co/marcoyang/icefall-asr-aishell-zipformer-pruned-transducer-stateless7-2023-03-21>
|
||||||
#### Pruned transducer stateless 7 (zipformer)
|
#### Pruned transducer stateless 7 (Byte-level BPE)
|
||||||
|
|
||||||
See <https://github.com/k2-fsa/icefall/pull/986>
|
See <https://github.com/k2-fsa/icefall/pull/986>
|
||||||
|
|
||||||
|
Loading…
x
Reference in New Issue
Block a user