9 Commits

Author SHA1 Message Date
Daniel Povey
b3b3e5daa0 Pad only on the right 2023-06-20 01:58:27 +08:00
Daniel Povey
6c3ab1e706 Fixes 2023-06-19 04:59:57 +08:00
Daniel Povey
03ad0d7910 Remove concept of epochs from training subformer for language modeling;
revert dimensions to how they were in zlm53.
2023-06-19 04:45:37 +08:00
Daniel Povey
da80241179 Use larger valid set; get --print-diagnostics=True to work 2023-05-28 15:17:09 +08:00
Daniel Povey
3351402875 Implement train mode in lm_datamodule 2023-05-23 11:08:05 +08:00
Daniel Povey
15aca1fb4a Simplify dataloader code 2023-05-18 13:55:52 +08:00
Daniel Povey
9367ea3646 Don't drop last batch 2023-05-18 12:47:28 +08:00
Daniel Povey
f0264bed1b Fix DDP issue; Change configurations, reducing subsampling factor; increase sequence length. 2023-05-04 16:18:31 +08:00
Daniel Povey
3574e7dbb5 Initial version of zipformer1 LM that runs, not sure whether it is working 2023-05-04 14:46:06 +08:00