21 Commits

Author	SHA1	Message	Date
Daniel Povey	d313c27c14	Change configuration again.. not great performance.	2021-09-07 20:58:00 +08:00
Daniel Povey	573e0582d8	Run in exp_2, with foam from start, knee_factor=5.0, initial_lrate=2e-04.	2021-08-30 14:10:21 +08:00
Daniel Povey	ccf7bdec23	Add Foam optimizer; I used this from epoch 3.	2021-08-28 21:51:54 +08:00
Daniel Povey	d045831a4f	Get dataset to work for empty input sentences; test it	2021-08-25 15:54:36 +08:00
Daniel Povey	a7b61100de	Use collate_fn as class. harmless but not necessary without multiple workers	2021-08-25 11:27:47 +08:00
Daniel Povey	0d97e689be	Version I am running...	2021-08-24 21:59:41 +08:00
Daniel Povey	e6eefeba88	Changes to dataset to prevent OOM on batches with short sentences	2021-08-24 14:50:49 +08:00
Daniel Povey	9576d6574f	Various bug fixes	2021-08-23 23:45:03 +08:00
Daniel Povey	7711fba867	Fix bugs; first version that is running successfully.	2021-08-23 22:40:23 +08:00
Daniel Povey	c3a8727446	Add train.py	2021-08-23 22:28:45 +08:00
Daniel Povey	26b5b5ba46	Get tests to work for MaskedLmConformer	2021-08-23 19:05:31 +08:00
Daniel Povey	5fecd24664	Test, and fix, TransformerDecoderRelPos	2021-08-23 17:48:00 +08:00
Daniel Povey	7856ab89fc	Test, and fix, TransformerDecoderLayerRelPos	2021-08-23 17:39:37 +08:00
Daniel Povey	556fae586f	Add testing for MaskedLmConformerEncoder	2021-08-23 17:22:03 +08:00
Daniel Povey	2fbe3b78fd	Add more testing; fix issue about channel dim of LayerNorm.	2021-08-23 17:18:00 +08:00
Daniel Povey	e0b04ba54f	Progress in testing	2021-08-23 15:38:37 +08:00
Daniel Povey	03ff4aab2f	Some progress on refactoring conformer code, it's in transformer.py only...	2021-08-23 11:11:09 +08:00
Daniel Povey	ea43b49ef2	Remove BatchNorm, use LayerNorm	2021-08-22 11:56:22 +08:00
Daniel Povey	076a70b62d	Initial conformer refactoring, not nearly done	2021-08-22 11:47:26 +08:00
Daniel Povey	cbe5ee1111	Copy some files, will edit..	2021-08-21 22:35:43 +08:00
Daniel Povey	421a41027a	Get dataset.py working..	2021-08-21 18:23:46 +08:00