mirrors/icefall
1
0
Fork 0
mirror of https://github.com/k2-fsa/icefall.git synced 2025-09-19 14:04:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,894 Commits 5 Branches 3 Tags
Commit Graph

55 Commits

Author SHA1 Message Date
Daniel Povey
74bf02bba6 Load num_tokens_seen from disk on checkpoint load. 2023-06-20 02:54:47 +08:00
Daniel Povey
85b6450a8a Remove old code 2023-06-19 07:45:57 +08:00
Daniel Povey
6c3ab1e706 Fixes 2023-06-19 04:59:57 +08:00
Daniel Povey
03ad0d7910 Remove concept of epochs from training subformer for language modeling; 
revert dimensions to how they were in zlm53.
 2023-06-19 04:45:37 +08:00
Daniel Povey
c7e8a7349d Increase dim of middle satck from 512 to 768 2023-06-19 02:16:59 +08:00
Daniel Povey
01ed3bbcc4 Make encoder dims mostly 512. 2023-06-18 04:02:21 +08:00
Daniel Povey
70bd58c648 Fix print_diagnostics break statement 2023-06-18 03:55:13 +08:00
Daniel Povey
e9668a5cfd Fix break in fix_diagnostics mode 2023-06-18 03:36:13 +08:00
Daniel Povey
5a8cabd429 Fix max_eig arg to TensorDiagnosticsOptions 2023-06-18 03:28:57 +08:00
Daniel Povey
7d7fc45ab2 Revert model-size changes 2023-05-30 14:49:42 +08:00
Daniel Povey
e313674dc7 Reduce batch size to 15 2023-05-29 17:38:11 +08:00
Daniel Povey
5fbbeb1d29 Try batch size of 16 2023-05-29 17:34:00 +08:00
Daniel Povey
cd36d149df Reduce encoder-dim and num-heads of center stack. 2023-05-29 17:32:49 +08:00
Daniel Povey
cdd9cf695f Fix bug regarding --start-batch option 2023-05-29 16:41:54 +08:00
Daniel Povey
16e51a7deb remove find_unused_parameters=True and use bypass module 2023-05-29 11:54:21 +08:00
Daniel Povey
38246c8690 Revert "find_unused_parameters=True removed" 
This reverts commit ba337f8554c2b0b7e0ab3462027de59862cb95dc.
 2023-05-29 11:51:09 +08:00
Daniel Povey
ba337f8554 find_unused_parameters=True removed 2023-05-29 11:47:03 +08:00
Daniel Povey
137ac513bf Some changes to try to reduce mem consumption; decrease batch size 2023-05-28 21:50:34 +08:00
Daniel Povey
815cc1ba4f Add another middle stack; batch size 18->16. 2023-05-28 20:23:30 +08:00
Daniel Povey
d045ef7ce7 Change default lr from 0.025 to 0.035 2023-05-28 15:42:54 +08:00
Daniel Povey
da80241179 Use larger valid set; get --print-diagnostics=True to work 2023-05-28 15:17:09 +08:00
Daniel Povey
105fb56db4 Make base-lr default 0.025 2023-05-24 16:30:23 +08:00
Daniel Povey
8483ca2e8f More partial work 2023-05-24 16:04:05 +08:00
Daniel Povey
8dc070ce37 Increase all ff dims; decrease batch size. 2023-05-20 13:35:23 +08:00
Daniel Povey
7d162bf41e mOve where srand called 2023-05-19 16:43:21 +08:00
Daniel Povey
f37ec0f0da Include start batch in seed 2023-05-19 16:39:13 +08:00
Daniel Povey
26cf13a3e1 Revert batch size to 20 2023-05-18 14:04:14 +08:00
Daniel Povey
5cd2df0cd6 Increase batch size from 20 to 22 2023-05-18 13:57:26 +08:00
Daniel Povey
15aca1fb4a Simplify dataloader code 2023-05-18 13:55:52 +08:00
Daniel Povey
eb64130787 Reverse zlm9..zlm12 2023-05-17 17:31:24 +08:00
Daniel Povey
5d7517e382 Set batch size back to 20 2023-05-17 14:56:38 +08:00
Daniel Povey
8fce9a05fc Revert batch size to 18 2023-05-17 14:53:53 +08:00
Daniel Povey
844844a02d Reduce batch size from 21 to 20 2023-05-17 14:28:56 +08:00
Daniel Povey
e25929c256 Reduce batch size to 21 2023-05-17 13:24:26 +08:00
Daniel Povey
e4246f6ba3 Reduce batch size from 24 to 22 2023-05-17 13:20:23 +08:00
Daniel Povey
6dce7e251d Increase batch size 2023-05-17 13:17:00 +08:00
Daniel Povey
30ace76fbc Add depthwise conv to decoder 2023-05-17 11:26:41 +08:00
Daniel Povey
a405106d2f Add 1-d convolution to text embedding module; reduce batch size 2023-05-16 20:05:52 +08:00
Daniel Povey
399a79ace6 Change chunk-size setup 2023-05-16 19:47:23 +08:00
Daniel Povey
a6eb45840a Reduce batch size 2023-05-16 17:39:59 +08:00
Daniel Povey
0412d19f50 Increase batch size 2023-05-16 16:33:17 +08:00
Daniel Povey
3f72813a96 Various bug fixes, implementing chunking 2023-05-16 16:27:09 +08:00
Daniel Povey
0006a4c4db Implement chunk sizes, to the extent that the program runs. 2023-05-16 16:13:20 +08:00
Daniel Povey
4562b25a6a Remove unused options 2023-05-16 14:25:19 +08:00
Daniel Povey
465d41c429 Increase batch size 2023-05-16 12:13:13 +08:00
Daniel Povey
0a76215fd7 Code cleanup 2023-05-15 22:01:19 +08:00
Daniel Povey
532f95a627 Reduce batch size slightly 2023-05-15 20:13:48 +08:00
Daniel Povey
a397a5973b Increase num parameters 2023-05-15 20:11:20 +08:00
Daniel Povey
047c6ffc58 First version of subformer that runs. 2023-05-15 16:03:01 +08:00
Daniel Povey
1b8be0744f Fix various bugs 2023-05-15 15:20:02 +08:00