Increase query-head-dim from 24 to 32.

This commit is contained in:
Daniel Povey 2022-11-09 13:28:29 +08:00
parent 364a4c3838
commit 423f9e3026

View File

@ -141,7 +141,7 @@ def add_model_arguments(parser: argparse.ArgumentParser):
parser.add_argument(
"--query-head-dim",
type=str,
default="24",
default="32",
help="Query/key dimension per head in encoder stacks: a single int or comma-separated list."
)