11 Commits

Author	SHA1	Message	Date
marcoyang	c0924f0a2f	register the weight and bias	2024-03-14 12:20:45 +08:00
marcoyang	6806810666	bug fix	2024-03-11 12:18:03 +08:00
marcoyang	3492d9415c	add lora version of ActivationDropouAndLinear; currently a simple version	2024-03-11 12:02:35 +08:00
marcoyang	bb8f6b0ef7	add lora to the in_proj of the feedforward module	2024-03-11 10:45:36 +08:00
marcoyang	5272a71ec9	also add lora in SelfAttention (for the value proj)	2024-03-08 10:40:18 +08:00
marcoyang	9bc1ad87b4	add script for decoding	2024-03-07 15:42:33 +08:00
marcoyang	a56034799b	first version of lora, could just run	2024-03-07 12:28:39 +08:00
marcoyang	87b19c0bd2	add finetune.py	2024-03-06 17:06:40 +08:00
marcoyang	3b3256a426	add files again	2024-03-06 17:02:21 +08:00
marcoyang	3c92bdb5fa	add more files	2024-03-06 12:28:20 +08:00
marcoyang	86a51e0771	initial commit	2024-03-05 18:30:43 +08:00