add preprocess v1

This commit is contained in:
saeedfirouzi 2025-11-08 14:27:59 +00:00
parent 826be2a19e
commit 9ed840c333

View File

@ -1,4 +1,4 @@
** DATASET ** DATASET for train
1-passage score does not have to be 0,1. it can be a range from 0 to 1 (0,0.25,0.5,0.75,1) : we can get this core by llm and apply it in loss calculation. 1-passage score does not have to be 0,1. it can be a range from 0 to 1 (0,0.25,0.5,0.75,1) : we can get this core by llm and apply it in loss calculation.