bi/serve_embed
6
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

add batch_size

Browse Source
This commit is contained in:
SFirouzi 2026-03-14 11:27:39 +03:30
parent 6a90ff0a7e
commit cc60fce612
1 changed files with 14 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

16
README.md
View File

@ -2,5 +2,17 @@
## MODELS ## MODELS
1-GEMMA-300M model 1-GEMMA-300M model : gemma
2-GEMMA-300M model fin-tuned 2-GEMMA-300M model fine-tuned : gemma_train
3-BGE-M3 model fine-tuned : bge_train
## HOW TO RUN
docker build -f Dockerfile -t serve_embed:latest .
docker run -d --gpus all --network host --restart unless-stopped serve_embed:latest
## port
3037
## domain
https://embed.models.aiengines.ir/