marc
/
BrainDock
Template
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

compose-vLLM.yaml aktualisiert

This commit is contained in:
Marc Blatter 2026-07-10 18:40:15 +00:00
parent 9bd75107cf
commit a452f1c7fb
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
compose-vLLM.yaml
View File

@ -29,7 +29,7 @@ services:
- "--port" - "--port"
- "8000" - "8000"
- "--gpu-memory-utilization" - "--gpu-memory-utilization"
- "0.85" - "0.72"
- "--max-model-len" - "--max-model-len"
- "65536" - "65536"
- "--hf-overrides" - "--hf-overrides"