vLLM hosting setup configured to work in our setup with Traefik and nginx to limit exposed end-points.
This setup does not come with any authentication, but relies on correctly configured server firewalls to protect the exposed end-points.
AarhusAI/vllm-docker
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|