vLLM API access boundaries

vLLM API access boundaries An architecture diagram generated by Archify. Client · served-model-name / timeout · Architecture component Client served-model-name / timeout Authenticated gateway · path / method / request limits · Architecture component Authenticated gateway path / method / request limits Internal vLLM Service · API / metrics / operations · Architecture component Internal vLLM Service API / metrics / operations Operator · separate trusted privileges · Architecture component Operator separate trusted privileges HTTPS allowed requests operations Legend Backend Security External

API-key scope

  • • Prefix authentication does not protect every endpoint.
  • • CORS is not authentication; JSON model is not an HTTP header.