Skip to main content
๐ŸŽค Luca Berton is speaking at Red Hat Summit & KubeCon EU 2026!Learn more โ†’

The inference gateway

Lesson in llm-d Distributed Inference Without GPUs ยท 4 min

Gateway API with the inference extension: an HTTPRoute to an InferencePool, an endpoint picker per request.

Sign in to continue

Sign in to access this lesson