Observability for AI Workloads
Follow a request through a Kubernetes AI service and use traces, metrics, and logs to diagnose model and retrieval problems.
What you'll learn
- Measure time to first token, throughput, and queue pressure
- Collect OpenTelemetry signals and correlate traces with logs
- Choose indicators and route actionable alerts
Who this is for
- • DevOps engineers deepening their expertise
- • SREs building production-grade systems
- • Backend developers expanding into infrastructure
Prerequisites
- • A Mac that can run a local Kubernetes cluster, and familiarity with kubectl.
Course content
2 modules, 6 lessons, 21m of video
Module 1
3 lessons, 11 min
4 min
Time to first token, tokens per second, queue depth, errors, accelerator memory and cost per request.
4 min
Prometheus scrapes the model servers; the OpenTelemetry Collector carries metrics, traces and logs.
4 min
A catalog of indicators, and a check that fails a change which breaks it.
Module 2
3 lessons, 10 min
5 min
Alertmanager routes per team and severity, inhibition for symptoms, silences for planned work.
4 min
Loki, the collector reading pod logs, and one request id that joins them.
3 min
Spans, the traceparent header, and Tempo: find the slow step in one look.
Get started
Start Free LessonFirst lesson is always free — no signup required
This course includes
Want all courses?
See Pro plan →Your instructor

Founder and CEO, Open Empower. About the author
More in AI Agents
All courses in this trackOpenClaw: Your First AI Agent
Deploy OpenClaw locally or on a small VPS, add real tools, create one reusable automation, and apply essential security guardrails. You'll leave with a working 'Ops Assistant' that generates a Daily Brief, creates an Action Queue, and does it all safely.
Beginner · 7 lessons · 1 h
Preview free lesson
Claude Code Masterclass: Ship Real Code with AI
Stop treating AI like a magic autocomplete and start using it like a sharp junior engineer who sits next to you — one you direct, review, and hold accountable. In 10 hands-on modules you'll master the Plan → Implement → Test → Review → Commit loop and use it to ship real, tested code with Claude Code: Best-of-N, honest test suites, safe git workflows, multimodal prompts, refactoring & docs, reusable skills, the GitHub MCP server, lifecycle hooks, and a production-readiness checklist. You stay the engineer of record — Claude proposes, you decide what ships.
Intermediate · 10 lessons · 5 h
Preview free lesson
MLflow on Kubernetes: ML at Scale
Build scalable MLOps with MLflow, KServe, Docker, and Kubernetes. Automate deployments, monitor models, and workflows. Learn to deploy ML models to Kubernetes at scale, implement CI/CD pipelines, track experiments, perform hyperparameter tuning, and build production-ready ML services.
Intermediate · 15 lessons · 1 h 28 min
Preview free lesson