GenAI Ops on Your Mac: RAG, Guardrails and Evaluations
Build a handbook assistant that cites its sources, measure retrieval quality, and add guardrails and evaluations before release.
What you'll learn
- Index and query documents with Chroma and Ollama
- Compare chunking, filters, and reranking
- Run evaluation gates in CI and review the results
Who this is for
- • DevOps engineers deepening their expertise
- • SREs building production-grade systems
- • Backend developers expanding into infrastructure
Prerequisites
- • An Apple Silicon Mac, Python, and Ollama.
Course content
2 modules, 6 lessons, 21m of video
Module 1
3 lessons, 11 min
5 min
Local embeddings, a Chroma vector store and a chat model, all on your Mac.
4 min
Chunk size, overlap, metadata filters and re-indexing, measured on the same questions.
4 min
How many chunks to send, whether a reranker helps, and a minimum score.
Module 2
3 lessons, 10 min
4 min
Input and output rails on the local model: off-topic, jailbreak, personal data, secrets.
4 min
Faithfulness and answer relevancy with Ragas, judged by the local model.
3 min
Minimum scores and a baseline, run on every change by a runner on the Mac.
Get started
Start Free LessonFirst lesson is always free — no signup required
This course includes
Want all courses?
See Pro plan →Your instructor

Founder and CEO, Open Empower. About the author
More in AI Agents
All courses in this trackOpenClaw: Your First AI Agent
Deploy OpenClaw locally or on a small VPS, add real tools, create one reusable automation, and apply essential security guardrails. You'll leave with a working 'Ops Assistant' that generates a Daily Brief, creates an Action Queue, and does it all safely.
Beginner · 7 lessons · 1 h
Preview free lesson
Claude Code Masterclass: Ship Real Code with AI
Stop treating AI like a magic autocomplete and start using it like a sharp junior engineer who sits next to you — one you direct, review, and hold accountable. In 10 hands-on modules you'll master the Plan → Implement → Test → Review → Commit loop and use it to ship real, tested code with Claude Code: Best-of-N, honest test suites, safe git workflows, multimodal prompts, refactoring & docs, reusable skills, the GitHub MCP server, lifecycle hooks, and a production-readiness checklist. You stay the engineer of record — Claude proposes, you decide what ships.
Intermediate · 10 lessons · 5 h
Preview free lesson
MLflow on Kubernetes: ML at Scale
Build scalable MLOps with MLflow, KServe, Docker, and Kubernetes. Automate deployments, monitor models, and workflows. Learn to deploy ML models to Kubernetes at scale, implement CI/CD pipelines, track experiments, perform hyperparameter tuning, and build production-ready ML services.
Intermediate · 15 lessons · 1 h 28 min
Preview free lesson