5 — AI Integration, Model Serving & Agentic Systems

Integrating AI Model APIs, Self-Hosting and Agents A reference deck for working engineers By Md Ahbab Hamid Khan

What this deck covers 01 The core decision: hosted API or self-hosted 02 Integrating model APIs end to end 03 Self-hosting: formats, quantisation, serving, GPUs 04 Retrieval augmented generation, start to finish 05 Agents: loops, memory, guardrails, frameworks 06 Shipping it: streaming UI, safety, degradation 07 Exposing a service, evaluation, observability, cost 08 Appendix: six short hands-on labs 2

Assumed prerequisites ▪You write code daily in at least one language ▪Comfortable with HTTP, JSON, async and streaming responses ▪Familiar with Git, containers and basic Linux operations ▪You can read Python and JavaScript examples interchangeably ▪No machine learning background or prior model API use assumed ▪Costs and figures throughout are illustrative, not quotes 3