An Introduction to AI Infrastructure
Course: AI Infrastructure: LLM-D, vLLM and GPUs
Overview of AI infrastructure covering GPUs, model servers, caching, model parallelism, and orchestration for designing and operating scalable, low-latency AI systems.
Notes for the AI Infrastructure: LLM-D, vLLM and GPUs course: 14 lessons across 5 sections.