ITC 6730 — Operations and LLM Operations for Scalable AI
3 semester hoursGraduateLab
Covers deployment, management, and scaling machine learning and large language model systems in real-world, cloud-native environments. Emphasizes operationalization over model design, focusing on building reliable, reproducible, and governed AI systems. Offers students an opportunity to gain hands-on experience with pretrained models, automated training pipelines, deployment strategies, model monitoring, and version control while applying DevOps-inspired principles to the AI life cycle. Addresses the distinct challenges of generative AI including prompt management, embeddings, and retrieval-augmented generation.