Learn how to run, manage and integrate AI workloads into Docker native toolset, like Docker Model Runner, MCP Toolkit, and Offload.
Course details
Unlock the power of large language models (LLMs) on your local machine using Docker Model Runner. In this course, join Docker Captain and DevOps Institute Ambassador Pawel Piwosz as he shows you how to set up and configure Docker Model Runner to run LLMs locallymaking them accessible from both containers and the host system. Explore how to pull and manage prebuilt models from Docker Hub, as well as package and distribute your own models. Along the way, learn how to integrate local LLMs into your applications using the familiar OpenAI API interface. Whether you're building prototypes, safeguarding privacy, or reducing inference costs, this course covers the tools you need to know to run powerful models without relying on the cloud.
Skills covered
Large Language Model Operations (LLMOps), Docker Products, Artificial Intelligence (AI), Docker

Homepage:
https://www.linkedin.com/learning/build-and-deploy-secure-ai-workloads-with-docker