What if your local machine could run high-throughput LLMs, multimodal models, or even fine-tune small AI models with GPU acceleration? In this new episode of AI Guide to the Galaxy, Oleg sits down with Eric from the Docker Model Runner team to explore how the project is evolving to make all of that possible. 🎙️ In this episode: - How Docker Model Runner is expanding support for engines like VLLM and NVIDIA NIMs - Running models on AMD GPUs and integrated graphics via Vulkan - Using multimodal m

1K views |  Docker Model Runner just got a major upgrade. We now...