What if your local machine could run high-throughput LLMs, multimodal models, or even fine-tune small AI models with GPU acceleration? In this new episode of AI Guide to the Galaxy, Oleg sits down with Eric from the Docker Model Runner team to explore how the project is evolving to make all of that possible. 🎙️ In this episode: - How Docker Model Runner is expanding support for engines like VLLM and NVIDIA NIMs - Running models on AMD GPUs and integrated graphics via Vulkan - Using multimodal m
What if your local machine could run high-throughput LLMs, multim…
781 views3 months ago
FacebookDocker
1.2K views | ⌛ Build GenAI apps in minutes—not weeks. Check out how...
1:35
1.2K views | ⌛ Build GenAI apps in minutes—not weeks. Check out h…
2K views1 week ago
FacebookDocker
1K views |  Docker Model Runner just got a major upgrade. We now...
5:10
1K views |  Docker Model Runner just got a major upgrade. We now...
2K views1 week ago
FacebookDocker
2.1K views · 21 reactions | Manage AI models like container images?...
2:14
2.1K views · 21 reactions | Manage AI models like container images?...
2K views1 week ago
FacebookDocker
You’ve got a model running locally. Now make it repeatable, shareable and scalable. Join us for a live webinar on Docker Model Runner to: - Test, run, and manage models locally with ease - Standardize runtimes so “works on my machine” actually holds - Streamline model distribution for your team and your CI Plus latest features like vLLM support from dev to production. Happening November 26, 2025 at 8 am PST, 11 am EST, 5 pm CET. With Eric Curtin and Eli Aleyner from Docker. Register here: https:
0:08
You’ve got a model running locally. Now make it repeatable, shareabl…
2K views2 months ago
FacebookDocker
Run Docker Containers using Podman and Libpod | ComputingForGeeks
Run Docker Containers using Podman and Libpod | ComputingF…
40.8K viewsJul 18, 2024
computingforgeeks.com
Tired of juggling GPUs, configs, and cloud costs just to build an AI chatbot? Ajeet Raina shows how to skip the complexity and run a full-stack AI chatbot locally using Docker Model Runner. You’ll learn how to: - Run Llama 3.2 locally with streaming responses - Add real-time metrics using Prometheus and Grafana - Enable distributed tracing with Jaeger - Deploy everything with a single Docker Compose command Built with React, Go, and Docker, this demo puts performance, observability, and data pri
1:09
Tired of juggling GPUs, configs, and cloud costs just to build an AI cha…
2K views5 months ago
FacebookDocker
0:13
If you haven’t tried Gordon recently, you’re missing out. Docker’s AI ag…
2K views5 months ago
FacebookDocker
0:50
Tired of wrestling with AI runtimes? Episode 7 of AI Guide to the Galax…
2K views2 months ago
FacebookDocker
Comparing 3 Docker container runtimes - Runc, gVisor and Kata …
2 weeks ago
dev.to
Nvidia-Docker Setup - Accessing GPU within Docker containers
42K viewsFeb 16, 2018
YouTubeMelvin L
Register Docker Runner/Executor with GitLab Server to Run Pipelines
22.2K viewsSep 8, 2023
YouTubeBuild With LaL
本地LLM部署新革命：Open WebUI + Docker Model Runner 一步到位安 …
194 views6 months ago
YouTube大雷早上好
Setting Up - Tutorial 00 - PyCharm + Docker + Windows
12.3K viewsSep 30, 2022
YouTubeUnify
Put your gaming GPU to work! Remote machine learning on Wind…
28.1K viewsApr 24, 2024
YouTubeTailscale
How to train a deep learning model using docker?
37.5K viewsJul 9, 2020
YouTubeAbhishek Thakur
Docker Model Runner, will it be a Ollama Killer ?
2.6K views10 months ago
YouTubeExecute Automation
56:20
Building a GPU cluster for AI
150.5K viewsOct 6, 2020
YouTubeLambda
1:55
Using NVIDIA GPU Cloud with Docker, Part 1
20.9K viewsMay 17, 2018
YouTubeNVIDIA Developer
14:59
Docker Dashboard Using Grafana, Prometheus & Node Exporter
66.1K viewsDec 21, 2020
YouTubeDB Tech
16:29
GPU Accelerated Machine Learning with WSL 2
26.8K viewsOct 8, 2020
YouTubeMicrosoft Developer
4:40
Using NVIDIA GPU Cloud with Docker, Part 2
12K viewsMay 17, 2018
YouTubeNVIDIA Developer
18:08
Monitoring Docker using Prometheus and grafana
31.9K viewsMay 13, 2020
YouTubeDeekshith SN
17:11
How to use GPU transcoding in an Emby or Plex container on Unraid
126K viewsFeb 13, 2019
YouTubeSpaceinvader One
4:55
Demo: Using NVIDIA GPUs with Jupyter Notebooks on Red Hat Op…
14.3K viewsApr 23, 2021
YouTubeOpenShift
15:10
Docker Tutorial 3-Deploying Machine Learning Models Using Fl…
50.8K viewsMay 17, 2020
YouTubeKrish Naik
31:24
How to manage Docker containers and hosts using a Web GUI - Easy …
5.1K viewsMay 11, 2021
YouTubeElastiCourse
11:05
Tutorial 7: Deploying Machine Learning Models In Azure Cloud
99.3K viewsJan 17, 2020
YouTubeKrish Naik
16:58
Build and Run a Docker Container for your Machine Learning Model (…
35.1K viewsAug 4, 2021
YouTubeData Science Garage
7:50
Cloud Run QuickStart - Docker to Serverless
207.8K viewsApr 10, 2019
YouTubeFireship
See more videos
Static thumbnail place holder