跳到主内容
智客 ZICQ

技能库 智客分类:运维与云 docker-ai-ml

Docker Ai Ml

Guidance for running AI/ML workloads on Docker. Covers Docker Model Runner (docker model pull/run for local LLMs), Docker Agent (multi-agent orchestration for coding tasks), Docker Sandboxes for isolated AI agent execution, GPU acceleration (nvidia-container-toolkit, --gpus flag), AI model serving with Docker, and running open-source LLMs (Llama, Gemma, Qwen) locally. Use when the user asks about docker ai, docker model runner, local LLM, docker agent, GPU docker, sandbox, model serving, or needs to deploy AI models with Docker. 使用场景:docker ai、model runner、本地LLM、docker agent、GPU docker、sandbox、AI模型部署.

77 安装量

官方网址:skills.sh

技能介绍

先看中文介绍;官方 description 原文单独保留,不改写 SKILL.md。

做什么

运行 Docker 的AI/ML 工作量指南 。 覆盖多克模型跑取器(为本地LLMS提供多克模型拉出/运行),多克代理器(用于编码任务的多代理管弦乐),用于孤立的AI代理执行的多克桑德盒,GPU加速(nvidia-container-toolkit,-gpus旗),与多克一起服务的AI模型,以及在当地运行开源LLLMS(Llama,Gemma,Quen)

何时用

** 用户提到时总是使用这种技能:**

代理如何加载

按 Agent Skills 渐进披露:启动时只加载 name 与 description(约 100 token);任务匹配后才读入整份 SKILL.md 正文;scripts/、references/、assets/ 仅在需要时再读。 本文件正文结构:Docker AI/ML — AI 工作负载、When to Use、Docker Model Runner、List available models、Pull a model、Run inference。

文件分析

文件分析:这是一份仅含 SKILL.md 的指令型技能,代理激活后整份正文进入上下文。

Docker AI/ML — AI 工作负载When to UseDocker Model RunnerList available modelsPull a modelRun inferenceInteractive chatAPI server mode→ access at http://localhost:11434/v1Install Skills for AI Coding AssistantsInstall skills for Claude CodeFor Codex CLI

· 许可:Apache-2.0

来源分类:skills.sh agent-skill

SKILL.md 与 Agent 调用

官方规范 ↗
name
docker-ai-ml
description
Guidance for running AI/ML workloads on Docker. Covers Docker Model Runner (docker model pull/run for local LLMs), Docker Agent (multi-agent orchestration for coding tasks), Docker Sandboxes for isolated AI agent execution, GPU acceleration (nvidia-container-toolkit, --gpus flag), AI model serving with Docker, and running open-source LLMs (Llama, Gemma, Qwen) locally. Use when the user asks about docker ai, docker model runner, local LLM, docker agent, GPU docker, sandbox, model serving, or needs to deploy AI models with Docker. 使用场景:docker ai、model runner、本地LLM、docker agent、GPU docker、sandbox、AI模型部署.
许可
Apache-2.0
  1. 发现技能客户端向 Agent 提供名称与描述目录。
  2. 匹配与调用用户指定或任务匹配后,载入 SKILL.md 指令。
  3. 按需加载按步骤读取参考文档、使用脚本与素材。

具体调用语法与可用工具以目标 Agent 客户端为准。 查看调用机制说明 ↗

安装这个技能

Skills CLI ↗

先选择目标 Agent 和安装范围,保留技能包的附属文件,安装后检查客户端能否发现该技能。

交给 Agent 安装

复制安装指令给支持 Agent Skills 的代理,确认其中的目标目录与客户端匹配。

把 Agent Skill「docker-ai-ml」安装到我的项目:SKILL.md 原文与官方 description 见 https://zicq.com/zh/skills/skl-cfb6ac588c432672-%E5%A4%9A%E5%85%8B%E7%88%B1Ml.html
请存为 .cursor/skills/docker-ai-ml/SKILL.md 或 .claude/skills/docker-ai-ml/SKILL.md,frontmatter 的 name 与 description 保持原样,不要改写。

GitHub 完整包 ↗

终端安装 · Skills CLI

需要 Node.js 与 npx。先查看仓库技能列表,确认实际名称。

npx skills add 'https://github.com/full-stack-skills/docker-skills' --list

npx skills add 'https://github.com/full-stack-skills/docker-skills' --skill 'docker-ai-ml'

CLI 会交互选择目标 Agent,默认安装到项目;用户级安装使用 -g。先通过查看命令核对仓库内容,再用 npx skills list 检查已安装技能。

阅读排版
--- name: docker-ai-ml description: Guidance for running AI/ML workloads on Docker. Covers Docker Model Runner (docker model pull/run for local LLMs), Docker Agent (multi-agent orchestration for coding tasks), Docker Sandboxes for isolated AI agent execution, GPU acceleration (nvidia-container-toolkit, --gpus flag), AI model serving with Docker, and running open-source LLMs (Llama, Gemma, Qwen) locally. Use when the user asks about docker ai, docker model runner, local LLM, docker agent, GPU docker, sandbox, model serving, or needs to deploy AI models with Docker. 使用场景:docker ai、model runner、本地LLM、docker agent、GPU docker、sandbox、AI模型部署. license: Apache-2.0 --- # Docker AI/ML — AI 工作负载 Guidance for running AI models and agents on Docker. ## When to Use **ALWAYS use this skill when the user mentions:** - "docker ai", "docker model", "model runner" - "本地 LLM", "local model", "offline model" - "docker agent", "AI agent" - "GPU docker", "nvidia docker" - "sandbox", "沙箱" - "LLM 部署", "模型部署" ## Docker Model Runner ```bash # List available models docker model ls # Pull a model docker model pull ai/gemma3 docker model pull ai/qwen2.5 # Run inference docker model run ai/gemma3 "Explain Docker in one sentence" # Interactive chat docker model run -i ai/gemma3 # API server mode docker model serve ai/gemma3 --port 11434 # → access at http://localhost:11434/v1 ``` ### Install Skills for AI Coding Assistants ```bash # Install skills for Claude Code docker model skills --claude # For Codex CLI docker model skills --codex ``` ## GPU Configuration ```bash # Install NVIDIA Container Toolkit (once) # Ubuntu/Debian: sudo apt-get install -y nvidia-container-toolkit sudo systemctl restart docker # Run with GPU access docker run --gpus all -it nvidia/cuda:12.6-base nvidia-smi # Specific GPU docker run --gpus device=0 -it nvidia/cuda:12.6-base # GPU + Model Runner docker model run --gpus all ai/llama3.2 ``` ## Docker Agent ```yaml # agent.yaml — Define a multi-agent system name: my-coding-agent model: provider: openai model: gpt-4o tools: - write_file - execute_command - web_search sandbox: image: node:22-alpine workdir: /workspace ``` ```bash # Run agent with Docker docker agent run -f agent.yaml "Fix the bug in src/app.js" ``` ## Docker Sandbox ```yaml # Isolated execution environment for AI agents sandbox: image: python:3.12-slim network: none # No network access read_only: true # Read-only filesystem memory: 512m cpus: 1 ``` ## Local LLM Stack ```bash # Ollama (open-source) as alternative docker run -d --name ollama \ -p 11434:11434 \ -v ollama_data:/root/.ollama \ --gpus all \ ollama/ollama # Download and run model docker exec ollama ollama pull llama3.2 docker exec ollama ollama run llama3.2 "Hello" ``` ## Workflow — 推荐使用流程 Step 1: **选择推理方案**: Docker Model Runner (`docker model`) 优先,Ollama 备选 Step 2: **检查硬件**: GPU 需 Linux + nvidia-container-toolkit;CPU 推理需 8-32GB RAM Step 3: **拉取模型**: `docker model pull ` 或 `ollama pull ` Step 4: **启动服务**: `docker model run` 或 `ollama serve` + 客户端 Step 5: **验证**: 发送测试 prompt 确认模型正常响应 ## Gotchas — Common Pitfalls - **GPU not available**: Docker Desktop Mac/Windows has limited GPU passthrough. → **Recovery**: Full GPU support requires Linux host + nvidia-container-toolkit; for Mac, use `docker model` which can offload inference. - **Model download size**: LLMs are large (2-70 GB). → **Recovery**: `docker model pull` caches models in `~/.docker/models`; check `df -h` before pulling; use quantized models (Q4/Q8) for smaller footprint. - **Memory limits**: LLM inference needs significant RAM (8-32 GB typical). → **Recovery**: `docker run --memory=16g model-runner`; check RAM: `free -h`; use smaller models (7B instead of 70B) if limited. - **Model Runner vs Ollama**: Docker Model Runner is Docker-native. Ollama has larger ecosystem. → **Recovery**: Use `docker model` for Docker integration; use Ollama for broader model selection; both can coexist. ## Boundary — 能力边界(适用与不适用场景) | 分类 | 场景 | 说明 | |------|------|------| | ✅ 能做 | 本地模型推理(Docker Model Runner / Ollama) | 拉取+运行开源 LLM,无需 API key | | ✅ 能做 | GPU 加速推理 | Linux 宿主机 + nvidia-container-toolkit | | ✅ 能做 | AI Agent 构建(Docker Agent / Sandboxes) | 多 agent 协作、沙箱隔离 | | ⚠️ 需条件 | macOS GPU 推理 | Docker Desktop 支持有限,优先用 `docker model` | | ⚠️ 需条件 | 大模型(70B+)推理 | 需 32GB+ RAM,考虑量化模型 | | ❌ 超范围 | 训练/微调模型 | 需专用框架(PyTorch/TensorFlow),不在本技能范围 | | ❌ 超范围 | 云端 API 调用(OpenAI/Claude) | 非本地推理,使用对应 SDK | | ❌ 超范围 | 生产模型 Serving(K8s) | 使用 `docker-production` + K8s 部署 | ## When NOT to Use This Skill | ❌ Skip | ✅ Use Instead | |---------|---------------| | Docker basics | `docker-basics` | | Building custom model images | `docker-build` | | Production model serving (K8s) | `docker-production` | | Cloud AI APIs (no Docker needed) | Direct API access | ## Security & Stability - Run model containers with `--read-only` when possible — models are read-only weights. - Limit network access for model containers. Local inference doesn't need internet. - GPU passthrough gives the container direct hardware access. Combine with `--security-opt` for isolation. - Monitor GPU memory usage: `nvidia-smi` for utilization. ## 📚 官方文档参考 | 文档 | 地址 | |------|------| | Docker AI 概述 | https://docs.docker.com/ai-overview/ | | Docker Model Runner | https://docs.docker.com/ai/model-runner/ | | Docker Model Runner 入门 | https://docs.docker.com/ai/model-runner/get-started/ | | Docker Agent | https://docs.docker.com/ai/docker-agent/ | | Docker Sandboxes | https://docs.docker.com/ai/sandboxes/ | | AI/ML 示例 | https://docs.docker.com/reference/samples/ai-ml/ | ## 🧭 Docker Skills Journey > 📍 **You are here: `docker-ai-ml` — AI/ML 工作负载** **← Prev**: `docker-testcontainers` — Integration testing ## FAQ **Q1: 如何快速上手此技能?** A: 参考上方的快速开始章节,按步骤操作即可。 **Q2: 遇到版本不兼容问题怎么办?** A: 检查依赖版本,使用 lock 文件锁定,参考常见陷阱章节。 **Q3: 如何在生产环境使用?** A: 参考最佳实践章节,确保配置正确,做好监控和日志。 **Q4: 性能如何优化?** A: 参考性能优化相关文档,使用缓存、索引等手段。 **Q5: 如何贡献或反馈问题?** A: 在 GitHub 仓库提交 Issue 或 Pull Request。 **Q6: 是否支持中文?** A: 支持中文文档和中文注释,详见国内适配章节。

相关技能

运维与云

Docker Essentials

用于容器管理,图像操作,调试的基本道克命令和工作流程.

运维与云

Find Skills

从开放的代理技能生态系统中发现并安装技能. 使用时:(1)用户问"我如何做X",X可能拥有现有技能,(2)用户说"为X找到技能"或"是否为X有技能",(3)用户问"你能否做X",X是专门能力,(4)用户想扩展代理能力,(5)用户想搜索工具,模板,或工作流程,(6)用户提到他们希望…

运维与云

Microsoft Foundry

构建,部署,评价,优化,微调,管理微软创始代理,模型,资源最终结束. 用法:铸造、azd ai代理、azd 提供/部署、托管代理脚手架/开发/运行/部署/拖放、即时代理创建、创建代理、更新代理、添加代理工具、援引代理、代理.yaml、评估代理、批量活化、连续活化、持续监测、代理C…

运维与云

Azure Deploy

执行已有.azure/部署计划.md和基础设施文件的ALREADY-PREPARED应用程序的Azure部署。 当用户向 CREATE 请求新应用程序时, 请不要使用此技能 。 这种技能运行了 azd上行, azd 部署, trarraform 应用, 和 az 部署命令带有内置…