Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
192 changes: 192 additions & 0 deletions blog/hami-dra-npu-sharing/index.md

Large diffs are not rendered by default.

192 changes: 192 additions & 0 deletions i18n/zh/docusaurus-plugin-content-blog/hami-dra-npu-sharing/index.md

Large diffs are not rendered by default.

3 changes: 3 additions & 0 deletions i18n/zh/docusaurus-plugin-content-blog/tags.yml
Original file line number Diff line number Diff line change
Expand Up @@ -97,6 +97,9 @@
"软切分":
label: "软切分"
permalink: "/soft-slicing"
"NPU 共享":
label: "NPU 共享"
permalink: "/npu-sharing"
"Release":
label: "Release"
permalink: "/release"
Expand Down

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -32,4 +32,6 @@ import LabCardGridAuto from '@site/src/components/labs/LabCardGridAuto';
- **实验 14** 在挂载四块 T4 的 GKE 节点上安装 HAMi v2.10.0,并通过分配注解与调度器日志观察可组合的 `gpu-scheduler-policy` 策略链(`spread`、`binpack`、`mutex`、`mutex,binpack`)。
- **实验 16** 在配备 7 张 RTX PRO 6000 的服务器上安装 HAMi v2.10.0,并验证完整的 Dynamic MIG 生命周期:按 Pod 创建 MIG、混合规格、选择性回收、device plugin 重启恢复以及跨 GPU 调度。
- **实验 17** 将模型打包为 KitOps ModelKit,通过 initContainer 从 Jozu Hub 拉取,并使用 SGLang(可选 vLLM)在 HAMi GPU 共享资源上提供服务。
- **实验 18** 在两张共享 GPU 上同时运行吵闹邻居与安静租户负载,验证 HAMi 隔离能覆盖与不能覆盖的边界,并使用 Linkerd 让敏感流量绕开竞争。
- **实验 19** 在 310P3 节点上安装 HAMi 2.10.0 与昇腾设备插件,验证模板硬切(`vir01`、`vir02`、`vir04`)、多 Pod 共卡、容量耗尽、整卡互斥和分配指标。
- **实验 20** 在昇腾 310P3 节点上安装 HAMi DRA 0.2.3 与 Ascend DRA Driver,验证请求到 ResourceClaim 的转换、双 Pod NPU 共享、显存配额隔离与调度器容量记账。
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,12 @@
"kserve":
label: "KServe"
permalink: "/kserve"
"kitops":
label: "KitOps"
permalink: "/kitops"
"modelkit":
label: "ModelKit"
permalink: "/modelkit"
"nvidia":
label: "nvidia"
permalink: "/nvidia"
Expand Down
5 changes: 5 additions & 0 deletions sidebars-tutorials.js
Original file line number Diff line number Diff line change
Expand Up @@ -106,6 +106,11 @@ module.exports = {
id: "labs/hami-ascend-vnpu-slicing",
customProps: { level: "Intermediate", duration: "about 60 minutes" },
},
{
type: "doc",
id: "labs/ascend-hami-dra",
customProps: { level: "Advanced", duration: "about 120 minutes" },
},
],
},
],
Expand Down
3 changes: 3 additions & 0 deletions static/img/hami-dra-npu-sharing/dra-model-zh.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions static/img/hami-dra-npu-sharing/dra-model.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions static/img/hami-dra-npu-sharing/hami-dra-design-zh.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions static/img/hami-dra-npu-sharing/hami-dra-design.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions static/img/hami-dra-npu-sharing/webhook-conversion-zh.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions static/img/hami-dra-npu-sharing/webhook-conversion.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions static/img/hami-dra-npu-sharing/where-hami-stuck-zh.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions static/img/hami-dra-npu-sharing/where-hami-stuck.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading