docs: document dynamic plugin authoring by willkill07 · Pull Request #311 · NVIDIA/NeMo-Relay

willkill07 · 2026-06-25T17:27:24Z

Overview

Document dynamic plugin authoring across native Rust plugins, worker plugins, examples, and the grpc-v1 protocol.

Stack dependency: this PR cannot be merged until parent stacked PR #310 is merged: #310

I confirm this contribution is my own work, or I have the right to submit it under this project's license.
I searched existing issues and open pull requests, and this does not duplicate existing work.

Details

Add focused docs pages for native dynamic plugins, worker dynamic plugins, Rust native example, Python worker example, and the high-level grpc-v1 protocol.
Update build-plugin navigation and manifest examples for plugin SemVer compatibility.
Keep skills updates out of this docs PR.

Validation run across the completed stack:

cargo test -p nemo-relay-types
cargo test -p nemo-relay-plugin
cargo test -p nemo-relay-worker-proto
cargo test -p nemo-relay-worker
cargo check -p nemo-relay-cli

Where should the reviewer start?

Start with docs/build-plugins/native-dynamic-plugins.mdx and docs/build-plugins/grpc-worker-protocol.mdx.

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

Relates to: feat: implement dynamic plugin host policy and attestation gates #302
Relates to: feat: add explicit plugin config file override #230

coderabbitai · 2026-06-25T17:27:32Z

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Enterprise

Run ID: 32ce915c-8de9-47a4-9097-455097fce025

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests

_{Comment @coderabbitai help to get the list of available commands.}

github-actions · 2026-06-25T17:31:46Z

Fern docs preview: https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay (https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay)

github-actions · 2026-06-25T23:29:20Z

Fern docs preview: https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay (https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay)

github-actions · 2026-06-25T23:48:59Z

Fern docs preview: https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay (https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay)

github-actions · 2026-06-26T00:29:38Z

Fern docs preview: https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay (https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay)

github-actions · 2026-06-26T00:55:09Z

Fern docs preview: https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay (https://nvidia-preview-pull-request-311.docs.buildwithfern.com/nemo/relay)

Signed-off-by: Will Killian <wkillian@nvidia.com>

github-actions · 2026-06-26T02:37:15Z

License Diff

Compared against origin/main.

Lockfile license changes

Lockfile License Changes

Rust

Added

fixedbitset 0.5.7 (Apache-2.0)
multimap 0.10.1 (Apache-2.0)
petgraph 0.8.3 (Apache-2.0)
prost-build 0.14.3 (Apache-2.0)
prost-types 0.14.3 (Apache-2.0)
protoc-bin-vendored 3.2.0 (MIT)
protoc-bin-vendored-linux-aarch_64 3.2.0 (MIT)
protoc-bin-vendored-linux-ppcle_64 3.2.0 (MIT)
protoc-bin-vendored-linux-s390_64 3.2.0 (MIT)
protoc-bin-vendored-linux-x86_32 3.2.0 (MIT)
protoc-bin-vendored-linux-x86_64 3.2.0 (MIT)
protoc-bin-vendored-macos-aarch_64 3.2.0 (MIT)
protoc-bin-vendored-macos-x86_64 3.2.0 (MIT)
protoc-bin-vendored-win32 3.2.0 (MIT)
pulldown-cmark 0.13.4 (MIT)
pulldown-cmark-to-cmark 22.0.0 (Apache-2.0)
tonic-build 0.14.6 (MIT)
tonic-prost-build 0.14.6 (MIT)
unicase 2.9.0 (Apache-2.0)

Removed

None

Updated/Changed

`hashbrown`

Before:

hashbrown 0.15.5 (MIT OR Apache-2.0)
hashbrown 0.17.0 (Apache-2.0)

After:

hashbrown 0.15.5 (Apache-2.0)
hashbrown 0.17.0 (Apache-2.0)

`prettyplease`

Before:

prettyplease 0.2.37 (MIT OR Apache-2.0)

After:

prettyplease 0.2.37 (Apache-2.0)

`sha2`

Before:

sha2 0.11.0 (Apache-2.0)

After:

sha2 0.10.9 (Apache-2.0)
sha2 0.11.0 (Apache-2.0)

Node

Added

None

Removed

None

Updated/Changed

None

Python

Added

grpcio 1.81.1 (Apache-2.0)

Removed

None

Updated/Changed

None

Status output

[license-diff] selected languages: rust, node, python
[license-diff] generating current inventory
[license-diff] current: generating Rust inventory
[license-diff] current: Rust inventory complete (364 packages)
[license-diff] current: generating Node inventory
[license-diff] current: Node inventory complete (364 packages)
[license-diff] current: generating Python inventory
[license-diff] current: Python inventory complete (105 packages)
[license-diff] current inventory complete
[license-diff] checking out base ref origin/main into a temporary worktree
[license-diff] base: generating Rust inventory
[license-diff] base: Rust inventory complete (344 packages)
[license-diff] base: generating Node inventory
[license-diff] base: Node inventory complete (364 packages)
[license-diff] base: generating Python inventory
[license-diff] base: Python inventory complete (104 packages)
[license-diff] base inventory complete
[license-diff] removing temporary base worktree
[license-diff] comparing inventories
[license-diff] rendering Markdown output
[license-diff] done

github-actions Bot added size:XXL PR is very large Documentation documentation-related lang:python PR changes/introduces Python code lang:rust PR changes/introduces Rust code labels Jun 25, 2026

willkill07 mentioned this pull request Jun 25, 2026

chore(skills): add dynamic plugin maintainer guidance #312

Draft

2 tasks

copy-pr-bot Bot temporarily deployed to fern June 25, 2026 17:27 Inactive

willkill07 self-assigned this Jun 25, 2026

willkill07 added this to the 0.5 milestone Jun 25, 2026

willkill07 force-pushed the wkk_dynamic-plugin-7-docs branch from 93a8ad2 to aab0429 Compare June 25, 2026 18:16

copy-pr-bot Bot temporarily deployed to fern June 25, 2026 18:17 Inactive

willkill07 force-pushed the wkk_dynamic-plugin-7-docs branch from aab0429 to 54b791f Compare June 25, 2026 18:44

copy-pr-bot Bot temporarily deployed to fern June 25, 2026 18:44 Inactive

willkill07 force-pushed the wkk_dynamic-plugin-7-docs branch from 54b791f to 0215bd5 Compare June 25, 2026 19:03

copy-pr-bot Bot temporarily deployed to fern June 25, 2026 19:03 Inactive

willkill07 force-pushed the wkk_dynamic-plugin-7-docs branch from 0215bd5 to be7897a Compare June 25, 2026 23:21

copy-pr-bot Bot temporarily deployed to fern June 25, 2026 23:21 Inactive

willkill07 force-pushed the wkk_dynamic-plugin-7-docs branch from be7897a to 29d6a2c Compare June 25, 2026 23:40

copy-pr-bot Bot temporarily deployed to fern June 25, 2026 23:40 Inactive

willkill07 force-pushed the wkk_dynamic-plugin-7-docs branch from 29d6a2c to f617c36 Compare June 26, 2026 00:19

copy-pr-bot Bot temporarily deployed to fern June 26, 2026 00:20 Inactive

willkill07 force-pushed the wkk_dynamic-plugin-7-docs branch from f617c36 to 69ea5e1 Compare June 26, 2026 00:45

copy-pr-bot Bot temporarily deployed to fern June 26, 2026 00:45 Inactive

willkill07 added 2 commits June 25, 2026 22:20

feat(plugin): add native Rust plugin SDK

93e5b53

Signed-off-by: Will Killian <wkillian@nvidia.com>

feat(plugin): load rust_dynamic plugins in relay

54be92c

Signed-off-by: Will Killian <wkillian@nvidia.com>

willkill07 added 4 commits June 25, 2026 22:27

feat(worker): add grpc-v1 protocol and Rust worker SDK

ff285ce

Signed-off-by: Will Killian <wkillian@nvidia.com>

feat(worker): activate grpc-v1 worker plugins in relay

712f900

Signed-off-by: Will Killian <wkillian@nvidia.com>

feat(python): add nemo-relay-plugin worker SDK package

a29a7bd

Signed-off-by: Will Killian <wkillian@nvidia.com>

docs: document dynamic plugin authoring

3ce55f0

Signed-off-by: Will Killian <wkillian@nvidia.com>

willkill07 force-pushed the wkk_dynamic-plugin-7-docs branch from 69ea5e1 to 3ce55f0 Compare June 26, 2026 02:28

copy-pr-bot Bot temporarily deployed to fern June 26, 2026 02:28 Inactive

Uh oh!

Conversation

willkill07 commented Jun 25, 2026

Overview

Details

Where should the reviewer start?

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

Uh oh!

coderabbitai Bot commented Jun 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Review skipped

Uh oh!

github-actions Bot commented Jun 25, 2026

Uh oh!

github-actions Bot commented Jun 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jun 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jun 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jun 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Jun 26, 2026

License Diff

Lockfile License Changes

Rust

Added

Removed

Updated/Changed

hashbrown

prettyplease

sha2

Node

Added

Removed

Updated/Changed

Python

Added

Removed

Updated/Changed

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

coderabbitai Bot commented Jun 25, 2026 •

edited

Loading

github-actions Bot commented Jun 25, 2026 •

edited

Loading

github-actions Bot commented Jun 25, 2026 •

edited

Loading

github-actions Bot commented Jun 26, 2026 •

edited

Loading

github-actions Bot commented Jun 26, 2026 •

edited

Loading

`hashbrown`

`prettyplease`

`sha2`