Skip to content

topk: add top-k kernel for MoE routers on Metal - #1124

Open
SunMarc wants to merge 4 commits into
huggingface:mainfrom
SunMarc:add-topk
Open

topk: add top-k kernel for MoE routers on Metal#1124
SunMarc wants to merge 4 commits into
huggingface:mainfrom
SunMarc:add-topk

Conversation

@SunMarc

@SunMarc SunMarc commented Aug 29, 2026

Copy link
Copy Markdown
Member

What does this PR do ?

This PR adds better topk kernel on metal

@github-actions github-actions Bot added the chore Version bumps, releases, misc maintenance label Aug 29, 2026
@sayakpaul

Copy link
Copy Markdown
Member

@SunMarc could we rename it to topk-metal or something to denote the specificity?

@SunMarc

SunMarc commented Sep 3, 2026

Copy link
Copy Markdown
Member Author

@SunMarc could we rename it to topk-metal or something to denote the specificity?

I named it this way because there was a change that i might add cuda kerrnels in it.

@sayakpaul

Copy link
Copy Markdown
Member

/kernel-builder build-and-stage topk

@sayakpaul

Copy link
Copy Markdown
Member

/kernel-bot build-and-stage topk

@github-actions

github-actions Bot commented Sep 3, 2026

Copy link
Copy Markdown

Build request processed.

Command: /kernel-bot build-and-stage topk
Mode: build and stage
Target branch: pr-1124
PR head SHA: 587ce750a422b669be1d18befba79b9efc0388c8
Workflows: build.yaml, build-mac.yaml, build-windows.yaml

Dispatched (1):

Hub uploads:

`kernel_maintainers.py check` requires every directory with a `build.toml` to
appear in the registry, so the new kernel failed CI until it was listed. The
card is the same template the other 51 kernels ship, and `CARD.md` is the name
they all use.
@SunMarc

SunMarc commented Sep 4, 2026

Copy link
Copy Markdown
Member Author

can you build and stage again @sayakpaul ? i've fixed a few things since the CI wasn't happy (e.g kernels-maintainers.json)

@sayakpaul

Copy link
Copy Markdown
Member

/kernel-bot build-and-stage topk

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown

Build request processed.

Command: /kernel-bot build-and-stage topk
Mode: build and stage
Target branch: pr-1124
PR head SHA: d3c5b6d301c91bd0043b6e7cf789286d34c9dd71
Workflows: build.yaml, build-mac.yaml, build-windows.yaml

Dispatched (1):

Hub uploads:

@sayakpaul

Copy link
Copy Markdown
Member

@SunMarc I just did. But more generally, let's first confirm it can build successfully (which you can trigger as well). Then we can just do merge-and-upload (unless you want to test the staged builds).

@SunMarc

SunMarc commented Sep 4, 2026

Copy link
Copy Markdown
Member Author

Oh nice, always thought that we had to stage before ! thanks for letting me know

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

chore Version bumps, releases, misc maintenance

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants