Skip to content

[Feat] Align quant and fused rmsnorm kernels with aiter/triton#481

Open
cschenjunlin wants to merge 6 commits intomainfrom
cjl/fused_quant_rmsnorm
Open

[Feat] Align quant and fused rmsnorm kernels with aiter/triton#481
cschenjunlin wants to merge 6 commits intomainfrom
cjl/fused_quant_rmsnorm

Conversation

@cschenjunlin
Copy link
Copy Markdown
Contributor

@cschenjunlin cschenjunlin commented May 8, 2026

Motivation

Align quant and fused kernels with aiter/triton

Technical Details

Test Plan

Test Result

Submission Checklist

  • quant_rms_norm_kernel
  • fused_add_rmsnorm_kernel
  • quant_fused_add_rmsnorm_kernel
  • rmsnorm_kernel_large_m_small_n

Comment thread kernels/rmsnorm_kernel.py
y = (added * rrms) * g
_store_vec(_to_elem_vec(y), out_div, idx)

else:
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no need to copy all the codes in else?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants