Skip to content

Cutlass APIs changes for Fusion Epilogue - #657

Open
rishi-yadav wants to merge 10 commits into
intel:mainfrom
rishi-yadav:cutlas_apis
Open

Cutlass APIs changes for Fusion Epilogue#657
rishi-yadav wants to merge 10 commits into
intel:mainfrom
rishi-yadav:cutlas_apis

Conversation

@rishi-yadav

@rishi-yadav rishi-yadav commented Dec 4, 2025

Copy link
Copy Markdown
Test Suite Enabled Disabled Pass Rate
LinCombTopKSoftmaxCol 9 8 100%
LinCombSplitK 14 1 100%
LinCombSoftmaxRow 10 10 100%
Total 37 19 100%

@rishi-yadav rishi-yadav changed the title Cutlass APIs changes for Fusionwq Cutlass APIs changes for Fusion Dec 4, 2025
@rishi-yadav rishi-yadav changed the title Cutlass APIs changes for Fusion Cutlass APIs changes for Fusion Epilogue Dec 4, 2025
@aschabana
aschabana requested a review from kausikmaiti January 6, 2026 09:42
xe_gemm_f8_f8_fp32_tensor_op_fp32.cpp
xe_gemm_fp16_s8_fp32_tensor_op_fp32.cpp
gemm_universal_bf16n_bf16t_f32n_tensor_op_f32_xe.cpp
gemm_universal_fp8_fp8_fp32_tensor_op_f32_xe_models.cpp

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the changed and commented code is the same, needn't change.

xe_gemm_bf16_bf16_fp32_tensor_op_fp32_evt.cpp
xe_gemm_bf16_bf16_fp32_lincombtopksoftmaxcol_tensor_op_f32.cpp
xe_gemm_bf16_bf16_fp32_lincomb_splitk_tensor_op_f32.cpp
# xe_gemm_bf16_bf16_fp32_lincomb_softmaxrow_tensor_op_f32.cpp

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we still need to run softmaxrow tensor op? if we don't run it in this PR, propose to remove this part code.

Array<ElementInput, FragmentSize> const& frg_input) {

return frg_acc;
return frg_input;

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please explain this change?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants