Skip to content

GLM-4.5 model accuracy alignment- #4813 - #165

Open
zhanghonggeng wants to merge 1 commit into
modelscope:mainfrom
PFCCLab:glm45-accuracy-alignment
Open

GLM-4.5 model accuracy alignment- #4813#165
zhanghonggeng wants to merge 1 commit into
modelscope:mainfrom
PFCCLab:glm45-accuracy-alignment

Conversation

@zhanghonggeng

Copy link
Copy Markdown

Adds bit-exact numerical alignment patches between Megatron-LM and PaddleFleet for the GLM-4.5 MoE model, gated by USE_ACCURACY_COMPATIBLE=1 environment variable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants