Skip to content

Issue with Sparse MLP #178

@Venkatesh3132003

Description

@Venkatesh3132003

still not fixed:
/usr/local/lib/python3.11/dist-packages/megablocks/layers/arguments.py in post_init(self)
80 import triton
81 if triton.version >= '3.2.0':
---> 82 raise ValueError(
83 'Sparse MLP is not supported with triton >=3.2.0. Please use mlp_impl="grouped" instead.',
84 )

ValueError: Sparse MLP is not supported with triton >=3.2.0. Please use mlp_impl="grouped" instead.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions