Skip to content

Modin df becomes pandas df when sent to a ray remote. How can I stop it doing that? #7691

@Liquidmasl

Description

@Liquidmasl

Hi there,

I am not only using modin by itself, i also use ray quite a lot. It is now necessary to send a full modin datagrame to a ray remote Actor/Task. But whenever this is done, in the actor/task the modin dataframe is no longer a modin dataframe. It becomes a default pandas dataframe.

Even when the modin df is encapsulated in a class that is sent to a remote, in the remote its a pandas again.

How can I make it not do that? currently the only thing I managed is getting partition list with from_partition, send it to a remote, and then reconstruct the modin df there. Which is kinda annoying, and also a bit slow.

Any chance of telling modin to stay a modin df?

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions