Skip to content

[BACKEND][MULTIPROCESS] Error on Windows fork multi-process #4

Description

@Drdaag

Issue on calling the multi-process:

_pickle.PicklingError: Can't pickle <function process_date_folder at 0x0000017FD99F3920>: it's not the same object as src.FileFinder.FinderUtils.process_date_folder
Traceback:
 
File "Python\DopplerManager\app.py", line 97, in <module>
    main()
    ~~~~^^
File "Python\DopplerManager\app.py", line 61, in main
    render_sidebar(ff)
    ~~~~~~~~~~~~~~^^^^
File "Python\DopplerManager\src\ui\sidebar.py", line 20, in render_sidebar
    ff.Findfiles(scan_path)
    ~~~~~~~~~~~~^^^^^^^^^^^
File "Python\DopplerManager\src\FileFinder\FileFinderClass.py", line 136, in Findfiles
    for i, result in enumerate(
                     ~~~~~~~~~^
        pool.imap_unordered(FinderUtils.process_date_folder, date_folders)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ):
    ^
File "Python\Python313\Lib\multiprocessing\pool.py", line 873, in next
    raise value
File "Python\Python313\Lib\multiprocessing\pool.py", line 540, in _handle_tasks
    put(task)
    ~~~^^^^^^
File "Python\Python313\Lib\multiprocessing\connection.py", line 206, in send
    self._send_bytes(_ForkingPickler.dumps(obj))
                     ~~~~~~~~~~~~~~~~~~~~~^^^^^
File "Python\Python313\Lib\multiprocessing\reduction.py", line 51, in dumps
    cls(buf, protocol).dump(obj)
    ~~~~~~~~~~~~~~~~~~~~~~~^^^^^

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

BackendRelated to DB relations or other backend codeHIGHbugSomething isn't working

Type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions