vine: dagvine implementation#4253

Draft

JinZhou5042 wants to merge 240 commits into

cooperative-computing-lab:masterfrom

JinZhou5042:task-graph

Commits on May 1, 2025

vine: separate pending and ready tasks
JinZhou5042
committed

Commits on May 2, 2025

Commits on May 25, 2025

Merge branch 'cooperative-computing-lab:master' into separate_pending_and_ready_tasks
JinZhou5042
authored
use vine_schedule_have_committable_resources
Jin Zhou
committed
static
Jin Zhou
committed
vine_schedule_rotate_pending
Jin Zhou
committed
revert
Jin Zhou
committed
adjust location
Jin Zhou
committed
fix int done
Jin Zhou
committed

Commits on May 29, 2025

Merge branch 'cooperative-computing-lab:master' into separate_pending_and_ready_tasks
JinZhou5042
authored

Commits on Jun 12, 2025

Merge branch 'cooperative-computing-lab:master' into separate_pending_and_ready_tasks
JinZhou5042
authored

Commits on Jun 20, 2025

Commits on Jun 27, 2025

Commits on Jun 30, 2025

merge
Jin Zhou
committed
Merge remote-tracking branch 'origin/separate_pending_and_ready_tasks' into separate_pending_and_ready_tasks
Jin Zhou
committed

Commits on Jul 5, 2025

Merge branch 'cooperative-computing-lab:master' into separate_pending_and_ready_tasks
JinZhou5042
authored

Commits on Sep 23, 2025

Merge branch 'cooperative-computing-lab:master' into separate_pending_and_ready_tasks
JinZhou5042
authored

Commits on Oct 13, 2025

vine: function infile load mode
Jin Zhou
committed
specify utf-8
Jin Zhou
committed
utf-8
Jin Zhou
committed
vine: some bug fixes for the library code
Jin Zhou
committed

Commits on Oct 14, 2025

dttools: progress_bar src and test
Jin Zhou
committed
add unit
Jin Zhou
committed
format issue
Jin Zhou
committed
vine: valid link when sending message on worker
Jin Zhou
committed
merge
Jin Zhou
committed
Merge remote-tracking branch 'origin/progress-bar' into task-graph
Jin Zhou
committed
Merge remote-tracking branch 'origin/worker-bug-fix' into task-graph
Jin Zhou
committed
vine: LIST_ITERATE_REVERSE
Jin Zhou
committed
temp
Jin Zhou
committed
Merge remote-tracking branch 'origin/LIST_ITERATE_REVERSE' into task-graph
Jin Zhou
committed
vine: task graph executor in C
Jin Zhou
committed
simple fix
Jin Zhou
committed
braces in block
Jin Zhou
committed
type fix
Jin Zhou
committed
type fix
Jin Zhou
committed
lint
Jin Zhou
committed

Commits on Oct 15, 2025

some fixes
Jin Zhou
committed
bug
Jin Zhou
committed
use proxy function and library
Jin Zhou
committed
comment functions
Jin Zhou
committed
use a separate directory
Jin Zhou
committed

Commits on Oct 16, 2025

backup
Jin Zhou
committed
libtask
Jin Zhou
committed
dagvine
Jin Zhou
committed
new interface
Jin Zhou
committed
api change
Jin Zhou
committed
new
Jin Zhou
committed
vine task graph tuning
Jin Zhou
committed

Commits on Oct 17, 2025

new version
Jin Zhou
committed

Commits on Oct 18, 2025

remove _task_graph
Jin Zhou
committed
new
Jin Zhou
committed
reg
Jin Zhou
committed
sog && reg
Jin Zhou
committed
sog
Jin Zhou
committed

Commits on Oct 19, 2025

milestone
Jin Zhou
committed
new files
Jin Zhou
committed
lint and format
Jin Zhou
committed
rename executor
Jin Zhou
committed
checkpoint works
Jin Zhou
committed
update apis
Jin Zhou
committed
make
Jin Zhou
committed
lint
Jin Zhou
committed
make format
Jin Zhou
committed

Commits on Oct 20, 2025

comment
Jin Zhou
committed
Merge branch 'cooperative-computing-lab:master' into task-graph
JinZhou5042
authored
file name fix
Jin Zhou
committed

Commits on Oct 22, 2025

gpus
Jin Zhou
committed
Merge remote-tracking branch 'origin/separate_pending_and_ready_tasks' into HEAD
Jin Zhou
committed

Commits on Oct 29, 2025

time metrics
Jin Zhou
committed
optimized put
Jin Zhou
committed
lint
Jin Zhou
committed
lint
Jin Zhou
committed
time metrics
Jin Zhou
committed

Commits on Nov 1, 2025

new structure
Jin Zhou
committed
git ignore
Jin Zhou
committed

Commits on Nov 3, 2025

Merge branch 'cooperative-computing-lab:master' into task-graph
JinZhou5042
authored
revert vine_manager_put_task
Jin Zhou
committed
Merge remote-tracking branch 'origin/task-graph' into task-graph
Jin Zhou
committed
traverse w->current_libraries instead of w->current_tasks
Jin Zhou
committed
Merge remote-tracking branch 'origin/use-current-library' into task-graph
Jin Zhou
committed
merge
Jin Zhou
committed
revert push_task_to_ready_tasks
Jin Zhou
committed
vine: multiply task priority on resource exhaustion
Jin Zhou
committed
Merge remote-tracking branch 'origin/push_task_to_ready_tasks' into task-graph
Jin Zhou
committed
vine: clean redundant input replicas upon task completion
Jin Zhou
committed
lint
Jin Zhou
committed

Commits on Nov 4, 2025

Merge branch 'cooperative-computing-lab:master' into clean_redundant_replicas
JinZhou5042
authored
make it an argument
Jin Zhou
committed
shift-disk-load
Jin Zhou
committed
merge
Jin Zhou
committed
lint
Jin Zhou
committed
comment
Jin Zhou
committed
vine_temp
Jin Zhou
committed
vine: vine_temp.c
Jin Zhou
committed
merge
Jin Zhou
committed
lint
Jin Zhou
committed
trigger rebuild
Jin Zhou
committed

Commits on Nov 5, 2025

comments
Jin Zhou
committed
remove unrelated code
Jin Zhou
committed
Merge remote-tracking branch 'origin/master' into progress-bar
Jin Zhou
committed
fix flicker
Jin Zhou
committed

Commits on Nov 6, 2025

update doc
Jin Zhou
committed
fix comment
Jin Zhou
committed
trigger rebuild
Jin Zhou
committed

Commits on Nov 10, 2025

Commits on Dec 3, 2025

merge
Jin Zhou
committed
modify project name
Jin Zhou
committed

Commits on Dec 4, 2025

Commits on Jan 5, 2026

fix comments
Jin Zhou
committed
Merge branch 'cooperative-computing-lab:master' into vine_temp
JinZhou5042
authored
merge
Jin Zhou
committed
clean
Jin Zhou
committed
merge
Jin Zhou
committed
merge
Jin Zhou
committed
merge
Jin Zhou
committed
Merge remote-tracking branch 'origin/library-network-code-bugfix' into task-graph
Jin Zhou
committed
update
Jin Zhou
committed
rename recovery_tasks_submitted
Jin Zhou
committed
timestamp format
Jin Zhou
committed

Commits on Jan 7, 2026

temp
Jin Zhou
committed
merge
Jin Zhou
committed

Commits on Jan 8, 2026

support new dask expr
Jin Zhou
committed
revert vine_worker
Jin Zhou
committed
support dask expressions
Jin Zhou
committed
gitignore
Jin Zhou
committed
remove context graph from makefile
Jin Zhou
committed

Commits on Jan 9, 2026

convert bg to dask expr
Jin Zhou
committed
support internal in/out
Jin Zhou
committed
auto recovery
Jin Zhou
committed
rename to User
Jin Zhou
committed
block rec tasks w missing inputs
Jin Zhou
committed
merge
Jin Zhou
committed
Merge branch 'library-infile-load-mode' of github.com:JinZhou5042/cctools into library-infile-load-mode
Jin Zhou
committed
rename infile_path
Jin Zhou
committed

Commits on Jan 12, 2026

Merge remote-tracking branch 'origin/master' into task-graph
Jin Zhou
committed

Commits on Jan 15, 2026

add compute makespan
Jin Zhou
committed
use processing_transfers in vine_cache_check_files
Jin Zhou
committed

Commits on Feb 16, 2026

Merge branch 'cooperative-computing-lab:master' into task-graph
JinZhou5042
authored
fast task committment
Jin Zhou
committed
checkpoint
Jin Zhou
committed

Commits on Feb 19, 2026

fix var name
Jin Zhou
committed
comment out time metrics
Jin Zhou
committed

Commits on Mar 23, 2026

Merge branch 'cooperative-computing-lab:master' into task-graph
JinZhou5042
authored

Commits on Apr 23, 2026

ckpt
Jin Zhou
committed
checkpoint: good condition
Jin Zhou
committed
apply gitignore
Jin Zhou
committed
add graph
Jin Zhou
committed

Commits on Apr 24, 2026

reapply .gitignore
Jin Zhou
committed
rm ignore .so files
Jin Zhou
committed
Merge branch 'cooperative-computing-lab:master' into master
JinZhou5042
authored

Commits on Apr 29, 2026

rearrange makefiles
Jin Zhou
committed
rename files and dirs
Jin Zhou
committed
rename dirs
Jin Zhou
committed
clean proxy and adaptor
Jin Zhou
committed
add utils
Jin Zhou
committed
revert vine_manager_put
Jin Zhou
committed

Commits on May 2, 2026

Commits on May 4, 2026

rm time_end_execution
Jin Zhou
committed
Merge branch 'cooperative-computing-lab:master' into task-graph
JinZhou5042
authored
apply gitignore
Jin Zhou
committed
add graph
Jin Zhou
committed
reapply .gitignore
Jin Zhou
committed
rm ignore .so files
Jin Zhou
committed
add back transfer_port_bind_failed
Jin Zhou
committed
rm unused vars
Jin Zhou
committed
rm unsed vars
Jin Zhou
committed
rm vine_schedule_count_committable_cores
Jin Zhou
committed
no use cvine at dagvine.py
Jin Zhou
committed
revert some files
Jin Zhou
committed
rm unsed vars
Jin Zhou
committed
delete context graph
Jin Zhou
committed
revert daskvine
Jin Zhou
committed
rm binary file
Jin Zhou
committed
fix cvine path
Jin Zhou
committed
clean some includes
Jin Zhou
committed
clean comments
Jin Zhou
committed

Commits on May 5, 2026

upgrade runner task
Jin Zhou
committed
runtime task creation and io mounting
Jin Zhou
committed

Commits on May 6, 2026

profiling pre/post processing
Jin Zhou
committed
modulize pre/post
Jin Zhou
committed
remove comment
Jin Zhou
committed
chain grouping
Jin Zhou
committed

Commits on May 8, 2026

Merge branch 'cooperative-computing-lab:master' into master
JinZhou5042
authored

Commits on Jun 8, 2026

checkpoint-v0
Jin Zhou
committed

Commits on Jun 17, 2026

Merge branch 'cooperative-computing-lab:master' into master
JinZhou5042
authored
Merge branch 'cooperative-computing-lab:master' into task-graph
JinZhou5042
authored
renaming files and dirs and function names stuff
Jin Zhou
committed
move project path
Jin Zhou
committed
apply gitignore
Jin Zhou
committed
add graph
Jin Zhou
committed
reapply .gitignore
Jin Zhou
committed
rm ignore .so files
Jin Zhou
committed
rm graph/
Jin Zhou
committed
move to python bindings
Jin Zhou
committed

Commits on Jun 23, 2026

add some patches
Jin Zhou
committed
Merge branch 'cooperative-computing-lab:master' into master
JinZhou5042
authored
merge
Jin Zhou
committed
merge
Jin Zhou
committed
rm stale files
Jin Zhou
committed
remove a couple useless code
Jin Zhou
committed
no enable debug log
Jin Zhou
committed
vine: return recovery tasks
Jin Zhou
committed
lint
Jin Zhou
committed

Commits on Jun 24, 2026

Commits on Jun 25, 2026

merge
Jin Zhou
committed
Merge remote-tracking branch 'origin/master' into task-graph
Jin Zhou
committed
Merge remote-tracking branch 'origin/library-infile-load-mode' into task-graph
Jin Zhou
committed
rm stale api
Jin Zhou
committed
vine_cache_check_xfer
Jin Zhou
committed
add a comment
Jin Zhou
committed
rename to external_recovery_handling
Jin Zhou
committed
Merge branch 'cooperative-computing-lab:master' into return-recovery-tasks
JinZhou5042
authored
new changes
Jin Zhou
committed
merge
Jin Zhou
committed
reset task commit
Jin Zhou
committed