SAM2

[peterferenc8-coder]

Hi!

Amazing work, it works great!
I have tried something myself and it was not this sophisticated. I used Meta's SAM2 model for a more persistent object tracking. Did you consider SAM2 for this project?

[Rriik]

I agree, it would be nice to explore integrations for some of these ML-based object/motion trackers as an addition to (end eventually superseding) the existing YOLO/CV based flows. I also would vouch for Meta CoTracker3 as a complementary model to SAM2. While SAM2 gives you persistent object mask tracking, CoTracker3 allows you to track point movements within and between the masked objects.