2026Vision

GOT-JEPA surgical tool tracking

Author, public repository

I wanted the tools in a surgical clip to stay identified as the camera moves. This is public code for GOT-JEPA tracking on CholecTrack20: a frozen DINOv2 encoder, a per-track predictor, DETR detection, and re-identification. It is a separate line from the ISBI phase-recognition paper.

Three empty ink boxes inside a rectangle on warm paper, with short trails. — Fig. 1Ink boxes drift inside a blank frame. Generated illustration of the method, not a capture. No clinical frames.

Stack: GOT-JEPA, CholecTrack20, Tracking, DINOv2
Links: Code

Also

2026MVA Rare Disease Hackathon 2026
2026Causal-JEPA reproduction
2025AIMS: Surgical Phase Detection
2025MSc Thesis: Surgical Video Prediction
2024Pothole Detection (arXiv)