From 2d1cbaeac7b52ca64baf61e58973d0940ae843d0 Mon Sep 17 00:00:00 2001 From: Tengyu Ma Date: Mon, 24 Nov 2025 18:20:43 -0800 Subject: [PATCH] Update veval README.md for frame shifting alert on sa-co/veval yt1b (#213) Summary: Pull Request resolved: https://github.com/facebookresearch/sam3/pull/213 Reviewed By: haithamkhedr Differential Revision: D87830284 Pulled By: tengyu-ma fbshipit-source-id: e6cc52f42bfa2de33462f0c26acebcb1bcee0cff --- scripts/eval/veval/README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/scripts/eval/veval/README.md b/scripts/eval/veval/README.md index 3147426..0863d44 100644 --- a/scripts/eval/veval/README.md +++ b/scripts/eval/veval/README.md @@ -50,6 +50,10 @@ For each domain: For all three domains: - [SA-Co/VEval](https://universe.roboflow.com/sa-co-veval) +Special note on **SA-Co/VEval - YT-Temporal-1B**: +* **Frame Shifting Alert!** +* The ready-to-use data hosted on Roboflow was produced by following the preprocessing steps below. Therefore, the frame-shifting issue for YT-Temporal-1B still exists: due to the nature of Youtube videos, the re-downloaded videos may not be exactly the same as those used during annotation, which can affect eval number reproducibility. + ### Download via preprocessing steps #### Download annotations The GT annotations are available at Hugging Face: