Aerial road scene from XS-VID

Annotated video frame · 1024 × 1024

Dataset at a glance

A difficult benchmark by construction.

374video sequences
223Kannotated frames
1.4Mbounding boxes
7object categories

XS-VID v2 provides a shared data contract across Detection, MOT, and SOT. The release contains media, unified annotations, development splits, and task-specific protocol files. Runnable evaluators are provided in the code release.

Inspect the release ↓

Benchmark results

Three tracks. One difficult scale regime.

Compare every evaluated method under the released protocols, then open its official paper or implementation directly from the table.

AP versus latency comparison across XS-VID detection baselines
Detection landscapeBubble area denotes FLOPs. Established VOD methods occupy the high-latency, low-AP region on XS-VID.

What the benchmark reveals

Temporal input alone is not enough at extremely small scales.

The Detection table makes the transfer gap visible: several established VOD systems are substantially heavier than single-frame alternatives while remaining far from the leading XS-VID AP. The MOT and SOT views extend this comparison to trajectory-level evaluation.

Read the benchmark paper ↗

YOLOFT baseline

A temporal baseline shaped by the benchmark.

YOLOFT strengthens fine-scale evidence before local temporal aggregation, while retaining an efficient Detection path.

Illustration of XS-VID small-object video challenges
XS-VID exposes weak target evidence, scale variation, and temporal ambiguity simultaneously.

YOLOFT-L is the released baseline for the Detection track. Its shared temporal representation also supports the released MOT and SOT task extensions.

29.3Detection AP
31.5MOT TAO mAP
59.63SOT success AUC

Sequence explorer

Follow targets in motion.

Browse public ground-truth annotations across contiguous video frames, then inspect any frame at native image coordinates.

Loading sequence

Visible tracks

Boxes are public ground-truth annotations rendered at their native image coordinates.

Release v2

From download to reproducible evaluation.

01 / DATA

Download XS-VID v2

Media, unified train/test annotations, development views, and protocol files are distributed together.

Hugging Face ↗ModelScope ↗
02 / CODE

Run YOLOFT

The code release includes the temporal Detection backbone and task-specific MOT and SOT workflows.

YOLOFT code ↗
03 / EVALUATION

Evaluate a track

Runnable Detection, TAO-compatible MOT, Track-by-Detection, and SOT evaluation commands are provided in the code release.

Model weights ↗Evaluation guide ↗

Download and prepare XS-VID v2

From the YOLOFT checkout, one standard-library command downloads the dataset, verifies archive hashes, extracts images and generates labels/splits. No hub SDK is needed. Both dataset mirrors are public.

ModelScope dataset; HF alternative in guide
git clone https://github.com/gjhhust/YOLOFT.git
cd YOLOFT
python tools/xsvid/download_release.py --hub ms --destination ./downloads

Download and evaluation guide →

Quick start
git clone https://github.com/gjhhust/YOLOFT.git && cd YOLOFT && python tools/xsvid/download_release.py --hub ms --component dataset --destination ./downloads

Citation

Use XS-VID in your work.

@article{guo2026xsvid,
  title={{XS-VID}: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos},
  author={Guo, Jiahao and Xu, Ziyang and Wu, Lianjun and Gao, Fei and Liu, Wenyu and Wang, Xinggang},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year={2026},
  doi={10.1109/TPAMI.2026.3741044}
}
Read the paper ↗

Acknowledgements: the release builds on and includes integrations adapted from Ultralytics, DCNv3 / InternImage, BoT-SORT, TransT, and their respective dependencies. Please consult the included licenses before redistribution or commercial use.