VISION LAB / 01RECORDED EXPERIMENT

OPEN-VOCABULARY RELATION PREDICTION

RelateAnything

Detection · Object Association · Relation Prediction
Class Filter 비교 · Temporal Filtering · GPU 추론 기록

DETECTION + RELATION MODELYOLO11s / RelateAnything

20.04 s · 481 Frames · Synthetic Video

i

Recorded Inference · RTX 4090 / 저장 결과 재생 · Browser Inference 미지원

Method ↗
01

Frame Inspector

FRAME — / 480

Loading Experiment Data

RECORDED INFERENCE
Loading Inference Records
00.00 / 20.04
03

Relation Score Timeline

Click to Seek
BaselineAssociationDraft Positives
01 / RESULTS

Detection Label Instability

Occlusion 구간의 Detection Label 변화 · Bottle Class Filter의 입력 누락
All-class Detection + Position / Size Association

Pipeline Comparison · 동일 Video / Checkpoint
PipelineBottle Box Coverageholding Precisionholding Recallholding F1Pipeline FPS

Relation Score ≥ 0.5 · holding Draft Labels: 74 (Positive 33 / Negative 41) · Missing Positive: FN
Box Coverage: Frame별 Box 제공률 · Localization Accuracy 미평가
Pipeline FPS: Mean Local Inference Latency의 역수 · Rendering / File I/O 제외

02 / METHOD

Class-Agnostic
Object Association

  1. 01

    All-class Detection

    YOLO11s · Bottle Class Filter 제거
    vase / cup Label의 후보 유지

  2. 02

    Object Association

    IoU · Motion Prediction · Box Size
    최초 Bottle ID 유지 · 현재 관측 Box만 사용

  3. 03

    Temporal Filtering

    Relation Score 보존
    EMA + Hysteresis 적용 상태 별도 기록

03 / LIMITATIONS

Failure Modes

Proximity vs. Holding

Bottle 인접 구간의 holding False Positives 잔존
Temporal Filtering의 Semantic Error 개선 한계

Low on Recall

on Positive의 Relation Score < 0.5
Relation별 Calibration / Threshold 검증 필요

Generalization Scope

Synthetic Video 1개 · Draft Labels · Development Evaluation
Real-world / Held-out Evaluation 미실시 · Model Retraining 없음
다양한 Background / Lighting / Occlusion / Multi-object 조건의 ID Switch 및 Relation 성능 검증 필요

04 / REPRODUCIBILITY

Experiment Artifacts

Frame-level Boxes · Relation Scores · Metrics · Source Code