Every question is about one TARGET OBJECT, marked in the reference video
with a red box and a cyan highlight.
You judge how well two AI-generated videos preserve that object. 28 quick questions · ~10 minutes.
👀
Watchthe reference video and find the target object (red box, cyan highlight)
⚖️
Comparehow that object looks in videos A and B, replay as often as you like
✅
Ratethe object on 3 quick aspects per question, then go with your gut
assigning session…
Loading videos…
Reference — for context only
Reference (ground truth)
Target object (highlighted)
Candidates — judge these two
A
B
0.0 / 0.0s
Object permanenceDoes the target object highlighted above exist in the videos on the right?
Appearance doesn't matter.
Motion continuityDoes the object follow similar motion to the target object in the
reference video? If the target object is static, its position shouldn't
change (up to camera movement). Appearance doesn't matter.
Appearance preservationWhich one of the generated objects looks more similar to the target
object in the reference video? Motion doesn't matter.