REVIEW 5 cited by
Towards Understanding Camera Motions in Any Video
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We introduce CameraBench, a large-scale dataset and benchmark designed to assess and improve camera motion understanding. CameraBench consists of ~3,000 diverse internet videos, annotated by experts through a rigorous multi-stage quality control process. One of our contributions is a taxonomy of camera motion primitives, designed in collaboration with cinematographers. We find, for example, that some motions like "follow" (or tracking) require understanding scene content like moving subjects. We conduct a large-scale human study to quantify human annotation performance, revealing that domain expertise and tutorial-based training can significantly enhance accuracy. For example, a novice may confuse zoom-in (a change of intrinsics) with translating forward (a change of extrinsics), but can be trained to differentiate the two. Using CameraBench, we evaluate Structure-from-Motion (SfM) and Video-Language Models (VLMs), finding that SfM models struggle to capture semantic primitives that depend on scene content, while VLMs struggle to capture geometric primitives that require precise estimation of trajectories. We then fine-tune a generative VLM on CameraBench to achieve the best of both worlds and showcase its applications, including motion-augmented captioning, video question answering, and video-text retrieval. We hope our taxonomy, benchmark, and tutorials will drive future efforts towards the ultimate goal of understanding camera motions in any video.
Forward citations
Cited by 5 Pith papers
-
Natural Language Camera Movement Understanding
A cinematographic taxonomy, atomic real+synthetic benchmark (ACaM), and targeted-augmentation SFT let an 8B VLM outperform Gemini-3.1-Pro by 10-11% on camera-movement recognition, yet a large human gap remains.
-
CameraAnything: Refilming Videos with Arbitrary Camera Control
A video diffusion editor jointly controls extrinsic pose, multi-shot cuts, focal length, and native resolution via Plücker rays in resolution-aware 3D RoPE, trained on synthetic multi-camera pairs.
-
Self-Supervised Learning of Structured Dynamics from Videos
A two-token 'primary/residual' future-feature predictor separates camera from object motion, outpacing frozen-feature baselines and matching larger supervised models on several probes.
-
GS-Agent: Creating 4D Physical Worlds With Generative Simulation
Three LLM agents write physics-engine code from text, review rendered frames, and correct errors, turning prompts into physically simulated 4D worlds with camera control.
-
Leveraging Optimal Transport for Distributed Two-Sample Testing: An Integrated Transportation Distance-based Framework
A permutation test that aggregates per-client Wasserstein distances into an integrated transportation distance detects distributional differences in distributed data, with claimed Type I error control and high power.
Discussion (0). Sign in to comment.