REVIEW 8 cited by
OmniControl: Control Any Joint at Any Time for Human Motion Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present a novel approach named OmniControl for incorporating flexible spatial control signals into a text-conditioned human motion generation model based on the diffusion process. Unlike previous methods that can only control the pelvis trajectory, OmniControl can incorporate flexible spatial control signals over different joints at different times with only one model. Specifically, we propose analytic spatial guidance that ensures the generated motion can tightly conform to the input control signals. At the same time, realism guidance is introduced to refine all the joints to generate more coherent motion. Both the spatial and realism guidance are essential and they are highly complementary for balancing control accuracy and motion realism. By combining them, OmniControl generates motions that are realistic, coherent, and consistent with the spatial constraints. Experiments on HumanML3D and KIT-ML datasets show that OmniControl not only achieves significant improvement over state-of-the-art methods on pelvis control but also shows promising results when incorporating the constraints over other joints.
Forward citations
Cited by 8 Pith papers
-
AnyAct: Towards Human Reenactment of Character Motion From Video
Sparse local 2D articulated cues extracted from monocular non-human character videos can condition a human motion generator to produce high-fidelity, editable human reenactments that preserve essential dynamics.
-
Ego-Human Motion Prediction with 3D-Aware LLM
Ego3DLM jointly predicts past and future 3D body pose and motion descriptions in a single autoregressive pass, conditioned on egocentric video, 3D scene features, and three-point tracking, achieving state-of-the-art o...
-
ClusterStyle: Modeling Intra-Style Diversity with Prototypical Clustering for Stylized Motion Generation
ClusterStyle clusters each motion style into global and local prototypes and conditions a latent diffusion model on them, improving stylized motion generation fidelity and enabling controllable within-style diversity ...
-
InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation
InterAct is a unified 21.81-hour 3D human-object interaction benchmark with text annotations, quality-corrected data, and a multi-task model that achieves state-of-the-art results across six generation tasks.
-
UMO: Scaling Multi-Identity Consistency for Image Customization via Matching Reward
A reinforcement-learning reward based on bipartite face matching improves multi-identity consistency and reduces identity confusion in image customization models.
-
FocusDPO: Dynamic Preference Optimization for Multi-Subject Personalized Image Generation via Adaptive Focus
FocusDPO adds dynamic spatial weighting to preference-based fine-tuning, improving subject fidelity and reducing attribute leakage in multi-subject personalized image generation.
-
PoseMaster: A Unified 3D Native Framework for Stylized Pose Generation
PoseMaster produces a 3D character mesh from one image and a target 3D skeleton, preserving identity and pose in a single unified model, and it outperforms two-stage 2D-to-3D baselines on the VRoid pose canonicalizati...
-
Motion Generation: A Survey of Generative Approaches and Benchmarks
A structured survey that categorizes recent motion generation methods by underlying generative approach and compiles datasets, metrics, and statistical trends.
Discussion (0). Sign in to comment.