{"id":"fd0d403f-60b1-4ca5-9f50-44caea325958","arxiv_id":"2605.31551","paper_version":1,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":2.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"SMART adapts SMPLest-X via stratified finetuning and RAFT tracking to achieve 0.647 validation and 0.593 test scores on the FIFA 2026 skeletal tracking challenge, versus baseline 1.053.","lead":"SMART finetunes the SMPLest-X model with depth supervision and broadcast augmentations, then pairs it with RAFT optical flow tracking and foot anchoring to estimate 3D soccer player poses from broadcast video, cutting the FIFA baseline error by 38.6 percent on validation. A smart generalist might read it to see how large pre-trained vision models are adapted for practical sports analytics without new hardware.","discovery_kind":"new_application","skeptic_critique":{"model":"grok-4.3","headline":"Validation split details and potential leakage in stratified clip split remain the primary unverified assumption behind the 38.6% gain.","rationale":"The reader's weakest_assumption already isolates the single most load-bearing empirical risk for a competition submission. No additional internal inconsistency or formal gap is visible from the supplied abstract and claim; the concern is therefore the same one already flagged.","tokens_in":1668,"tokens_out":316,"duration_ms":10866,"concrete_test":"Request the exact clip IDs or stratification code used for the validation split; recompute the baseline and SMART scores on a fresh random 80/20 clip-level split of the same source footage while keeping all other training and inference settings identical. If the relative improvement drops below 20%, the original gain is sensitive to split choice.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The headline result (0.647 vs. 1.053 on validation) is presented as evidence that finetuning SMPLest-X with multi-task depth supervision, broadcast augmentation, RAFT tracking, and foot-plane anchoring produces the improvement. For this attribution to hold, the stratified clip split must guarantee that no temporal or scene overlap exists between training clips and the validation set, and that the split itself was not tuned after observing validation performance. The abstract provides no quantitative description of the split (e.g., clip length, stratification criteria, or overlap statistics), leaving open the possibility that the measured gain partly reflects a more favorable data partition rather than the listed algorithmic components.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.3","summary":"The paper presents SMART for the FIFA Skeletal Tracking Challenge 2026, which estimates 3D world-space soccer player poses from broadcast video. It finetunes the SMPLest-X ViT-H model (687M parameters) using a stratified clip split, multi-task depth supervision, broadcast augmentation, a RAFT dense optical flow tracker, foot-plane anchoring, and two-pass temporal smoothing. It reports a validation score of 0.647 (38.6% better than the FIFA baseline of 1.053) and a held-out test score of 0.593 (Global MPJPE 0.324 m, Local MPJPE 0.054 m).","tokens_in":1806,"tokens_out":531,"duration_ms":12471,"significance":"If the reported gains can be independently verified as arising from the listed components rather than data partitioning, the work would demonstrate a practical recipe for adapting large body models to sports broadcast footage with camera motion and ground-plane constraints. The test-set numbers provide a concrete, falsifiable benchmark for future soccer pose methods.","major_comments":[{"comment":"Abstract: the central claim that the 38.6% validation improvement is produced by the finetuning choices, RAFT tracker, and foot-plane anchoring cannot be evaluated because the manuscript supplies no methods section, no implementation details of the multi-task depth loss or broadcast augmentation, and no ablation tables isolating each component's contribution to the MPJPE reductions.","section":"Abstract"},{"comment":"Abstract: the stratified clip split is described only at the level of a name; no clip-length statistics, stratification criteria, or quantitative overlap measures between training and validation clips are given, leaving open the possibility that the measured gain partly reflects a more favorable partition rather than the algorithmic contributions.","section":"Abstract"},{"comment":"Abstract: no error analysis, per-scene breakdown, or failure-case discussion is provided to support the attribution of the test-set Global MPJPE (0.324 m) and Local MPJPE (0.054 m) specifically to the RAFT tracker and foot-plane anchoring.","section":"Abstract"}],"minor_comments":[{"comment":"The abstract reports both validation and test scores but does not state whether the validation split was fixed before any hyper-parameter search or whether the reported numbers reflect a single run or the best of several runs.","section":"Abstract"}],"recommendation":"major_revision","confidential_remarks":null},"author_rebuttal":{"model":"grok-4.3","summary":"We thank the referee for the constructive feedback highlighting the need for expanded methodological transparency and analysis in our challenge submission. We address each major comment below and will revise the manuscript to incorporate the requested details.","responses":[{"response":"We agree that the current concise format lacks a dedicated methods section and ablations. In the revised manuscript we will add a full methods section detailing the multi-task depth loss formulation, broadcast augmentation pipeline, and ablation tables that isolate the contribution of each component (stratified finetuning, RAFT tracking, foot-plane anchoring) to the reported MPJPE reductions.","revision_made":"yes","referee_comment":"[Abstract] Abstract: the central claim that the 38.6% validation improvement is produced by the finetuning choices, RAFT tracker, and foot-plane anchoring cannot be evaluated because the manuscript supplies no methods section, no implementation details of the multi-task depth loss or broadcast augmentation, and no ablation tables isolating each component's contribution to the MPJPE reductions."},{"response":"We will expand the data section to report clip-length statistics, explicit stratification criteria (e.g., by camera motion, player density, and scene type), and quantitative overlap measures such as average temporal overlap and feature similarity between train and validation clips to demonstrate that the partition does not artificially inflate performance.","revision_made":"yes","referee_comment":"[Abstract] Abstract: the stratified clip split is described only at the level of a name; no clip-length statistics, stratification criteria, or quantitative overlap measures between training and validation clips are given, leaving open the possibility that the measured gain partly reflects a more favorable partition rather than the algorithmic contributions."},{"response":"We acknowledge the absence of error analysis. The revision will include a dedicated analysis section with per-scene MPJPE breakdowns, qualitative failure cases, and quantitative attribution experiments showing the incremental effect of the RAFT tracker and foot-plane anchoring on the final Global and Local MPJPE values.","revision_made":"yes","referee_comment":"[Abstract] Abstract: no error analysis, per-scene breakdown, or failure-case discussion is provided to support the attribution of the test-set Global MPJPE (0.324 m) and Local MPJPE (0.054 m) specifically to the RAFT tracker and foot-plane anchoring."}],"tokens_in":1374,"tokens_out":512,"duration_ms":14458,"standing_objections":[]},"desk_editor":{"model":"grok-4.3","letter":"The paper is a FIFA Skeletal Tracking Challenge submission. It starts from SMPLest-X, applies a stratified clip split plus multi-task depth supervision and broadcast augmentation during finetuning, then layers on RAFT optical flow for camera tracking, foot-plane anchoring, and temporal smoothing. On the validation set it moves the score from the baseline 1.053 to 0.647; on the held-out test set it reaches 0.593 with the reported global and local MPJPE values.\n\nNothing in the method is new. SMPLest-X and RAFT are existing components, and the finetuning steps are standard practice. The work is an empirical application to one narrow domain rather than a new algorithm or derivation.\n\nWhat it does well is ship concrete numbers on a true held-out test set and break the metric into global and local components. That gives other challenge participants a usable reference point.\n\nThe main weakness is the missing link between the listed techniques and the reported gains. The abstract gives no ablation tables, no quantitative description of the clip split (lengths, stratification rules, overlap checks), and no error analysis. Without those, it is impossible to tell how much of the 38% validation improvement comes from the RAFT tracker or foot anchoring versus from how the validation clips were chosen. The circularity burden noted in the stress test is real on the evidence supplied.\n\nThis paper is for teams already working on the FIFA challenge or for applied sports-vision practitioners who need a practical baseline. A reader looking for new ideas in 3D human modeling or tracking will not find them. It does not contain the formal grounding or evidential sharpness that would justify sending it to serious referees.","headline":"This is a competition entry that finetunes SMPLest-X with RAFT and standard tricks for soccer pose, reports clear test-set numbers, but adds no new methods and leaves the source of the 38% gain unverified.","tokens_in":2273,"tokens_out":440,"would_cite":false,"duration_ms":17208,"reading_group":"no","serious_thinker":"yes","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.3","headline":"Finetuned SMPLest-X with RAFT tracking and foot anchoring achieves 38.6 percent lower error than FIFA baseline for soccer pose estimation.","keywords":["soccer","pose estimation","3D reconstruction","optical flow","human mesh recovery","broadcast video","SMPL"],"falsifier":"Evaluating the SMART pipeline on an independent soccer video dataset collected separately from the challenge data and measuring if the MPJPE remains below 0.4 m.","tokens_in":2551,"feed_emoji":"⚽","tokens_out":620,"duration_ms":20522,"temperature":0.7,"pith_summary":"The paper presents SMART as an approach to the FIFA Skeletal Tracking Challenge for estimating 3D poses of soccer players from broadcast video. It finetunes the large SMPLest-X model using a stratified clip split, multi-task depth supervision, and broadcast augmentation. These are paired with a RAFT dense optical flow camera tracker, foot-plane anchoring, and two-pass temporal smoothing. On the validation set this yields a score of 0.647 against the baseline of 1.053, and 0.593 on the held-out test set with specific MPJPE values.","feed_headline":"Soccer pose method improves FIFA score by 38 percent","feed_subtitle":"Finetuned SMPLest-X plus RAFT tracking and foot anchoring reaches 0.593 on held-out test set.","key_machinery":"SMPLest-X finetuning combined with RAFT optical flow tracking and foot-plane anchoring to enforce temporal consistency and ground contact in 3D pose estimates from video.","core_discovery":"SMART finetunes SMPLest-X via stratified clip split, multi-task depth supervision, and broadcast augmentation, paired with a RAFT dense optical flow camera tracker, foot-plane anchoring, and two-pass temporal smoothing to achieve a validation score of 0.647, a 38.6 percent improvement over the FIFA baseline of 1.053, and a test score of 0.593.","pith_inferences":["Similar adaptation techniques could improve pose estimation in other dynamic sports with broadcast footage.","Large mesh models may generalize better to new domains when combined with dense flow tracking for camera motion."],"forward_implications":["Global MPJPE of 0.324 m and local MPJPE of 0.054 m on the test set indicate accurate world-space and relative joint positions.","The method works on standard broadcast video without specialized camera setups.","Temporal smoothing produces smoother pose sequences over time.","Foot-plane anchoring maintains realistic player-ground interactions."],"fun_headline_variants":["SMART reaches 0.647 on FIFA soccer pose validation","38.6 percent improvement to 0.593 test score with SMART","SMPLest-X and RAFT yield 0.593 in soccer pose test","Foot-plane anchoring improves soccer pose FIFA score 38 percent"],"cache_read_input_tokens":2112,"weakest_assumption_plain":"The improvements are attributable to the described finetuning choices, RAFT tracker, and foot-plane anchoring rather than to undisclosed data leakage, metric-specific tuning, or post-hoc selection of the validation split.","fun_headline_variants_meta":{"raw":{"variants":["SMART reaches 0.647 on FIFA soccer pose validation","38.6 percent improvement to 0.593 test score with SMART","SMPLest-X and RAFT yield 0.593 in soccer pose test","Foot-plane anchoring improves soccer pose FIFA score 38 percent"]},"model":"grok-4.3","cost_usd":0.00577,"raw_usage":{"total_tokens":2708,"prompt_tokens":585,"num_sources_used":0,"completion_tokens":73,"cost_in_usd_ticks":57699500,"prompt_tokens_details":{"text_tokens":585,"audio_tokens":0,"image_tokens":0,"cached_tokens":256},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":2050,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":585,"tokens_out":73,"duration_ms":13476,"temperature":1.0,"reasoning_tokens":2050,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-06-28T22:43:43.254693+00:00","model_set":{"reader":"grok-4.3"},"falsifier":"Evaluating the SMART pipeline on an independent soccer video dataset collected separately from the challenge data and measuring if the MPJPE remains below 0.4 m.","supporting_citations":[],"review_version":1}