{"id":"3e0111e8-59e3-4325-9364-f691098234fb","arxiv_id":"2508.01802","paper_version":1,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":6.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"SoccerTrack v2 provides full-length panoramic 4K multi-view soccer videos annotated with player positions, identities, roles, teams, and 12 ball action classes.","lead":"This paper introduces SoccerTrack v2, a public dataset of ten full-length panoramic 4K soccer match recordings with player tracking and ball action annotations. It aims to help researchers build automated tools for game state reconstruction and tactical analysis in soccer.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The central claim that BePro cameras provide 'complete player visibility' is not supported by any occlusion statistics or annotation-quality metrics in the available text, so the dataset's full-pitch tracking and GSR value rest on an unverified premise.","rationale":"The reader's verdict is UNVERDICTED because the full text is corrupted. I examined the abstract as the only reliable evidence. The strongest claim is that SoccerTrack v2 provides full-pitch multi-view 4K recordings with complete player visibility and GSR/BAS annotations. For this claim to be true, the camera arrangement must provide at least one unoccluded view of every player at every frame. This is an empirical property that cannot be assumed from the camera brand; occlusion in crowded soccer scenes is a standard failure mode. The manuscript (as available) provides no statistics to support it, and the corrupted full text cannot supply them. I considered whether the more load-bearing concern is annotation accuracy or the dataset's public availability. Both are important, but the 'complete player visibility' assumption is the one that, if false, invalidates the dataset's raison d'être for full-pitch game state reconstruction regardless of annotation quality. Therefore I agree with the reader's weakest_assumption. My proposed check would settle the concern by directly measuring occlusion rates. The verdict remains UNCHANGED: with no verifiable evidence either way, the paper stays unverdictable; the check is a precondition for moving toward acceptance.","tokens_in":4170,"tokens_out":4330,"duration_ms":49803,"concrete_test":"Download the released dataset and, on a random sample of frames (e.g., 5% across all 10 matches), compute for every annotated player whether that player is visible in at least one camera, using the provided calibration to project 2D pitch coordinates and person detections. Report the fraction of player-frames with occlusion-free visibility, per match and per pitch region (goalmouths, sidelines). If the overall fraction is not above ~95%, the 'complete player visibility' claim is refuted and full-pitch MOT/GSR benchmarks are compromised. Also compare an independent tracker's ID-switch rate to occlusion events to confirm.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The dataset's central value proposition, stated in the abstract, is that BePro multi-view recordings provide 'complete player visibility' for full-pitch tracking and game state reconstruction. If any player is frequently outside all camera fields-of-view or occluded by other players/structures in every view, then the 2D pitch-coordinate GSR labels cannot be reliably produced for that player, and MOT/GSR benchmarks built on this data would be compromised. The available manuscript (the full text is corrupted/unreadable) contains no camera count, camera placement diagram, occlusion statistics, frame-level visibility rates, or inter-annotator agreement / reprojection error for the GSR labels. Thus the strongest claim is currently an unsupported empirical assertion. This is not to say the claim is false; but it is the least secure load-bearing assumption. Since the entire downstream contribution (full-pitch MOT, GSR, BAS) depends on it, the paper cannot be evaluated without this evidence.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The manuscript introduces SoccerTrack v2, a proposed public dataset of ten full-length, panoramic 4K recordings of university-level soccer matches, captured with BePro cameras. The abstract claims that the dataset provides game-state reconstruction (GSR) labels in the form of 2D pitch coordinates, jersey-based player IDs, roles, and teams, plus ball action spotting (BAS) labels for 12 action classes, with the stated purpose of advancing multi-object tracking, game-state reconstruction, and ball action spotting. The abstract is readable, but the supplied full text is almost entirely corrupted by character-encoding errors, so the collection pipeline, annotation procedures, dataset statistics, and any validation results could not be examined. The central contribution is plausible but is presented without quantitative support in the available text.","tokens_in":4292,"tokens_out":2575,"duration_ms":35725,"significance":"If the dataset actually contains what the abstract describes, it would be a valuable public resource: full-pitch multi-view footage with synchronized GSR and BAS labels is rare, and a public release could support reproducible MOT, GSR, and BAS benchmarks for sports analytics. The paper's credibility, however, depends entirely on evidence that is not present: camera coverage statistics, annotation-quality measures, dataset statistics, and a usable description of the collection and annotation pipeline. The full text is unreadable, so as submitted the central claim is an unsupported assertion rather than a documented dataset contribution.","major_comments":[{"comment":"The abstract's central claim that BePro cameras provide 'complete player visibility' is load-bearing for the dataset's value, but the manuscript provides no supporting evidence: there is no camera count, no camera placement diagram, no frame-level visibility rates, no occlusion statistics, and no discussion of how players outside the field of view or occluded in all views are handled. The relevant collection-pipeline text is unreadable due to encoding corruption, so I could not verify this premise. The paper should add a detailed camera-array description and quantitative coverage/occlusion statistics, or explicitly qualify the visibility claim.","section":"Abstract; Full Text, Collection Pipeline section"},{"comment":"No annotation-quality metrics are provided for the GSR labels. The manuscript should report inter-annotator agreement, reprojection error, and the protocol for resolving occlusions and identity switches, since the 2D pitch-coordinate labels and jersey-based player IDs are the core of the dataset. Without such measures, benchmark users cannot assess label reliability, and the claimed suitability for MOT and GSR is not established.","section":"Full Text, Annotation Process section"},{"comment":"The BAS labels for 12 action classes are listed in the abstract, but the manuscript reports no class definitions, no annotation guidelines, no segment boundaries or event timestamps, no class distribution, and no agreement statistics. These details are necessary for the dataset to be usable for ball action spotting and for comparisons across methods.","section":"Full Text, BAS annotation section"},{"comment":"The dataset statistics are essentially absent from the readable portion: no number of frames, no total duration per match, no number of annotated tracks, no resolution and frame-rate details, and no train/validation/test split are given. Because the full text is garbled, I could not locate any of these quantities. A dataset paper should present these numbers prominently, along with sample frames and annotation visualizations.","section":"Full Text, Dataset Statistics section"}],"minor_comments":[{"comment":"The abstract does not report even basic dataset statistics such as the number of frames, total duration, or number of annotated player tracks; adding these would make the contribution concrete.","section":"Abstract"},{"comment":"The full text is encoded as mojibake and is not readable; the authors should resubmit a properly encoded manuscript.","section":"Full Text"},{"comment":"The terms 'panoramic 4K' and 'full-pitch' should be defined precisely: whether each recording is a single stitched panorama, how many camera views are fused, and what angular coverage each camera provides.","section":"Full Text"},{"comment":"The manuscript does not cite the original SoccerTrack dataset or other comparable multi-view soccer datasets, which makes it difficult to assess novelty and incremental contribution.","section":"Full Text"}],"recommendation":"major_revision","confidential_remarks":"The main barrier is not a fundamental flaw in the dataset concept but the total absence of verifiable evidence in the submitted text. If the authors can provide a readable manuscript with camera geometry, annotation-quality metrics, dataset statistics, and sample visualizations, the contribution may be a solid dataset paper. I would not recommend rejection on the basis of the abstract alone, since the central claim is plausible, but the current submission cannot be accepted or meaningfully evaluated."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Short version: the abstract describes SoccerTrack v2, a public dataset of 10 full-length panoramic 4K multi-view university soccer matches with game-state reconstruction (GSR) and ball-action-spotting (BAS) labels. That combination is genuinely new: most prior soccer datasets are broadcast-view or short clips, and unifying GSR with BAS on full matches fills a real gap. If the data ships as described, it will be a useful resource for MOT, tracking, and sports analytics.\n\nWhat the paper does well: the design choices are sensible—panoramic 4K, multi-view, 2D pitch coordinates, jersey-based IDs, 12 BAS classes. The goals are clear, and the contribution is concrete rather than a tweak of an existing benchmark. The authors are part of a line of work that has already released SoccerTrack v1, so the dataset is presumably meant to be a living resource.\n\nNow the soft spots, and they are real but mostly about verification. The abstract makes a load-bearing claim: BePro cameras provide \"complete player visibility\" for the whole pitch. There are no occlusion statistics, no camera count or placement diagram, no frame-level visibility rates, no annotation agreement numbers, no reprojection error, and no baseline results in the abstract. The full text we were given is corrupted, so we cannot check whether those numbers exist in the body. If they are missing, the paper is currently an unsupported assertion wrapped around a potentially valuable dataset. Also, 10 matches is a modest size; it may be enough for benchmarking, but the community will want to know match length, frame rates, and how the data split is designed.\n\nI don't think any of this is fatal. Dataset papers can be judged by whether the data is released, what the annotations look like, and whether the paper provides enough evidence that the annotations are correct. The authors should add visibility statistics, inter-annotator agreement, and at least one baseline (e.g., a simple tracking or GSR method) to the technical report. If those are already in the missing full text, then the abstract is just too thin.\n\nBottom line: this is a paper for the computer-vision/sports-analytics community. A serious referee could get useful signal from it if the data is public and the metrics exist. I would send it to review, with the explicit request that the referee verify dataset access and annotation quality. Reading group? Maybe, once the full text is readable.","headline":"A plausibly useful soccer dataset whose core visibility guarantee cannot be checked from the abstract alone; worth sending to review if the data is public and the missing metrics exist in the full text.","tokens_in":4804,"tokens_out":1880,"would_cite":false,"duration_ms":21123,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"SoccerTrack v2 is a public dataset of ten full-length panoramic 4K university matches with dense tracking and ball-action labels, built to let vision systems reconstruct game state over entire games.","keywords":["multi-object tracking","game state reconstruction","ball action spotting","soccer analytics","multi-view dataset","panoramic video","player tracking","action spotting"],"falsifier":"Compute, from the released labels, the fraction of frames in each match where some on-pitch player has no valid 2D pitch coordinate. If any full match has a substantial gap rate—for instance, more than 1% of frames missing at least one player—the complete-visibility premise is falsified.","tokens_in":3979,"feed_emoji":"⚽","tokens_out":4526,"duration_ms":56544,"temperature":0.7,"pith_summary":"SoccerTrack v2 is a public dataset intended to move soccer video analysis from short clips and broadcast views to full matches. It provides ten full-length, panoramic 4K recordings of university-level matches, captured with BePro cameras arranged for complete player visibility across the whole pitch. Each video comes with game state reconstruction labels—2D pitch coordinates, jersey-based player IDs, roles, and teams—plus ball action spotting labels for 12 action classes such as Pass, Drive, and Shot. If the data delivers what it promises, the field gains a common benchmark on which tracking, game state reconstruction, and action spotting can be trained and compared end to end.","feed_headline":"Ten full 4K matches labeled for full-pitch soccer tracking","feed_subtitle":"SoccerTrack v2 adds player positions, jersey IDs, and 12 ball-action labels for entire games, not clipped highlights.","key_machinery":"The central object is the annotated corpus, not a new algorithm. It is built around the BePro multi-camera rig, whose panoramic 4K output is meant to keep every player visible for the entire match. The annotation pipeline attaches to each frame the labels that make game state reconstructable: on-pitch coordinates, stable jersey-based player IDs, role and team tags, and 12 ball-action classes (Pass, Drive, Shot, and others). The complete player visibility property is the load-bearing mechanism: it is what lets the dataset serve as ground truth for full-match reconstruction rather than as a collection of tractable highlight clips.","core_discovery":"The paper's central claim is that a single public dataset can support the three linked tasks of multi-object tracking, game state reconstruction, and ball action spotting at full-match scale. SoccerTrack v2 consists of ten full-length panoramic 4K recordings of university matches with dense labels: per-frame 2D pitch coordinates, jersey-based player identities that persist across the match, player roles, and team assignments, together with ball action annotations covering 12 classes. The authors argue that this combination—full matches, complete player visibility, and synchronized action labels—is what prior datasets lack, and that it is what would allow automated tactical analysis and game state reconstruction to be studied as one problem rather than as isolated subproblems.","pith_inferences":["The university-level matches and a single capture setup mean transfer to professional, broadcast-style video is an open question; a cross-dataset evaluation against broadcast benchmarks would settle it.","If the complete-visibility claim is to be useful, the dataset should also expose per-frame missing-player indicators, allowing users to distinguish tracker failures from genuinely invisible players.","Because the same rig supplies all ten matches, the dataset may encode a fixed camera geometry; releasing calibration details would let later datasets vary venue and camera height without redoing the annotation scheme."],"forward_implications":["Full-match player identity tracks become a standard evaluation target, since jersey-based IDs persist rather than being reset every clip.","Ball action spotting can be studied jointly with tracking, enabling downstream statistics such as pass maps, pressing metrics, and shot sequences.","Models trained on this data can be evaluated under complete visibility conditions, removing player loss due to broadcast cuts as an excuse for track failures.","The released labels lower the annotation barrier for new benchmarks in soccer analytics, so new methods can be compared on common ground."],"supporting_citations":[],"fun_headline_variants":["SoccerTrack v2: full-pitch 4K dataset for game state reconstruction","Ten full 4K matches with jersey IDs and ball actions","Full-pitch multi-view soccer dataset for tracking and reconstruction","New soccer dataset: 10 panoramic 4K matches with dense labels","SoccerTrack v2 enables full-match game state reconstruction"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"That every player on the pitch is actually visible to the BePro cameras for the entirety of each of the 10 matches, so the ground-truth coordinates never go silent; if occlusion or out-of-view gaps occur often, the dataset cannot deliver the full-match game state reconstruction it promises.","fun_headline_variants_meta":{"raw":{"variants":["SoccerTrack v2: full-pitch 4K dataset for game state reconstruction","Ten full 4K matches with jersey IDs and ball actions","Full-pitch multi-view soccer dataset for tracking and reconstruction","New soccer dataset: 10 panoramic 4K matches with dense labels","SoccerTrack v2 enables full-match game state reconstruction"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000204,"raw_usage":{"total_tokens":1330,"prompt_tokens":828,"completion_tokens":502,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":444,"completion_tokens_details":{"reasoning_tokens":411}},"tokens_in":444,"tokens_out":502,"duration_ms":5402,"temperature":1.0,"reasoning_tokens":411,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-06T05:21:21.358623+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Compute, from the released labels, the fraction of frames in each match where some on-pitch player has no valid 2D pitch coordinate. If any full match has a substantial gap rate—for instance, more than 1% of frames missing at least one player—the complete-visibility premise is falsified.","supporting_citations":[],"review_version":1}