Pith. sign in

REVIEW 22 cited by

Data Filtering Networks

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2309.17425 v3 pith:NCTF5MND submitted 2023-09-29 cs.AI cs.LG

classification cs.AIcs.LG
keywords datafilteringdatasettrainedimagenetlearningnetworkstraining
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large training sets have become a cornerstone of machine learning and are the foundation for recent advances in language modeling and multimodal learning. While data curation for pre-training is often still ad-hoc, one common paradigm is to first collect a massive pool of data from the Web and then filter this candidate pool down to an actual training set via various heuristics. In this work, we study the problem of learning a data filtering network (DFN) for this second step of filtering a large uncurated dataset. Our key finding is that the quality of a network for filtering is distinct from its performance on downstream tasks: for instance, a model that performs well on ImageNet can yield worse training sets than a model with low ImageNet accuracy that is trained on a small amount of high-quality data. Based on our insights, we construct new data filtering networks that induce state-of-the-art image-text datasets. Specifically, our best performing dataset DFN-5B enables us to train state-of-the-art CLIP models for their compute budgets: among other improvements on a variety of tasks, a ViT-H trained on our dataset achieves 84.4% zero-shot transfer accuracy on ImageNet, out-performing models trained on other datasets such as LAION-2B, DataComp-1B, or OpenAI's WIT. In order to facilitate further research in dataset design, we also release a new 2 billion example dataset DFN-2B and show that high performance data filtering networks can be trained from scratch using only publicly available data.

Discussion (0). Sign in to comment.

Forward citations

Cited by 22 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Revisiting Model Stitching In the Foundation Model Era

    cs.CV 2026-03 accept novelty 7.0 of 10

    Final-feature matching makes heterogeneous VFMs reliably stitchable; stitched models fuse complementary strengths and enable efficient multi-VFM Stitch Trees for multimodal LLMs.

  2. Meta CLIP 2: A Worldwide Scaling Recipe

    cs.CV 2025-07 conditional novelty 7.0 of 10

    A data curation and training recipe that scales CLIP from English-only data to 300+ languages from scratch, breaking the curse of multilinguality at ViT-H/14 scale.

  3. Synthetic Visual Genome

    cs.CV 2025-06 conditional novelty 7.0 of 10

    A GPT-4V/GPT-4o pipeline for completing and refining scene graph annotations yields a dense synthetic dataset that, after instruction tuning, gives a 3B model strong relationship understanding and grounding results.

  4. Twins: Learn to Predict Unified Representations with Focal Loss

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Channel-wise concatenation of SigLIP2 and Flux VAE features into one token, trained with a focal-style flow-matching loss, yields a unified representation with 1.59 gFID on ImageNet 256 and VAE-level reconstruction.

  5. Do All Visual Tokens Matter Equally? Object-Evidence Preserving Token Merging for Vision-Language Retrieval

    cs.IR 2026-07 conditional novelty 6.0 of 10

    Object-aware soft merging of post-projector visual tokens preserves MaxSim-selectable evidence, yielding >93% token reduction and higher R@1 than full ColPali on Flickr30K and MSCOCO.

  6. Distribution Matching Distillation Meets Reinforcement Learning

    cs.CV 2025-11 conditional novelty 6.0 of 10

    Combining DMD distillation with RL during training produces few-step text-to-image models that outperform their multi-step teacher on several benchmarks.

  7. EgoPrivacy: What Your First-Person Camera Says About You?

    cs.CV 2025-06 conditional novelty 6.0 of 10

    A new benchmark and attack show that egocentric videos leak wearer demographics and identity well above chance, and that matching third-person clips strengthens demographic attacks.

  8. Kernel-based Unsupervised Embedding Alignment for Enhanced Visual Representation in Vision-language Models

    cs.CV 2025-06 conditional novelty 6.0 of 10

    Fine-tuning CLIP's visual encoder to match DINOv2's kernel-based similarity structure improves its fine-grained visual perception while preserving its alignment to text.

  9. SurgVLM: A Large Vision-Language Model and Systematic Evaluation Benchmark for Surgical Intelligence

    cs.CV 2025-06 conditional novelty 6.0 of 10

    SurgVLM, a family of surgical vision-language models trained on 1.81M frames and 7.79M conversations, outperforms 14 commercial VLMs on a six-dataset surgical benchmark.

  10. SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning

    cs.RO 2025-05 conditional novelty 6.0 of 10

    SCIZOR filters suboptimal and redundant state-action pairs from robot demonstrations without human labels, improving imitation-learning policy success rates by about 15% on average.

  11. TokBench: Evaluating Your Visual Tokenizer before Visual Generation

    cs.CV 2025-05 conditional novelty 6.0 of 10

    TokBench measures text recognition accuracy and face similarity on reconstructed images and videos across 16 tokenizers, showing small text and faces are poorly preserved and often missed by traditional metrics.

  12. Qwen-Audio-VAE Technical Report

    eess.AS 2026-07 conditional novelty 5.0 of 10

    A 12.5 Hz continuous audio VAE reconstructs speech, music, and sound well while encoding 64×30s clips in 541 ms after latency-aware encoder pruning.

  13. MagicVL-2B: Empowering Vision-Language Models on Mobile Devices with Lightweight Visual Encoders via Curriculum Learning

    cs.CV 2025-08 unverdicted novelty 5.0 of 10

    MagicVL-2B is a 2B vision-language model for mobile phones that claims state-of-the-art-matching accuracy at 41.1% lower on-device power, via a lightweight encoder, dynamic resolution, and curriculum learning.

  14. Using Scaling Laws for Data Source Utility Estimation in Domain-Specific Pre-Training

    cs.LG 2025-07 conditional novelty 5.0 of 10

    Running multiple short annealing runs at different token scales can reveal per-source utility scaling curves that change data-source rankings compared with single point estimates.

  15. (Almost) Free Modality Stitching of Foundation Models

    cs.CV 2025-07 conditional novelty 5.0 of 10

    A hypernetwork that generates connector weights for all image-text model pairs can rank pairs like grid search at about 10x lower training cost, but the best connector lags grid search by a few points.

  16. Image Reconstruction as a Tool for Feature Analysis

    cs.CV 2025-06 conditional novelty 5.0 of 10

    Reconstruction fidelity from vision encoder features reveals which models preserve more visual information, and linear feature-space operations can produce color edits.

  17. DSCH-Loss: A Dynamic Semantic Channel Objective for Deep Semantic Hashing

    cs.AI 2026-07 conditional novelty 4.5 of 10

    Dynamic Semantic Channel Hashing (DSCH) replaces fixed-width SCH channels with continuous, similarity-dependent widths and positions, improving tie-aware mAP on most cross- and intra-modal retrieval tasks.

  18. OpenVision 2: A Family of Generative Pretrained Visual Encoders for Multimodal Learning

    cs.CV 2025-09 conditional novelty 4.0 of 10

    OpenVision 2 shows that a caption-only generative objective can match contrastive learning for multimodal vision encoders at lower training cost, scaling to 1B parameters.

  19. SAILViT: Towards Robust and Generalizable Visual Backbones for MLLMs via Gradual Feature Refinement

    cs.CV 2025-07 conditional novelty 4.0 of 10

    A three-stage coarse-to-fine training recipe for vision backbones produces consistent benchmark gains for lightweight multimodal LLMs.

  20. AMMKD: Adaptive Multimodal Multi-teacher Distillation for Lightweight Vision-Language Models

    cs.CV 2025-08 reject novelty 3.0 of 10

    AMMKD claims large gains from adaptively weighted two-teacher CLIP distillation, but its equations are internally inconsistent, its baselines are unverifiable, and its tests do not match its stated retrieval goal.

  21. Detecting Hope, Hate, and Emotion in Arabic Textual Speech and Multi-modal Memes Using Large Language Models

    cs.CL 2025-08 unverdicted novelty 3.0 of 10

    The submission cannot be reviewed as a coherent paper: its abstract and full text are two different papers, so the abstract's claims have no supporting body.

  22. Generalizing vision-language models to novel domains: A comprehensive survey

    cs.CV 2025-06 conditional novelty 3.0 of 10

    A survey of VLM generalization literature organized by transferred module, with benchmark tables and a review of multimodal LLMs.

Pith tools