The reviewed record of science sign in
Pith

arxiv: 2404.16233 · v2 · pith:BTDYBELR · submitted 2024-04-24 · cs.LG · cs.AI

AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Models

Zhiqiang Tang , Haoyang Fang , Su Zhou , Taojiannan Yang , Zihan Zhong , Tony Hu , Katrin Kirchhoff , George Karypis This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:BTDYBELRrecord.jsonopen to challenge →

classification cs.LG cs.AI
keywords autommautomltasksautogluon-multimodalclassificationdesignedfoundationimage
0
0 comments X
read the original abstract

AutoGluon-Multimodal (AutoMM) is introduced as an open-source AutoML library designed specifically for multimodal learning. Distinguished by its exceptional ease of use, AutoMM enables fine-tuning of foundation models with just three lines of code. Supporting various modalities including image, text, and tabular data, both independently and in combination, the library offers a comprehensive suite of functionalities spanning classification, regression, object detection, semantic matching, and image segmentation. Experiments across diverse datasets and tasks showcases AutoMM's superior performance in basic classification and regression tasks compared to existing AutoML tools, while also demonstrating competitive results in advanced tasks, aligning with specialized toolboxes designed for such purposes.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Beyond IID: How General Are Tabular Foundation Models, Really?

    cs.LG 2026-06 unverdicted novelty 7.0

    Tabular foundation models excel on tiny- to medium-sized IID data but are outperformed by traditional tree-based and deep learning models on non-IID, large, and high-dimensional datasets, based on evaluations across 1...

  2. TREX: Automating LLM Fine-tuning via Agent-Driven Tree-based Exploration

    cs.AI 2026-04 unverdicted novelty 6.0

    TREX automates the LLM training lifecycle via collaborative agents and tree-based exploration, delivering consistent performance gains across 10 real-world fine-tuning tasks in FT-Bench.

  3. Modular Multimodal Classification Without Fine-Tuning: A Simple Compositional Approach

    cs.LG 2026-05 unverdicted novelty 5.0

    CoMET achieves strong multimodal classification performance by composing frozen modality encoders, PCA compression, and tabular foundation models without any training, reaching state-of-the-art on diverse benchmarks i...