Pith. sign in

REVIEW 5 cited by

Multimodal Federated Learning in Healthcare: a Review

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2310.09650 v2 pith:LZXFNPJT submitted 2023-10-14 cs.LG cs.AI

classification cs.LGcs.AI
keywords healthcarelearningmultimodaldatafederatedprivacyadvancementsdomain
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Recent advancements in multimodal machine learning have empowered the development of accurate and robust AI systems in the medical domain, especially within centralized database systems. Simultaneously, Federated Learning (FL) has progressed, providing a decentralized mechanism where data need not be consolidated, thereby enhancing the privacy and security of sensitive healthcare data. The integration of these two concepts supports the ongoing progress of multimodal learning in healthcare while ensuring the security and privacy of patient records within local data-holding agencies. This paper offers a concise overview of the significance of FL in healthcare and outlines the current state-of-the-art approaches to Multimodal Federated Learning (MMFL) within the healthcare domain. It comprehensively examines the existing challenges in the field, shedding light on the limitations of present models. Finally, the paper outlines potential directions for future advancements in the field, aiming to bridge the gap between cutting-edge AI technology and the imperative need for patient data privacy in healthcare applications.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Prototype-conditioned Mixture-of-Experts synthesizes missing modalities in federated learning and beats prior methods on heterogeneous chest X-ray clients without public data.

  2. Multimodal Federated Learning With Missing Modalities through Feature Imputation Network

    cs.LG 2025-05 conditional novelty 6.0 of 10

    A federated feature imputation network that synthesizes missing modality bottleneck features improves multimodal federated learning accuracy over naive and generative baselines.

  3. Federated Foundation Model for GI Endoscopy Images

    cs.CV 2025-05 conditional novelty 5.0 of 10

    Federated self-supervised pretraining with masked autoencoders produces GI endoscopy representations that outperform single-site training and approach centralized training on classification, detection, and segmentation.

  4. Multimodal Federated Learning: A Survey through the Lens of Different FL Paradigms

    cs.LG 2025-05 conditional novelty 5.0 of 10

    A paradigm-based taxonomy of multimodal federated learning that assigns each branch a headline challenge: modality heterogeneity (horizontal), privacy leakage (vertical), and efficiency (hybrid).

  5. ClusMFL: A Cluster-Enhanced Framework for Modality-Incomplete Multimodal Federated Learning in Brain Imaging Analysis

    eess.IV 2025-02 conditional novelty 5.0 of 10

    ClusMFL uses FINCH cluster centers as modality proxies with contrastive alignment and modality-aware aggregation to improve multimodal federated learning when clients have incomplete MRI or PET data.

Pith tools