REVIEW 7 cited by
Improving Federated Learning Personalization via Model Agnostic Meta Learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Federated Learning (FL) refers to learning a high quality global model based on decentralized data storage, without ever copying the raw data. A natural scenario arises with data created on mobile phones by the activity of their users. Given the typical data heterogeneity in such situations, it is natural to ask how can the global model be personalized for every such device, individually. In this work, we point out that the setting of Model Agnostic Meta Learning (MAML), where one optimizes for a fast, gradient-based, few-shot adaptation to a heterogeneous distribution of tasks, has a number of similarities with the objective of personalization for FL. We present FL as a natural source of practical applications for MAML algorithms, and make the following observations. 1) The popular FL algorithm, Federated Averaging, can be interpreted as a meta learning algorithm. 2) Careful fine-tuning can yield a global model with higher accuracy, which is at the same time easier to personalize. However, solely optimizing for the global model accuracy yields a weaker personalization result. 3) A model trained using a standard datacenter optimization method is much harder to personalize, compared to one trained using Federated Averaging, supporting the first claim. These results raise new questions for FL, MAML, and broader ML research.
Forward citations
Cited by 7 Pith papers
-
FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fields
MDIR detects LLM weight homology from embedding matrices alone using polar decomposition and permutation matching, achieving perfect AUC and accuracy on LeaFBench and reconstructing layer-level transformations.
-
Federated Learning with Heterogeneous and Private Label Sets
By averaging classifier weights per label across clients and tuning the central model on unlabeled data, federated learning can handle private, heterogeneous client label sets at accuracy close to the public-label setting.
-
Addressing the Collaboration Dilemma in Low-Data Federated Learning via Transient Sparsity
LIPS, a method that periodically prunes low-sensitivity middle-layer weights after aggregation, mitigates layer-wise inertia and improves low-data federated learning accuracy.
-
Collate: Collaborative Neural Network Learning for Latency-Critical Edge Systems
Collate jointly trains heterogeneous models under per-device latency constraints via dynamic zeroizing-recovering and proto-corrected aggregation, gaining ~2–3% accuracy over prior heterogeneous FL.
-
SuperSFL: Resource-Heterogeneous Federated Split Learning with Weight-Sharing Super-Networks
A weight-sharing super-network plus locally supervised gradient fusion makes split-federated learning converge in fewer communication rounds than fixed-split baselines.
-
The OCR Quest for Generalization: Learning to recognize low-resource alphabets with model editing
Merging task vectors from separately fine-tuned OCR experts improves out-of-domain generalization and transfer to low-resource alphabets compared to centralized fine-tuning on the same data.
-
Federated Learning with Unlabeled Clients: Personalization Can Happen in Low Dimensions
FLowDUP generates personalized federated models for unlabeled clients via a hypernetwork operating in a low-dimensional random subspace, with a transductive multi-task PAC-Bayes bound motivating the objective.
Discussion (0). Sign in to comment.