REVIEW 13 cited by
Federated Learning with Matched Averaging
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Federated learning allows edge devices to collaboratively learn a shared model while keeping the training data on device, decoupling the ability to do model training from the need to store the data in the cloud. We propose Federated matched averaging (FedMA) algorithm designed for federated learning of modern neural network architectures e.g. convolutional neural networks (CNNs) and LSTMs. FedMA constructs the shared global model in a layer-wise manner by matching and averaging hidden elements (i.e. channels for convolution layers; hidden states for LSTM; neurons for fully connected layers) with similar feature extraction signatures. Our experiments indicate that FedMA not only outperforms popular state-of-the-art federated learning algorithms on deep CNN and LSTM architectures trained on real world datasets, but also reduces the overall communication burden.
Forward citations
Cited by 13 Pith papers
-
Robust Federated Learning Under Real-World Client Churn
FeLiX reduces wall-clock time-to-target accuracy in federated learning by up to 2.37x using lightweight availability tiers, fresh-utility client selection, and informativeness-aware aggregation without requiring oracu...
-
Cyst-X: A Multi-Center MRI Benchmark and Federated Learning Framework for Malignancy-Risk Stratification of Pancreatic Cystic Neoplasm
A multi-center MRI benchmark and federated learning framework for IPMN malignancy-risk stratification, with an internal AUC of 0.85 on T2-weighted MRI.
-
Model Fusion via Retrofitting
A neuron-centric fusion method that clusters intermediate activations of independently trained models into importance-weighted centroids and fits the fused network to them, outperforming baselines in zero-shot non-IID...
-
FLsim: A Modular and Library-Agnostic Simulation Framework for Federated Learning
FLsim is a modular, library-agnostic federated learning simulation framework supporting custom strategies, multiple topologies, and pluggable blockchain consensus.
-
PROTEAN: Federated Intrusion Detection in Non-IID Environments through Prototype-Based Knowledge Sharing
PROTEAN combines global model averaging with class prototype sharing to improve rare-attack detection accuracy in non-IID federated intrusion detection.
-
Tackling Data Heterogeneity in Federated Learning through Knowledge Distillation with Inequitable Aggregation
KDIA uses a triFreqs-weighted all-client teacher model plus knowledge distillation and a conditional generator to improve accuracy and convergence in large-client, low-participation heterogeneous federated learning.
-
FedBKD: Distilled Federated Learning to Embrace Gerneralization and Personalization on Non-IID Data
A data-free GAN plus bidirectional knowledge distillation between global and local models improves both personalization and generalization in non-IID federated classification.
-
Optimal Transport-based Domain Alignment as a Preprocessing Step for Federated Learning
Wasserstein barycenter-based color alignment is claimed to boost FedAvg's CIFAR-10 accuracy from ~71% to ~99%, but the evaluation is questionable.
-
Tackling Heterogeneity in Federated Learning via Variance-Reduced Boltzmann Sampling within Homogeneous Social Coalitions
A variance-reduction-based client selection with coalition clustering yields modest accuracy gains over baselines in heterogeneous federated learning, but its convergence guarantee rests on an assumption that the poli...
-
Towards Graph-Based Privacy-Preserving Federated Learning: ModelNet -- A ResNet-based Model Classification Dataset
ModelNet creates three CIFAR-100-based benchmarks with controlled semantic diversity across 5,000 client subsets.
-
UniVarFL: Uniformity and Variance Regularized Federated Learning for Heterogeneous Data
UniVarFL adds a classifier variance regularizer and a hyperspherical uniformity regularizer to local federated training, reporting improved accuracy on some non-IID benchmarks but not consistently across its own experiments.
-
Collaborative Batch Size Optimization for Federated Learning
A distributed randomized binary search lets federated learning clients find a hardware-safe shared batch size within a few rounds, speeding up training compared to a small default batch size.
-
Accelerated Training of Federated Learning via Second-Order Methods
A survey that categorizes second-order federated learning methods and argues they reduce communication rounds, based on results borrowed from the cited papers rather than new experiments.
Discussion (0). Sign in to comment.