REVIEW 44 cited by
LEAF: A Benchmark for Federated Settings
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
LEAF: A Benchmark for Federated Settings
read the original abstract
Modern federated networks, such as those comprised of wearable devices, mobile phones, or autonomous vehicles, generate massive amounts of data each day. This wealth of data can help to learn models that can improve the user experience on each device. However, the scale and heterogeneity of federated data presents new challenges in research areas such as federated learning, meta-learning, and multi-task learning. As the machine learning community begins to tackle these challenges, we are at a critical time to ensure that developments made in these areas are grounded with realistic benchmarks. To this end, we propose LEAF, a modular benchmarking framework for learning in federated settings. LEAF includes a suite of open-source federated datasets, a rigorous evaluation framework, and a set of reference implementations, all geared towards capturing the obstacles and intricacies of practical federated environments.
Forward citations
Cited by 44 Pith papers
-
SpecGradFilter: A Spectral Gradient Filtering Framework for Taming Federated Heterogeneity
Inter-client gradient divergence in federated learning concentrates in low-frequency components; suppressing them via spectral or spatial high-pass filtering reduces client drift and raises accuracy under non-IID data.
-
FedXDS: Leveraging Model Attribution Methods to counteract Data Heterogeneity in Federated Learning
FedXDS uses propagation-based attribution to identify task-relevant features for selective data sharing in federated learning, yielding higher accuracy and faster convergence under heterogeneity with formal privacy gu...
-
Totoro$^+$: An Adaptive and Scalable Edge Federated Learning System
Totoro+ is a DHT-based fully decentralized FL system with locality-aware multi-ring P2P structure, pub/sub forest, and game-theoretic path planning that claims O(log N) hops and 1.2-14x speedup for many concurrent app...
-
Your Neighbors Know: Leveraging Local Neighborhoods for Backdoor Detection in Decentralized Learning
Argus enables backdoor detection in decentralized ML by collaborative neighbor-based validation of triggers, backed by convergence theory and reducing attack success by up to 90% on tested datasets.
-
Your Neighbors Know: Leveraging Local Neighborhoods for Backdoor Detection in Decentralized Learning
Argus detects backdoors in decentralized learning by local trigger analysis and neighbor similarity checks on consistency, with theoretical convergence guarantees and empirical reductions in attack success up to 90 points.
-
From Coordinate Matching to Structural Alignment: Rethinking Prototype Alignment in Heterogeneous Federated Learning
FedSAF shifts prototype alignment in heterogeneous federated learning from coordinate matching to inter-class structural relations and reports up to 3.52% gains over prior methods.
-
Data-Free Contribution Estimation in Federated Learning using Gradient von Neumann Entropy
Matrix von Neumann entropy of final-layer gradients acts as a data-free proxy for client contribution in federated learning, showing high correlation with standalone accuracy on non-IID benchmarks.
-
SMART: A Spectral Transfer Approach to Multi-Task Learning
SMART transfers knowledge in multi-task linear regression via spectral subspace similarity assumptions, achieving near-minimax Frobenius error rates while requiring only a fitted source model.
-
SketchGuard: Scaling Byzantine-Robust Decentralized Federated Learning via Sketch-Based Screening
SketchGuard decouples Byzantine filtering from aggregation in decentralized federated learning by exchanging k-dimensional Count Sketches for screening and full models only from accepted neighbors, achieving up to 50-...
-
FeDa4Fair: Client-Level Federated Datasets for Fairness Evaluation
FeDa4Fair is a new library and benchmark for creating federated datasets with heterogeneous client-level biases to standardize evaluation of fairness methods in federated learning.
-
FedFFT: Taming Client Drift in Federated SAM via Spectral Perturbation Filtering
Low-frequency components of client-side SAM perturbations carry most inter-client disagreement; high-pass filtering them yields more consistent federated updates and higher accuracy under non-IID data.
-
pFedUL: Layer-Aware Federated Unlearning for Personalized Federated Learning
Layer-aware selective unlearning for personalized FL matches near-retrain forgetting while retaining ~97% personalized accuracy for remaining clients across four pFL architectures.
-
AutoEncoder-Compressed Parallel Split Learning for Pre-trained Model Fine-Tuning
An autoencoder-based split-learning compressor with a two-stage alignment protocol achieves about 10x communication reduction during pre-trained vision-model fine-tuning with near-zero accuracy loss, outperforming heu...
-
NFSA: Non-Forward Secure Aggregation with One Server via Two Layer Secret Sharing
NFSA combines PRF-based two-layer secret sharing with CRT packing of almost key-homomorphic PRF masks to achieve single-server, one-shot secure aggregation without server-forwarded key shares.
-
PRoVeFL: Private Robust and Verifiable Aggregation in Federated Learning
Multi-server multi-key FHE with a shared random mask lets PRoVeFL run complex Byzantine-robust FL aggregation privately and verifiably, with large reported speedups over Prio and ELSA.
-
Closing the Alignment-Maturity Gap in Federated Prototype Learning
FedSAP stabilizes federated prototype learning via a deterministic alignment curriculum and proxy separation loss, reporting up to 4 percentage point gains under high heterogeneity across three benchmarks.
-
Silent Failures in Federated Personalization of Foundation Models
Federated personalization of foundation models creates hard-to-detect trustworthiness failures due to privacy constraints, and existing benchmarks cannot adequately evaluate them.
-
Efficient Multi-objective Prompt Optimization via Pure-exploration Bandits
Adapting multi-objective pure-exploration bandits enables efficient Pareto prompt set recovery and best feasible prompt identification for LLMs, with linear-case guarantees and empirical gains over baselines.
-
Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity
Rescaled ASGD recovers convergence to the true global objective by rescaling worker stepsizes proportional to computation times, matching the known time lower bound in the leading term under non-convex smoothness and ...
-
FED-FSTQ: Fisher-Guided Token Quantization for Communication-Efficient Federated Fine-Tuning of LLMs on Edge Devices
Fed-FSTQ uses Fisher information to guide token selection and mixed-precision quantization in federated PEFT, cutting uplink traffic 46x and wall-clock time-to-accuracy by 52% on multilingual and medical QA tasks.
-
PrivEraserVerify: Efficient, Private, and Verifiable Federated Unlearning
PrivEraserVerify unifies efficiency via adaptive checkpointing, privacy via layer-adaptive DP, and verifiability via fingerprints in federated unlearning, claiming 2-3x faster performance than retraining with formal g...
-
Breaking the Capacity Bottleneck in Model-Heterogeneous Federated Learning via Gradual Model Restoration
FedGMR progressively restores sub-model capacity for bandwidth-constrained clients via gradual density increases and mask-aware aggregation, narrowing the gap to full-model federated learning.
-
Benchmarking Robust Aggregation in Decentralized Gradient Marketplaces
Adaptive Sybil backdoor attacks can defeat MartFL, FLTrust, and SkyMask in buyer-baseline gradient marketplaces with little visible effect on accuracy or cost.
-
PracMHBench: Re-evaluating Model-Heterogeneous Federated Learning Based on Practical Edge Device Constraints
PracMHBench evaluates eight model-heterogeneous federated learning algorithms under practical edge device constraints and finds that depth-level heterogeneity wins under compute/communication limits while memory limit...
-
Incentivizing Honesty among Competitors in Collaborative Learning and Optimization
Formulates a game where competitors in collaborative learning are incentivized to manipulate updates, then proposes mechanisms that restore honest participation for mean estimation, convex SGD, and non-convex federate...
-
Adaptive Federated Optimization
Proposes federated adaptive optimizers (FedAdagrad, FedAdam, FedYogi) with convergence analysis for non-convex objectives under data heterogeneity and reports empirical gains over FedAvg.
-
HERO: A Heterogeneity-Aware Benchmark Library for Federated Continual Learning
HERO shows that FCL method rankings shift when client data skew and task-order mismatch are controlled separately, and that average accuracy can hide weak bottom-client performance.
-
Exploring CKKS Parameter Trade-offs for Privacy-Preserving Personalized Federated Learning
pFedCKKS derives CKKS parameter constraints for PFL under 128-bit security reducing choices to inner and outer ciphertext primes and evaluates precision-cost trade-offs on FEMNIST, CelebA and Sentiment140.
-
CRAFT: Conflict-Resolved Aggregation for Federated Training
CRAFT derives a closed-form solution for conflict-resolved aggregation in federated learning via geometric constraints and projection, with theoretical support for common descent and empirical gains on heterogeneous data.
-
FedFrozen: Two-Stage Federated Optimization via Attention Kernel Freezing
FedFrozen improves stability in heterogeneous federated Transformer training by warming up the full model then freezing the attention kernel (query/key) while optimizing the value block under a fixed kernel.
-
FED-FSTQ: Fisher-Guided Token Quantization for Communication-Efficient Federated Fine-Tuning of LLMs on Edge Devices
Fed-FSTQ uses Fisher-guided token quantization to cut uplink traffic 46-fold and improve straggler-limited time-to-accuracy by 52% versus Fed-LoRA in non-IID multilingual and medical QA tasks.
-
FED-FSTQ: Fisher-Guided Token Quantization for Communication-Efficient Federated Fine-Tuning of LLMs on Edge Devices
Fed-FSTQ reduces uplink traffic by 46x and improves time-to-accuracy by 52% in federated LLM fine-tuning using Fisher-guided token quantization and selection.
-
DFCA: Decentralized Federated Clustering Algorithm
DFCA decentralizes IFCA-style clustered federated learning: clients keep one model per cluster, train their assigned model locally, and exchange only that model with neighbors via a running average, matching centraliz...
-
FLAegis: A Two-Layer Defense Framework for Federated Learning Against Poisoning Attacks
FLAegis defends federated learning by SAX-transforming client updates, spectral-clustering them to filter malicious clients, and applying FFT-based robust aggregation, outperforming several baselines on FEMNIST.
-
Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification
Non-identical data distributions degrade federated averaging accuracy on visual classification, but server momentum raises CIFAR-10 accuracy from 30.1% to 76.9% in the most skewed regimes.
-
Federated Learning for Object Detection: Enabling Collaborative Drone Learning Without Centralizing Data
FedAvg on non-IID KIIT-MiTA drone imagery recovers most centralized YOLO nano mAP while keeping images local, with YOLO26 nano gaining ~53% and ~68% relative mAP over single-drone baselines.
-
FedMTFI: Feature Importance Based Optimized Multi Teacher Knowledge Distillation in Heterogeneous Federated Learning Environment
FedMTFI clusters heterogeneous clients, trains cluster prototypes, and applies multi-teacher distillation with SHAP to improve accuracy over standard FL in non-IID settings.
-
Task2vec Readiness: Diagnostics for Federated Learning from Pre-Training Embeddings
Task2Vec-based unsupervised metrics of client embedding cohesion, dispersion, and density correlate strongly with final federated learning performance across multiple datasets and heterogeneity levels.
-
PrivacyBench: Privacy Isn't Free in Hybrid Privacy-Preserving Vision Systems
Combining federated learning with differential privacy causes catastrophic accuracy loss and large resource overhead in vision models, whereas federated learning with secure multi-party computation retains near-baseli...
-
FedEve: On Bridging the Client Drift and Period Drift for Cross-device Federated Learning
FedEve uses a Kalman filter to combine server momentum (prediction) with client updates (observation) to offset period drift and client drift in cross-device federated learning.
-
PIcsC: Partitioning-Induced Covariate Shift Correction
A Fisher-information regularizer is proposed to correct partition-induced covariate shift in cross-validation and federated learning, with reported gains of 3-5 points over FedAvg-class baselines.
-
Security and Privacy in Retrieval-Augmented Generation: Architectures, Threats, Defenses, and Future Directions for Building Trustworthy Systems
A survey of architectures, threats, defenses, and future directions for security and privacy in RAG systems.
-
Strategies for Improving Communication Efficiency in Distributed and Federated Learning: Compression, Local Training, and Personalization
A PhD dissertation showing unified compression theory, personalized accelerated local training, and pruning methods that reduce communication costs in federated learning and maintain accuracy in LLM pruning.
-
A Survey on Foundation Models for Personalized Federated Intelligence
The survey introduces personalized federated intelligence (PFI) as a framework integrating federated learning and foundation models to support privacy-aware personalization of AI models.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.