REVIEW 4 cited by
Detailed comparison of communication efficiency of split learning and federated learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We compare communication efficiencies of two compelling distributed machine learning approaches of split learning and federated learning. We show useful settings under which each method outperforms the other in terms of communication efficiency. We consider various practical scenarios of distributed learning setup and juxtapose the two methods under various real-life scenarios. We consider settings of small and large number of clients as well as small models (1M - 6M parameters), large models (10M - 200M parameters) and very large models (1 Billion-100 Billion parameters). We show that increasing number of clients or increasing model size favors split learning setup over the federated while increasing the number of data samples while keeping the number of clients or model size low makes federated learning more communication efficient.
Forward citations
Cited by 4 Pith papers
-
AutoEncoder-Compressed Parallel Split Learning for Pre-trained Model Fine-Tuning
An autoencoder-based split-learning compressor with a two-stage alignment protocol achieves about 10x communication reduction during pre-trained vision-model fine-tuning with near-zero accuracy loss, outperforming heu...
-
ProtoGuard-SL: Prototype Consistency Based Backdoor Defense for Vertical Split Learning
Class-prototype consistency vectors plus class-conditional conformal filtering cut backdoor ASR to ~0.03–0.08 on CIFAR-10, SVHN, and Bank Marketing while preserving main accuracy.
-
Navigating the Edge-Cloud Continuum: A State-of-Practice Survey
A state-of-practice survey that maps the edge-cloud continuum through a developer-oriented five-area conceptual framework.
-
Federated Split Learning with Improved Communication and Storage Efficiency
CSE-FSL combines an auxiliary network for local updates with periodic smashed-data uploads and a single server-side model, claiming convergence under non-convex loss and lower communication and storage costs.
Discussion (0). Continue with ORCID to comment.