Pith. sign in

REVIEW 46 references

Edge Association Strategies for Synthetic Data Empowered Hierarchical Federated Learning with Non-IID Data

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2506.18259 v1 pith:2MWJHPIW submitted 2025-06-23 cs.DC

Jer Shyuan Ng , Aditya Pribadi Kalapaaking , Xiaoyu Xia , Dusit Niyato , Ibrahim Khalil , Iqbal Gondal This is my paper · ORCID
classification cs.DC
keywords workersedgedatasetsframeworknon-iidservertrainingcommunication
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

In recent years, Federated Learning (FL) has emerged as a widely adopted privacy-preserving distributed training approach, attracting significant interest from both academia and industry. Research efforts have been dedicated to improving different aspects of FL, such as algorithm improvement, resource allocation, and client selection, to enable its deployment in distributed edge networks for practical applications. One of the reasons for the poor FL model performance is due to the worker dropout during training as the FL server may be located far away from the FL workers. To address this issue, an Hierarchical Federated Learning (HFL) framework has been introduced, incorporating an additional layer of edge servers to relay communication between the FL server and workers. While the HFL framework improves the communication between the FL server and workers, large number of communication rounds may still be required for model convergence, particularly when FL workers have non-independent and identically distributed (non-IID) data. Moreover, the FL workers are assumed to fully cooperate in the FL training process, which may not always be true in practical situations. To overcome these challenges, we propose a synthetic-data-empowered HFL framework that mitigates the statistical issues arising from non-IID local datasets while also incentivizing FL worker participation. In our proposed framework, the edge servers reward the FL workers in their clusters for facilitating the FL training process. To improve the performance of the FL model given the non-IID local datasets of the FL workers, the edge servers generate and distribute synthetic datasets to FL workers within their clusters. FL workers determine which edge server to associate with, considering the computational resources required to train on both their local datasets and the synthetic datasets.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

46 extracted references · 18 canonical work pages

  1. [1]

    Automatic Healthcare Diagnosis and Prediction Assessment based on AI Multi-Classification Algorithm,

    S. Endargiri and K. Laabidi, “Automatic Healthcare Diagnosis and Prediction Assessment based on AI Multi-Classification Algorithm,” in 12 2020 16th International Computer Engineering Conference (ICENCO) , pp. 112–117, 2020

    2020

  2. [2]

    Federated Learning for Object Detection in Autonomous Ve- hicles,

    D. Jallepalli, N. C. Ravikumar, P. V . Badarinath, S. Uchil, and M. A. Suresh, “Federated Learning for Object Detection in Autonomous Ve- hicles,” in 2021 IEEE Seventh International Conference on Big Data Computing Service and Applications (BigDataService) , pp. 107–114, 2021

    2021

  3. [3]

    Privacy-Preserving Traffic Flow Prediction: A Federated Learning Approach,

    Y . Liu, J. J. Q. Yu, J. Kang, D. Niyato, and S. Zhang, “Privacy-Preserving Traffic Flow Prediction: A Federated Learning Approach,”IEEE Internet of Things Journal , vol. 7, no. 8, pp. 7751–7763, 2020

    2020

  4. [4]

    FELIDS: Federated learning-based intrusion detection sys- tem for agricultural Internet of Things,

    O. Friha, M. A. Ferrag, L. Shu, L. Maglaras, K.-K. R. Choo, and M. Nafaa, “FELIDS: Federated learning-based intrusion detection sys- tem for agricultural Internet of Things,” Journal of Parallel and Dis- tributed Computing, vol. 165, pp. 17–31, 2022

    2022

  5. [5]

    Communication-efficient Learning of Deep Networks from Decentral- ized Data,

    B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y. Arcas, “Communication-efficient Learning of Deep Networks from Decentral- ized Data,” in Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (A. Singh and J. Zhu, eds.), vol. 54 of Proceedings of Machine Learning Research , pp. 1273–1282, PMLR, 20–22 Apr 2017

    2017

  6. [6]

    Decentralized Edge Intelligence: A Dynamic Resource Allocation Framework for Hierarchical Federated Learning,

    W. Y . B. Lim, J. S. Ng, Z. Xiong, J. Jin, Y . Zhang, D. Niyato, C. Leung, and C. Miao, “Decentralized Edge Intelligence: A Dynamic Resource Allocation Framework for Hierarchical Federated Learning,” IEEE Transactions on Parallel and Distributed Systems , vol. 33, no. 3, pp. 536–550, 2022

    2022

  7. [7]

    Dynamic Edge Association and Resource Allocation in Self-Organizing Hierarchical Federated Learning Networks,

    W. Y . B. Lim, J. S. Ng, Z. Xiong, D. Niyato, C. Miao, and D. I. Kim, “Dynamic Edge Association and Resource Allocation in Self-Organizing Hierarchical Federated Learning Networks,” IEEE Journal on Selected Areas in Communications , vol. 39, no. 12, pp. 3640–3653, 2021

    2021

  8. [8]

    Reputation-Aware Hedonic Coalition Formation for Ef- ficient Serverless Hierarchical Federated Learning,

    J. S. Ng, W. Y . B. Lim, Z. Xiong, X. Cao, J. Jin, D. Niyato, C. Leung, and C. Miao, “Reputation-Aware Hedonic Coalition Formation for Ef- ficient Serverless Hierarchical Federated Learning,” IEEE Transactions on Parallel and Distributed Systems , vol. 33, no. 11, pp. 2675–2686, 2022

    2022

Show all 46 references
  1. [9]

    Adaptive Hierar- chical Federated Learning Over Wireless Networks,

    B. Xu, W. Xia, W. Wen, P. Liu, H. Zhao, and H. Zhu, “Adaptive Hierar- chical Federated Learning Over Wireless Networks,” IEEE Transactions on Vehicular Technology, vol. 71, no. 2, pp. 2070–2083, 2022

    2022

  2. [10]

    Client-Edge-Cloud Hi- erarchical Federated Learning,

    L. Liu, J. Zhang, S. Song, and K. B. Letaief, “Client-Edge-Cloud Hi- erarchical Federated Learning,” in ICC 2020 - 2020 IEEE International Conference on Communications (ICC) , pp. 1–6, 2020

    2020

  3. [11]

    Bilateral pricing for dynamic association in federated edge learning,

    B. Pan, J. Lu, S. Cao, J. Liu, W. Tian, and M. Li, “Bilateral pricing for dynamic association in federated edge learning,” IEEE Transactions on Mobile Computing, pp. 1–14, 2025

    2025

  4. [12]

    Federated Learning With Non-IID Data: A Survey,

    Z. Lu, H. Pan, Y . Dai, X. Si, and Y . Zhang, “Federated Learning With Non-IID Data: A Survey,” IEEE Internet of Things Journal , vol. 11, no. 11, pp. 19188–19209, 2024

    2024

  5. [13]

    IOFL: Intelligent-Optimization-Based Federated Learning for Non-IID Data,

    X. Li, H. Zhao, and W. Deng, “IOFL: Intelligent-Optimization-Based Federated Learning for Non-IID Data,” IEEE Internet of Things Journal, vol. 11, no. 9, pp. 16693–16699, 2024

    2024

  6. [14]

    Delayed Gradient Aver- aging: Tolerate the Communication Latency for Federated Learning,

    L. Zhu, H. Lin, Y . Lu, Y . Lin, and S. Han, “Delayed Gradient Aver- aging: Tolerate the Communication Latency for Federated Learning,” in Advances in Neural Information Processing Systems (M. Ranzato, A. Beygelzimer, Y . Dauphin, P. Liang, and J. W. Vaughan, eds.), vol. 34, p...

    2021

  7. [15]

    Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training,

    Y . Lin, S. Han, H. Mao, Y . Wang, and W. J. Dally, “Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training,” arXiv preprint arXiv:1712.01887 , 2020

    2020 arXiv

  8. [16]

    QSGD: Communication-Efficient SGD via Gradient Quantization and Encod- ing,

    D. Alistarh, D. Grubic, J. Li, R. Tomioka, and M. V ojnovic, “QSGD: Communication-Efficient SGD via Gradient Quantization and Encod- ing,” in Advances in Neural Information Processing Systems (I. Guyon, U. V . Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. ...

    2017

  9. [17]

    A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks,

    M. Chen, Z. Yang, W. Saad, C. Yin, H. V . Poor, and S. Cui, “A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks,” IEEE Transactions on Wireless Communications , vol. 20, no. 1, pp. 269–283, 2021

    2021

  10. [18]

    Federated Learning Over Wireless IoT Networks With Optimized Communication and Resources,

    H. Chen, S. Huang, D. Zhang, M. Xiao, M. Skoglund, and H. V . Poor, “Federated Learning Over Wireless IoT Networks With Optimized Communication and Resources,” IEEE Internet of Things Journal, vol. 9, no. 17, pp. 16592–16605, 2022

    2022

  11. [19]

    Resource Allocation for Multi-Task Federated Learning Algorithm over Wireless Communication Networks,

    B. Cao, M. Chen, Y . Ben, Z. Yang, Y . Hu, C. Huang, and Y . Cang, “Resource Allocation for Multi-Task Federated Learning Algorithm over Wireless Communication Networks,” in 2022 IEEE Wireless Communi- cations and Networking Conference (WCNC) , pp. 590–595, 2022

    2022

  12. [20]

    Robust Federated Learning With Noisy Communication,

    F. Ang, L. Chen, N. Zhao, Y . Chen, W. Wang, and F. R. Yu, “Robust Federated Learning With Noisy Communication,” IEEE Transactions on Communications, vol. 68, no. 6, pp. 3452–3464, 2020

    2020

  13. [21]

    Federated Learning in Mobile Edge Networks: A Comprehensive Survey,

    W. Y . B. Lim, N. C. Luong, D. T. Hoang, Y . Jiao, Y .-C. Liang, Q. Yang, D. Niyato, and C. Miao, “Federated Learning in Mobile Edge Networks: A Comprehensive Survey,” IEEE Communications Surveys & Tutorials , vol. 22, no. 3, pp. 2031–2063, 2020

    2020

  14. [22]

    Robust Decentralized Federated Learning Using Collaborative Deci- sions,

    A. Gouissem, K. Abualsaud, E. Yaacoub, T. Khattab, and M. Guizani, “Robust Decentralized Federated Learning Using Collaborative Deci- sions,” in 2022 International Wireless Communications and Mobile Computing (IWCMC), pp. 254–258, 2022

    2022

  15. [23]

    Acceler- ating Federated Learning With Cluster Construction and Hierarchical Aggregation,

    Z. Wang, H. Xu, J. Liu, Y . Xu, H. Huang, and Y . Zhao, “Acceler- ating Federated Learning With Cluster Construction and Hierarchical Aggregation,” IEEE Transactions on Mobile Computing , vol. 22, no. 7, pp. 3805–3822, 2023

    2023

  16. [24]

    Resource Efficient Cluster-Based Federated Learning for D2D Communications,

    J.-P. Jung, Y .-B. Ko, and S.-H. Lim, “Resource Efficient Cluster-Based Federated Learning for D2D Communications,” in 2022 IEEE 95th Vehicular Technology Conference: (VTC2022-Spring), pp. 1–5, 2022

    2022

  17. [25]

    Communication-efficient Hierarchical Federated Learning for IoT Heterogeneous Systems with Imbalanced Data,

    A. A. Abdellatif, N. Mhaisen, A. Mohamed, A. Erbad, M. Guizani, Z. Dawy, and W. Nasreddine, “Communication-efficient Hierarchical Federated Learning for IoT Heterogeneous Systems with Imbalanced Data,” Future Generation Computer Systems , vol. 128, pp. 406–419, 2022

    2022

  18. [26]

    Sample-level Data Selection for Federated Learning,

    A. Li, L. Zhang, J. Tan, Y . Qin, J. Wang, and X.-Y . Li, “Sample-level Data Selection for Federated Learning,” in IEEE INFOCOM 2021 - IEEE Conference on Computer Communications , pp. 1–10, 2021

    2021

  19. [27]

    ISFL: Federated Learning for Non-i.i.d. Data with Local Importance Sampling,

    Z. Zhu, P. Fan, C. Peng, and K. B. Letaief, “ISFL: Federated Learning for Non-i.i.d. Data with Local Importance Sampling,” arXiv preprint arXiv:2210.02119, 2023

    2023 arXiv

  20. [28]

    FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction,

    L. Gao, H. Fu, L. Li, Y . Chen, M. Xu, and C.-Z. Xu, “FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction,” in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10102–10111, 2022

    2022

  21. [29]

    Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework,

    Q. Wu, K. He, and X. Chen, “Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework,” IEEE Open Journal of the Computer Society , vol. 1, pp. 35–44, 2020

    2020

  22. [30]

    Hybrid-FL for Wireless Networks: Cooperative Learning Mechanism Using Non-IID Data,

    N. Yoshida, T. Nishio, M. Morikura, K. Yamamoto, and R. Yonetani, “Hybrid-FL for Wireless Networks: Cooperative Learning Mechanism Using Non-IID Data,” in ICC 2020 - 2020 IEEE International Confer- ence on Communications (ICC) , pp. 1–7, 2020

    2020

  23. [31]

    Exploiting Unintended Feature Leakage in Collaborative Learning,

    L. Melis, C. Song, E. De Cristofaro, and V . Shmatikov, “Exploiting Unintended Feature Leakage in Collaborative Learning,” in 2019 IEEE Symposium on Security and Privacy (SP) , pp. 691–706, 2019

    2019

  24. [32]

    Federated Learning with Non-IID Data,

    Y . Zhao, M. Li, L. Lai, N. Suda, D. Civin, and V . Chandra, “Federated Learning with Non-IID Data,” arXiv preprint arXiv:1806.00582 , 2018

    2018 arXiv

  25. [33]

    Feature Matching Data Synthesis for Non-IID Federated Learning,

    Z. Li, Y . Sun, J. Shao, Y . Mao, J. H. Wang, and J. Zhang, “Feature Matching Data Synthesis for Non-IID Federated Learning,” IEEE Trans- actions on Mobile Computing , pp. 1–16, 2024

    2024

  26. [34]

    Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks,

    M. S. H. Abad, E. Ozfatura, D. GUndUz, and O. Ercetin, “Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks,” in ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pp. 8866–8870, 2020

    2020

  27. [35]

    The Non-IID Data Quagmire of Decentralized Machine Learning,

    K. Hsieh, A. Phanishayee, O. Mutlu, and P. Gibbons, “The Non-IID Data Quagmire of Decentralized Machine Learning,” in Proceedings of the 37th International Conference on Machine Learning (H. D. III and A. Singh, eds.), vol. 119 of Proceedings of Machine Learning Research, pp. ...

    2020

  28. [36]

    Social-Trust and Power- Efficient Relay Selection for Device-to-Device Underlaying Distributed Shared Network,

    M. Sun, N. Bao, J. Zuo, X. Sun, and S. Pan, “Social-Trust and Power- Efficient Relay Selection for Device-to-Device Underlaying Distributed Shared Network,” in 2020 International Conference on Computing, Networking and Communications (ICNC) , pp. 992–996, 2020

    2020

  29. [37]

    Energy-Efficiency Optimization- Based User Selection and Power Allocation for Uplink NOMA-Enabled IoT Networks,

    Y . Wu, S. Liu, X. Lin, and L. Sun, “Energy-Efficiency Optimization- Based User Selection and Power Allocation for Uplink NOMA-Enabled IoT Networks,” in 2023 IEEE 12th International Conference on Educa- tional and Information Technology (ICEIT) , pp. 321–325, 2023

    2023

  30. [38]

    Node Selection Strategy Design Based on Reputation Mechanism for Hierarchical Federated Learning,

    S. Xin, L. Zhuo, and C. Xin, “Node Selection Strategy Design Based on Reputation Mechanism for Hierarchical Federated Learning,” in 2022 18th International Conference on Mobility, Sensing and Networking (MSN), pp. 718–722, 2022

    2022

  31. [39]

    Pytorch Conditional CGAN

    M. Rahmdel, “Pytorch Conditional CGAN.” https://github.com/arturml/ mnist-cgan

  32. [40]

    CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images,

    J. J. Bird and A. Lotfi, “CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images,” IEEE Access, vol. 12, pp. 15642–15650, 2024

    2024

  33. [41]

    Risk Neutral is Best for Risky Decision Making,

    R. E. Marks, “Risk Neutral is Best for Risky Decision Making,” tech. rep., mimeo, 2016. https://www.agsm.edu.au/bobm/papers/rnisbest.pdf

    2016

  34. [42]

    Engwerda, LQ Dynamic Optimization and Differential Games

    J. Engwerda, LQ Dynamic Optimization and Differential Games . John Wiley & Sons, 2005

    2005

  35. [43]

    Lyapunov Stability Theory,

    S. Sastry, “Lyapunov Stability Theory,” in Nonlinear Systems: Analysis, Stability, and Control, pp. 182–234, Springer New York, 1999. 13

    1999

  36. [44]

    J.-J. E. Slotine and W. Li, Applied Nonlinear Control, vol. 199. Prentice Hall Englewood Cliffs, NJ, 1991

    1991

  37. [45]

    Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge,

    T. Nishio and R. Yonetani, “Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge,” in ICC 2019 - 2019 IEEE International Conference on Communications (ICC) , pp. 1–7, 2019

    2019

  38. [46]

    FedMCCS: Mul- ticriteria Client Selection Model for Optimal IoT Federated Learning,

    S. Abdulrahman, H. Tout, A. Mourad, and C. Talhi, “FedMCCS: Mul- ticriteria Client Selection Model for Optimal IoT Federated Learning,” IEEE Internet of Things Journal , vol. 8, no. 6, pp. 4723–4735, 2021

    2021

Pith tools