ArXiv Proposes FedCC Algorithm to Address Label Distribution Skew in Federated Learning
By Mr.Xu Community Post
Published: · 6 views
Summary:The ArXiv team introduces FedCC, a novel algorithm designed to tackle label distribution skew in federated learning (FL) caused by heterogeneous local data. The algorithm permits clients to tag ambiguous samples as 'unknown' and employs calibrated pseudo-labels to balance confidence between majority and minority classes. Extensive experiments demonstrate that FedCC significantly outperforms existing methods, achieving 67.3% accuracy in extreme scenarios where each client holds samples from only
Background and Challenges
Federated Learning (FL) is a distributed machine learning paradigm that enables clients to collaboratively train models without sharing raw data. However, when local data is heterogeneous, it leads to label distribution skew, causing client models to be biased towards majority classes and affecting prediction accuracy. The lack of ground-truth labels in the public dataset further hampers the server's ability to calibrate predictions, ultimately degrading overall performance.
FedCC Algorithm
To address these issues, the ArXiv team proposes FedCC, with the following key innovations:
- Allowing 'Unknown' Labels: Clients can tag ambiguous samples as 'unknown' to prevent error propagation.
- Calibrated Pseudo-Labels: By generating calibrated pseudo-labels on the public dataset, FedCC balances confidence between majority and minority classes, enhancing the model's ability to recognize minority classes.
Experimental Results
FedCC demonstrates strong performance in multiple benchmarks, particularly in scenarios with severe label skew:
- In the extreme scenario where each client holds samples from only one of ten classes, FedCC achieves 67.3% accuracy, while baselines collapse to near-random results.
- In other label skew scenarios, FedCC also significantly outperforms existing methods, showcasing its robustness and adaptability.
Technical Highlights
- Innovative Label Handling Mechanism: By allowing 'unknown' labels, FedCC effectively mitigates error propagation.
- Pseudo-Label Calibration: The use of calibrated pseudo-labels enables FedCC to maintain high confidence in majority classes while improving recognition of minority classes.
- Wide Applicability: The algorithm is not only applicable to federated learning but also to other machine learning scenarios with label skew.
Industry Impact and Developer Recommendations
FedCC offers an effective solution to the label distribution skew problem in federated learning, particularly in domains like healthcare and finance where data privacy and accuracy are critical. Developers can draw inspiration from FedCC's approach to incorporate similar label handling mechanisms in the design of distributed machine learning systems to enhance model robustness and accuracy. Additionally, the pseudo-label calibration strategy of FedCC can be applied to other scenarios requiring handling of imbalanced data.
— END —Source: ArXiv cs.AI (2026-08-24)
Tags: #Federated Learning #Label Distribution Skew #FedCC #ArXiv #Machine Learning
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments