ZICQ
中 Log in / Sign up
ZICQ Info LLMs & Foundation Models #Federated Learning #Label Distribution Skew #FedCC #ArXiv #Machine Learning

ArXiv Proposes FedCC Algorithm to Address Label Distribution Skew in Federated Learning

Avatar of Mr.Xu

By Mr.Xu Community Post

Published: · 6 views

中文阅读 (Chinese) English Version
Co-reading Select any sentence in the article to highlight, annotate, or copy a quote card. Join discussion ↓

Summary:The ArXiv team introduces FedCC, a novel algorithm designed to tackle label distribution skew in federated learning (FL) caused by heterogeneous local data. The algorithm permits clients to tag ambiguous samples as 'unknown' and employs calibrated pseudo-labels to balance confidence between majority and minority classes. Extensive experiments demonstrate that FedCC significantly outperforms existing methods, achieving 67.3% accuracy in extreme scenarios where each client holds samples from only


Background and Challenges

Federated Learning (FL) is a distributed machine learning paradigm that enables clients to collaboratively train models without sharing raw data. However, when local data is heterogeneous, it leads to label distribution skew, causing client models to be biased towards majority classes and affecting prediction accuracy. The lack of ground-truth labels in the public dataset further hampers the server's ability to calibrate predictions, ultimately degrading overall performance.

FedCC Algorithm

To address these issues, the ArXiv team proposes FedCC, with the following key innovations:

  1. Allowing 'Unknown' Labels: Clients can tag ambiguous samples as 'unknown' to prevent error propagation.
  2. Calibrated Pseudo-Labels: By generating calibrated pseudo-labels on the public dataset, FedCC balances confidence between majority and minority classes, enhancing the model's ability to recognize minority classes.

Experimental Results

FedCC demonstrates strong performance in multiple benchmarks, particularly in scenarios with severe label skew:

  • In the extreme scenario where each client holds samples from only one of ten classes, FedCC achieves 67.3% accuracy, while baselines collapse to near-random results.
  • In other label skew scenarios, FedCC also significantly outperforms existing methods, showcasing its robustness and adaptability.

Technical Highlights

  • Innovative Label Handling Mechanism: By allowing 'unknown' labels, FedCC effectively mitigates error propagation.
  • Pseudo-Label Calibration: The use of calibrated pseudo-labels enables FedCC to maintain high confidence in majority classes while improving recognition of minority classes.
  • Wide Applicability: The algorithm is not only applicable to federated learning but also to other machine learning scenarios with label skew.

Industry Impact and Developer Recommendations

FedCC offers an effective solution to the label distribution skew problem in federated learning, particularly in domains like healthcare and finance where data privacy and accuracy are critical. Developers can draw inspiration from FedCC's approach to incorporate similar label handling mechanisms in the design of distributed machine learning systems to enhance model robustness and accuracy. Additionally, the pseudo-label calibration strategy of FedCC can be applied to other scenarios requiring handling of imbalanced data.


Source: ArXiv cs.AI (2026-08-24)

— END —

Tags: #Federated Learning #Label Distribution Skew #FedCC #ArXiv #Machine Learning

Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.

What's your take on this story?
🚀 Explore & Submit Works

Community Comments

Loading live comments and annotations…