ArXiv Research: Automated Multilabel Classification of Mpox Research with BERT Models

Summary:This study addresses the challenge of organizing the vast amount of Mpox research by using multilabel classification to categorize 14,590 research articles into key topics such as outbreaks, vaccination, and epidemiology. Among the AI models tested, BERT achieved the highest performance with 97.05% accuracy, a 97.67% micro F1 score, and a 96.46% macro F1 score. The use of SHAP analysis provided insights into significant word features and patterns, enabling researchers, policymakers, and healthca

---

Key Research Findings

• Background and Challenge: The ongoing Mpox outbreak poses a significant threat to global public health, and the rapid accumulation of research literature makes it challenging to organize and analyze information efficiently. Traditional manual classification methods are insufficient to meet the demand for rapid information retrieval.

• Methodology: This study employs multilabel classification to categorize 14,590 Mpox research articles into key topics such as outbreaks, vaccination, diagnostics, and epidemiology. Various AI models, including BERT, RoBERTa, and XLNet, were tested, with BERT achieving the highest performance.

• Main Results:

  • The BERT model demonstrated excellent performance with 97.05% accuracy, 97.67% micro F1 score, and 96.46% macro F1 score.
  • SHAP analysis provided insights into the significant word features and patterns that influenced the model's decisions, enhancing its interpretability.

• Application Value:

  • The method enables automatic and efficient organization of Mpox research literature, saving researchers' time and improving the accuracy of information retrieval.
  • It provides policymakers and healthcare workers with a tool to quickly access key information, facilitating the development of more effective public health response strategies.

Technical Highlights

1. Application of Multilabel Classification: This study is the first to apply multilabel classification to Mpox research literature, demonstrating its potential in handling complex classification tasks.
2. High Performance of BERT: The BERT model excelled in terms of classification accuracy and F1 scores, showcasing its strong capabilities in natural language processing tasks.
3. Interpretability Analysis with SHAP: The use of SHAP analysis provided interpretability by revealing the significant word features and patterns that influenced the model's decisions, enhancing transparency.

Industry Impact and Recommendations for Developers

• Public Health Sector: This method can be widely applied in the public health sector to help researchers, policymakers, and healthcare workers quickly access key Mpox research information, thereby facilitating the development of more effective response strategies.
• AI Model Developers: It is recommended to further optimize multilabel classification models, exploring more efficient feature extraction and model interpretability methods to enhance classification performance and interpretability.
• Data Resource Construction: Building a larger-scale Mpox research literature dataset with more diverse data sources is recommended to improve the model's generalization and robustness.

---

Source: ArXiv cs.AI (2026-07-29)

— END —

Tags: #ArXiv #BERT #Multilabel Classification #Mpox #Public Health