arXiv Proposes Additive Disagreement Method to Diagnose Extrapolation in Gene Combination Prediction
Summary:arXiv has released a study on machine learning models for predicting the effects of gene combinations in perturbation screens. The research introduces the Additive Disagreement (AD) method to evaluate a model's extrapolation capabilities for unseen gene pairs. The AD method measures the extra interaction effect introduced by the model and reveals the limitations of existing neural predictors in handling unseen combinations. Experiments across multiple Perturb-seq datasets demonstrate the AD meth
Background and Motivation
In recent years, high-throughput gene perturbation screens have increasingly relied on machine learning models to predict the effects of unseen gene combinations. However, when both genes in a test pair were seen individually during training but their combination was not, standard out-of-distribution (OOD) methods often fail because neither gene appears unfamiliar on its own.
Additive Disagreement (AD) Method
To address this issue, the researchers propose the Additive Disagreement (AD) method. This method compares the model prediction with a simple additive prediction obtained by summing the two observed single-gene effects. The difference between them, called the Additive Disagreement, measures the extra interaction effect introduced by the model for an unseen combination. The larger the AD value, the greater the extra interaction effect.
Experimental Results and Analysis
The study conducted extensive experiments across eight prediction methods and three Perturb-seq datasets. The results show that specialized neural predictors do not consistently outperform the simple additive baseline. More importantly, predictions with larger deviations from the additive baseline tend to have larger errors. While traditional output-based and embedding-based confidence signals are inconsistent across datasets and models, the AD method remains informative across all evaluated compositional settings.
Application in Agentic Screening Workflows
The researchers further explored how the AD method can guide decisions in agentic perturbation-screening workflows. By using the AD as a reliability indicator for model predictions, it is possible to better identify uncertainties in the predictions and improve the reliability of the screening results.
Technical Mechanisms and Engineering Trade-offs
- Technical Mechanism: The core of the AD method lies in using the additive baseline to capture the model's extrapolation capabilities for unseen combinations, avoiding the failure of traditional OOD methods in handling unseen combinations.
- Engineering Trade-offs: The advantage of the AD method is its simplicity and generality. However, it is important to note that the AD value itself does not directly explain the biological meaning of the model prediction and needs to be interpreted in the context of the specific application scenario.
Developer Deployment Recommendations
- Applicable Scenarios: The AD method is suitable for scenarios where the model's extrapolation capabilities need to be evaluated, especially in areas such as gene combination prediction and drug combination screening.
- Deployment Recommendations: It is recommended to add an AD calculation step after the model prediction and set a threshold based on the AD value to filter out unreliable prediction results.
- Code Resources: The research team has open-sourced the code, and developers can access it at https://github.com/zygao930/OOD.
— END —Source: ArXiv Machine Learning (cs.LG) (2026-10-15)
Tags: #Gene Prediction #Machine Learning #Extrapolation Method #Perturb-seq #Additive Disagreement
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments