arXiv Research: Physics-Labeled LLM for Optimizing Engineering Simulator Calibration
Summary:This study investigates the potential of using Large Language Models (LLMs) conditioned on physical diagnostic descriptions to calibrate engineering simulators. The results show that LLMs provide a strong early semantic advantage, improving the initial design in 23 out of 25 trials and achieving a median calibration error 21.9 times lower than physics-free controls after five evaluations. However, this advantage diminishes by fifteen evaluations, and the inherent variability of the LLM decoder l
Background and Motivation
Calibrating engineering simulators requires tuning model parameters to match reference data, a process heavily constrained by computational costs. Traditional derivative-free optimizers are widely used but often inefficient in handling complex problems. This study explores whether Large Language Models (LLMs) can propose more efficient parameter updates based on physical diagnostic descriptions.
Methodology and Experiments
The research tested LLM performance on a cylinder-wake Large-Eddy Simulation and a damped-oscillator inverse problem. LLM physics-labeled prompts were compared against four text ablations (removed, anonymized, padded, misdirected) and standard optimizers (Nelder-Mead, Bayesian optimization, CMA-ES, and random search).
Key Findings
- Early Semantic Advantage: The first LLM proposal improved the initial design in 23 out of 25 trials.
- Significant Reduction in Calibration Error: After five evaluations, the median calibration error was 21.9 times lower than physics-free controls.
- Performance Fluctuation and Decay: However, this advantage diminished by fifteen evaluations, and the inherent variability of the LLM decoder led to a 9.8-fold performance spread.
- Superiority of Hybrid Workflow: To address these issues, the researchers introduced a hybrid method that uses the LLM as a warm-start, passing accumulated evaluations to a conventional optimizer. This approach reached the target accuracy in just nine simulator runs, outperforming standalone LLM (12 runs), Nelder-Mead (17 runs), and Bayesian optimization (>60 runs).
Engineering Trade-offs and Practical Applications
While LLMs show promise in the early stages, their performance fluctuation and decay limit their utility as standalone calibration tools. The hybrid method, combining the semantic understanding of LLMs with the stability of traditional optimizers, offers a more reliable solution. This approach is particularly suitable for scenarios with limited computational resources and high precision requirements.
Developer Recommendations
For developers looking to leverage LLMs for engineering simulator calibration, it is recommended to adopt the hybrid workflow to fully utilize the early advantages of LLMs while mitigating their performance fluctuation issues. Additionally, developers should be mindful of the variability of LLM decoders and consider using multi-model ensemble strategies to enhance stability.
— END —Source: ArXiv Machine Learning (cs.LG) (2026-10-19)
Tags: #Large Language Models #Engineering Simulation #Hybrid Optimization #Physics-Labeled #Calibration
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments