Skip to main navigation Skip to search Skip to main content

Analytical benchmark problems and methodological framework for the assessment and comparison of multifidelity optimization methods

Laura Mainini*, Andrea Serani, Hayriye Pehlivan-Solak, Francesco Di Fiore, Markus P. Rumpfkeil, Edmondo Minisci, Domenico Quagliarella, Sihmehmet Yildiz, Simone Ficini, Riccardo Pellegrini, Andrew Thelen, Dean Bryson, Melike Nikbay, Matteo Diez, Philip S. Beran

*Corresponding author for this work

Research output: Contribution to journalReview articlepeer-review

Abstract

As engineering systems increase in complexity and performance demands intensify, Multidisciplinary Design Optimization (MDO) methodologies are becoming essential for integrating models from multiple disciplines to optimize complex multi-physics systems. Within this context, major challenges remain in selecting appropriate disciplinary fidelity levels, and how to couple them effectively. Multifidelity methods offer a promising path forward by strategically combining information sources of varying fidelity - whether computational or experimental - to enable efficient and scalable design exploration and optimization. Despite the development of numerous multifidelity methods, their comparative performance remains difficult to assess due to the absence of standardized benchmark frameworks capable of evaluating performance across diverse optimization tasks. To address this gap, this paper introduces a comprehensive benchmarking framework that includes: (i) a suite of analytical benchmark optimization problems designed to stress-test and validate multifidelity methods; (ii) a set of assessment metrics for quantifying and comparing performance over measurable objectives; and (iii) the classification, evaluation, and comparison of several families of multifidelity optimization methods and frameworks using the proposed benchmarks to identify their respective strengths and weaknesses in real-world scenarios. The proposed benchmark problems are analytically defined functions carefully selected to capture mathematical challenges commonly encountered in real-world applications, including high dimensionality, multimodality, discontinuities, and noise. Their closed-form nature ensures computational efficiency, high reproducibility, and a clear separation of algorithmic behavior from numerical artifacts. The accompanying performance metrics support the systematic evaluation of multifidelity methods, measuring both optimization effectiveness and global approximation accuracy. By providing a rigorous, reproducible, and accessible benchmarking framework, this work aims to enable the broader community to understand, compare, and advance multifidelity optimization methods for complex problems in science and engineering.
Original languageEnglish
Pages (from-to)2969-3000
Number of pages32
JournalArchives of Computational Methods in Engineering
Volume33
Issue number2
Early online date10 Nov 2025
DOIs
Publication statusPublished - 1 Mar 2026

Funding

The work was conducted in collaboration with the NATO Science and Technology Organization task group AVT-331. The authors thank the AIAA Multidisciplinary Design Optimization Technical Committee (MDO TC) and the community of experts and practitioners that joined the AIAA Workshop on Multifidelity modelling for design and uncertainty quantification for the valuable interactions. The contributions from Dr. Philip Beran, Dr. Dean Bryson, Prof. Markus Rumpfkeil, and Dr. Andrew Thelen were supported by the US Air Force Office of Scientific Research under grant 20RQCOR055, Dr. Fariba Fahroo, Computational Mathematics Program Officer. The contributions from Dr. Matteo Diez, Dr. Simone Ficini, Dr. Riccardo Pellegrini and Dr. Andrea Serani at the National Research Council (CNR) were supported by the Office of Naval Research Global under grants N62909-18-1-2033 and N62909-21-1-2042. Distribution A: Approved for public release, distribution unlimited. Case number AFRL-2024-6631.

Keywords

  • analytical benchmarks
  • modeling and optimization
  • multifidelity methods

Fingerprint

Dive into the research topics of 'Analytical benchmark problems and methodological framework for the assessment and comparison of multifidelity optimization methods'. Together they form a unique fingerprint.

Cite this