Variable reduction for surrogate-based optimization

Frederik Rehbach, Lorenzo Gentile, Thomas Bartz-Beielstein

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

2 Downloads (Pure)


Real-world problems such as computational fluid dynamics simulations and finite element analyses are computationally expensive. A standard approach to mitigating the high computational expense is Surrogate-Based Optimization (SBO). Yet, due to the high-dimensionality of many simulation problems, SBO is not directly applicable or not efficient. Reducing the dimensionality of the search space is one method to overcome this limitation. In addition to the applicability of SBO, dimensionality reduction enables easier data handling and improved data and model interpretability. Regularization is considered as one state-of-the-art technique for dimensionality reduction. We propose a hybridization approach called Regularized-Surrogate-Optimization (RSO) aimed at overcoming difficulties related to high-dimensionality. It couples standard Kriging-based SBO with regularization techniques. The employed regularization methods are based on three adaptations of the least absolute shrinkage and selection operator (LASSO). In addition, tree-based methods are analyzed as an alternative variable selection method. An extensive study is performed on a set of artificial test functions and two real-world applications: the electrostatic precipitator problem and a multilayered composite design problem. Experiments reveal that RSO requires significantly less time than standard SBO to obtain comparable results. The pros and cons of the RSO approach are discussed, and recommendations for practitioners are presented.
Original languageEnglish
Title of host publicationGECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conferenc
EditorsCarlos Artemio Coello
Place of PublicationNew York
Number of pages9
Publication statusPublished - 8 Jul 2020
EventGECCO 2020 Genetic and Evolutionary Computation Conference - Cancun, Mexico
Duration: 8 Jul 202012 Jul 2020


ConferenceGECCO 2020 Genetic and Evolutionary Computation Conference
Abbreviated titleGECCO 2020


  • dimensionality reduction
  • surrogate-based optimization
  • modeling
  • real-world
  • surrogates

Fingerprint Dive into the research topics of 'Variable reduction for surrogate-based optimization'. Together they form a unique fingerprint.

Cite this