MO-SMAC: Multi-objective Sequential Model-based Algorithm Configuration

Verfasst von

Jeroen Rook, Carolin Benjamins, Jakob Bossek, Heike Trautmann, Holger Hoos, Marius Lindauer

Abstract

Automated algorithm configuration aims at finding well-performing parameter configurations for a given problem, and it has proven to be effective within many AI domains, including evolutionary computation. Initially, the focus was on excelling in one performance objective, but, in reality, most tasks have a variety of (conflicting) objectives. The surging demand for trustworthy and resource-efficient AI systems makes this multiobjective perspective even more prevalent. We propose a new general-purpose multiobjective automated algorithm configurator by extending the widely-used SMAC framework. Instead of finding a single configuration, we search for a nondominated set that approximates the actual Pareto set. We propose a pure multiobjective Bayesian optimization approach for obtaining promising configurations by using the predicted hypervolume improvement as acquisition function. We also present a novel intensification procedure to efficiently handle the selection of configurations in a multiobjective context. Our approach is empirically validated and compared across various configuration scenarios in four AI domains, demonstrating superiority over baseline methods, competitiveness with MO-ParamILS on individual scenarios, and an overall best performance.

Details

Organisationseinheit(en)
Fachgebiet Maschinelles Lernen
Institut für Künstliche Intelligenz
Forschungszentrum L3S
Externe Organisation(en)
University of Twente (UT)
Universität Paderborn
Leiden University
Rheinisch-Westfälische Technische Hochschule Aachen (RWTH)
University of British Columbia
Typ
Artikel
Journal
Evolutionary computation
Band
34
Seiten
29-52
Anzahl der Seiten
24
ISSN
1063-6560
Publikationsdatum
01.03.2026
Publikationsstatus
Veröffentlicht
Peer-reviewed
Ja
ASJC Scopus Sachgebiete
Computational Mathematics
Elektronische Version(en)
https://doi.org/10.1162/evco_a_00371 (Zugang: Geschlossen )

Zitieren

Laden...