Squirrel

A Switching Hyperparameter Optimizer

authored by

Noor Awad, Gresa Shala, Difan Deng, Neeratyoy Mallik, Matthias Feurer, Katharina Eggensperger, André Biedenkapp, Diederick Vermetten, Hao Wang, Carola Doerr, Marius Lindauer, Frank Hutter

Abstract

In this short note, we describe our submission to the NeurIPS 2020 BBO challenge. Motivated by the fact that different optimizers work well on different problems, our approach switches between different optimizers. Since the team names on the competition's leaderboard were randomly generated "alliteration nicknames", consisting of an adjective and an animal with the same initial letter, we called our approach the Switching Squirrel, or here, short, Squirrel.

Organisation(s)

Institute of Information Processing
Machine Learning Section

External Organisation(s)

University of Freiburg
Leiden University
Sorbonne Université
Bosch Center for Artificial Intelligence (BCAI)

Type

Preprint

No. of pages

3

Publication date

16.12.2020

Publication status

E-pub ahead of print

Electronic version(s)

https://arxiv.org/abs/2012.08180 (Access: Open)