Publication Details

Position: Why We Must Rethink Empirical Research in Machine Learning

Authored by

Moritz Herrmann, F. Julian D. Lange, Katharina Eggensperger, Giuseppe Casalicchio, Marcel Wever, Matthias Feurer, David Rügamer, Eyke Hüllermeier, Anne-Laure Boulesteix, Bernd Bischl

Abstract

We warn against a common but incomplete understanding of empirical research in machine learning that leads to non-replicable results, makes findings unreliable, and threatens to undermine progress in the field. To overcome this alarming situation, we call for more awareness of the plurality of ways of gaining knowledge experimentally but also of some epistemic limitations. In particular, we argue most current empirical machine learning research is fashioned as confirmatory research while it should rather be considered exploratory.

Details

External Organisation(s)
Munich Center for Machine Learning (MCML)
Ludwig-Maximilians-Universität München (LMU)
Type
Contribution to book/anthology
Publication date
2024
Publication status
Published
Peer reviewed
Yes
Electronic version(s)
https://doi.org/10.48550/arXiv.2405.02200 (Access: Open )
PDF
PDF

Cite

Loading...