METHODS IN DATA SCIENCE SEMINAR: A replication crisis in methodological research?
Recent developments and remaining challenges towards reliable empirical evidence

12h15 – 13h15
Louis Amphi- Isped
Campus Carreire – Université de Bordeaux

Open to all, no registration, videoconferencing only

Anne-Laure BOULESTEIX, PhD
Institute for Medical Information Processing, Biometry, and Epidemiology, Munich, Germany

More information about Anne-Laure BOULESTEIX

Statisticians are often keen to analyze the statistical aspects of the so-called “replication crisis in science“. They condemn fishing expeditions and publication bias across empirical scientific fields applying statistical methods, such as health sciences. But what about good practice issues in their own – methodological – research, i.e. research considering statistical (or more generally, computational) methods as research objects? When developing and evaluating new statistical methods and data analysis tools, do statisticians and data scientists adhere to the good practice principles they promote in fields which apply statistics and data science? I argue that methodological researchers should make substantial efforts to address what may be called the replication crisis in the context of methodological research in statistics and data science, in particular by trying to avoid bias in comparison studies based on simulated or real data. I discuss topics such as publication bias, cherry-picking, and the design and necessity of neutral comparison studies, and review recent positive developments towards more reliable empirical evidence in the context of methodological biostatistical research.

Meeting ID: 847 9055 3944
Code: 625187