Research Software Engineering (RSE)

Research software engineering addresses the use of software engineering principles for research applications. With a strong focus on Machine Learning, we strife to develop data processing tools which are applicable by practitioners and at the same time can conveniently be extended to answer scientific questions.

Focus Areas:

Projects and Software

We are currently developing the mlr3 universe of packages for Machine Learning in R. mlr3 implements the building blocks of Machine Learning in an efficient, object-oriented fashion. The base package is extended by a plethora of extension packages, summarized in the following figure:

mlr3 universe
mlr3 universe

For more details on the extension packages, see the Wiki page on GitHub. Other software projects are listed under Software.

Members

Name       Position
Martin Binder       PhD Student
Stefan Coors       PhD Student
Susanne Dandl       PhD Student
Florian Pfisterer       PhD Student
Marc Becker       Software Engineer
Lennart Schneider       PhD Student
Sebastian Fischer       PhD Student

Publications

  1. Fischer S, Harutyunyan L, Feurer M, Bischl B (2023) OpenML-CTR23 – A curated tabular regression benchmarking suite AutoML Conference 2023 (Workshop),
    link|pdf    .
  2. Rügamer D, Kolb C, Fritz C, Pfisterer F, Kopper P, Bischl B, Shen R, Bukas C, Sousa LB de Andrade e, Thalmeier D, Baumann P, Kook L, Klein N, Müller CL (2022) deepregression: a Flexible Neural Network Framework for Semi-Structured Deep Distributional Regression. Journal of Statistical Software (provisionally accepted).
    link|pdf    .
  3. Moosbauer J, Binder M, Schneider L, Pfisterer F, Becker M, Lang M, Kotthoff L, Bischl B (2022) Automated Benchmark-Driven Design and Explanation of Hyperparameter Optimizers. IEEE Transactions on Evolutionary Computation 26, 1336–1350.
    link | pdf    .
  4. Pfisterer F, Schneider L, Moosbauer J, Binder M, Bischl B (2022) Yahpo Gym – An Efficient Multi-Objective Multi-Fidelity Benchmark for Hyperparameter Optimization International Conference on Automated Machine Learning, pp. 3–1. PMLR.
    link | pdf    .
  5. Bischl B, Casalicchio G, Feurer M, Gijsbers P, Hutter F, Lang M, Mantovani RG, Rijn JN van, Vanschoren J (2021) OpenML Benchmarking Suites. In: In: Vanschoren J , In: Yeung S (eds) Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks,
    link | pdf    .
  6. Pfisterer F, Kern C, Dandl S, Sun M, Kim MP, Bischl B (2021) mcboost: Multi-Calibration Boosting for R. Journal of Open Source Software 6, 3453.
    link    .
  7. Sonabend R, Király FJ, Bender A, Bischl B, Lang M (2021) mlr3proba: An R Package for Machine Learning in Survival Analysis. Bioinformatics.
    link|pdf    .
  8. Binder M, Pfisterer F, Lang M, Schneider L, Kotthoff L, Bischl B (2021) mlr3pipelines - Flexible Machine Learning Pipelines in R. Journal of Machine Learning Research 22, 1–7.
    link | pdf    .
  9. Becker M, Binder M, Bischl B, Lang M, Pfisterer F, Reich NG, Richter J, Schratz P, Sonabend R (2021) mlr3 book.
    link    .
  10. Brockhaus S, Rügamer D, Greven S (2020) Boosting Functional Regression Models with FDboost. Journal of Statistical Software 94, 1–50.
  11. Lang M, Binder M, Richter J, Schratz P, Pfisterer F, Coors S, Au Q, Casalicchio G, Kotthoff L, Bischl B (2019) mlr3: A modern object-oriented machine learning framework in R. Journal of Open Source Software 4, 1903.
    link | pdf    .
  12. Molnar C, Casalicchio G, Bischl B (2018) iml: An R package for Interpretable Machine Learning. The Journal of Open Source Software 3, 786. link | pdf.
  13. Bender A, Scheipl F (2018) pammtools: Piece-wise exponential Additive Mixed Modeling tools. arXiv:1806.01042 [stat].
    link| pdf    .
  14. Schalk D, Thomas J, Bischl B (2018) compboost: Modular Framework for Component-Wise Boosting. JOSS 3, 967.
    link | pdf    .
  15. Bischl B, Richter J, Bossek J, Horn D, Thomas J, Lang M (2017) mlrMBO: A Modular Framework for Model-Based Optimization of Expensive Black-Box Functions. arXiv preprint arXiv:1703.03373.
    link | pdf    .
  16. Probst P, Au Q, Casalicchio G, Stachl C, Bischl B (2017) Multilabel Classification with R Package mlr. The R Journal 9, 352–369.
    link | pdf    .
  17. Casalicchio G, Bossek J, Lang M, Kirchhoff D, Kerschke P, Hofner B, Seibold H, Vanschoren J, Bischl B (2017) OpenML: An R package to connect to the machine learning platform OpenML. Computational Statistics, 977–991.
    link | pdf    .
  18. Lang M, Bischl B, Surmann D (2017) batchtools: Tools for R to work on batch systems. The Journal of Open Source Software 2.
    link    .
  19. Bischl B, Lang M, Kotthoff L, Schiffner J, Richter J, Studerus E, Casalicchio G, Jones ZM (2016) mlr: Machine Learning in R. The Journal of Machine Learning Research 17, 5938–5942.
    link | pdf    .
  20. Bischl B, Lang M, Kotthoff L, Schiffner J, Richter J, Studerus E, Casalicchio G, Jones ZM (2016) mlr: Machine Learning in R. The Journal of Machine Learning Research 17, 5938–5942.
  21. Schiffner J, Bischl B, Lang M, Richter J, Jones ZM, Probst P, Pfisterer F, Gallo M, Kirchhoff D, Kühn T, Thomas J, Kotthoff L (2016) mlr Tutorial.
    link | pdf    .
  22. Vanschoren J, Rijn JN, Bischl B (2015) Taking machine learning research online with OpenML. In: In: Fan W , In: Bifet A , In: Yang Q , In: Yu PS (eds) Proceedings of the 4th International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications, pp. 1–4. PMLR.
    link|pdf    .
  23. Vanschoren J, Rijn JN van, Bischl B, Casalicchio G, Feurer M (2015) OpenML: A Networked Science Platform for Machine Learning 2015 ICML Workshop on Machine Learning Open Source Software (MLOSS 2015), pp. 1–3.
    link | pdf    .
  24. Bischl B, Lang M, Mersmann O, Rahnenführer J, Weihs C (2015) BatchJobs and BatchExperiments: Abstraction Mechanisms for Using R in Batch Environments. Journal of Statistical Software 64, 1–25.
    link    .
  25. Vanschoren J, Rijn JN van, Bischl B, Torgo L (2014) OpenML: Networked Science in Machine Learning. SIGKDD Explorations Newsletter 15, 49–60.
    link | pdf    .
  26. Vanschoren J, Bischl B, Hutter F, Sebag M, Kegl B, Schmid M, Napolitano G, Wolstencroft K (2015) Towards a data science collaboratory. Lecture Notes in Computer Science (IDA 2015) 9385.
    pdf    .

Contact

Feel free to contact us if you are looking for collaborations:

michel.lang [at] stat.uni-muenchen.de