Knowledge-Guided Additive Modeling for Supervised Regression

Learning processes by exploiting restricted domain knowl- edge is an important task across a plethora of scientific areas, with more and more hybrid methods combining data-driven and model-based approaches. However, while such hybrid methods have been tested in various scientific applications, they have been mostly tested on dynam- ical systems, with only limited study about the influence of each model component on global performance and parameter identification. In this work, we assess the performance of hybrid modeling against traditional machine learning methods on standard regression problems. We com- pare, on both synthetic and real regression problems, several approaches for training such hybrid models. We focus on hybrid methods that addi- tively combine a parametric physical term with a machine learning term and investigate model-agnostic training procedures. We also introduce a new hybrid approach based on partial dependence functions. Experi- ments are carried out with different types of machine learning models, including tree-based models and artificial neural networks.