Logo: to the web site of Uppsala University

Conventionally, the models used in science and technology were obtained through the careful study of nature. Scientists proposed models based on their observations, and the models were understood in detail. In the new paradigm of machine learning (ML), on the other hand, models are instead trained on large amounts of data. They are typically of a black-box nature and come without guarantees on their accuracy and range of validity. 

It is natural to ask if both approaches can be combined beneficially. Incorporating domain knowledge from the sciences may make ML models more accurate and robust. Conversely, models and techniques from ML may constitute useful tools for improving scientific models. These questions are the subject of this dissertation, which therefore belongs to the broad area of physics-informed machine learning.        

The first main contribution of the thesis concerns various problems encountered in regression tasks. Physics-informed neural networks (PINNs) are extended to suit situations with noisy or incomplete data. Firstly, a method to learn the noise distribution in the case of homogeneous measurement noise is developed. Secondly, repulsive ensembles are employed to enable Bayesian uncertainty quantification in PINNs. Furthermore, multitask Gaussian processes (GPs) are considered, and a method to incorporate nonlinear sum constraints is presented.        

The second group of contributions deals with the use of generative models in physical applications. A modification of generative adversarial networks (GANs) is developed, where the distribution of certain high-level statistics chosen from domain knowledge is matched between true and generated data. A modularized architecture tailored to the generation of in-ice radio signals is devised for use as a component in an optimization pipeline. This architecture enables the generation of physically consistent samples as well as the differentiability of the samples in an efficient manner.