Colloquium

Differentiable Physics Simulations for Deep Learning

When

1 p.m., Feb. 11, 2022

In this talk I will focus on the possibilities that arise from recent advances in the area of deep learning for physical simulations. In this context, especially the Navier-Stokes equations represent an interesting and challenging advection-diffusion PDE that poses a variety of challenges for deep learning methods.

In particular, I will focus on differentiable physics solvers from the larger field of differentiable programming. Differentiable solvers are very powerful tools to integrate into deep learning processes. The existing numerical methods for efficient solvers can be leveraged within learning tasks to provide crucial information in the form of reliable gradients to update the weights of a neural networks. Interestingly, it turns out to be beneficial to combine supervised and physics-based approaches. The former poses a much simpler learning task by providing explicit reference data that is typically pre-computed. Physics-based learning on the other hand can provide gradients for a larger space of states that are only encountered at training time. Here, differentiable solvers are particularly powerful to, e.g., provide neural networks with feedback about how inferred solutions influence the long-term behavior of a physical model.

I will demonstrate this concept with several examples from learning to reduce numerical errors, over long-term planning and control, to generalization. I will conclude by discussing current limitations and by giving an outlook about promising future directions.

Short bio:  Nils is an Associate-Professor at the Technical University of Munich (TUM). He focuses on deep-learning methods for physical systems, with an emphasis on fluid flow problems. Together with his research group he is especially interested in methods for the tight and seamless integration of learning algorithms with numerical methods, e.g. via differentiable physics simulations. He additionally works on latent-space simulation algorithms, generative adversarial models, and visual reconstructions.

Place: Hybrid: Math, 501 and Zoom https://arizona.zoom.us/j/86997964863     Password:   Locute