Geometric Understanding of Supervised and Unsupervised Deep Learning for Biomedical Image Reconstruction

Jong Chul Ye
Korea Advanced Institute of Science and Technology (KAIST)
Bio and Brain Engineering/Mathematics

Recently, deep learning approaches have been extensively used for various inverse problems thanks to its excellent performance. However, it is still difficult to obtain coherent geometric view why such deep learning architectures provide superior performance over mathematically-driven classical algorithms. Inspired by recent theoretical understanding of geometry of CNN as a combinatorial framelet representation, here we provide a unified theoretical framework that leads to a better understanding and optimized design of CNNs for various inverse problems. We also present our generalized cycleGAN framework for unsupervised learning that can be used for general inverse problems without having any matched training data set. We provide extensive experimental results using our supervised and unsupervised neural networks for several biomedical imaging reconstruction problems to verify the geometric understanding of CNNs for image reconstruction problems.

Presentation (PDF File)

Back to Deep Learning and Medical Applications