Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published October 2023 | Published
Conference Paper

Score-Based Diffusion Models as Principled Priors for Inverse Imaging

Abstract

Priors are essential for reconstructing images from noisy and/or incomplete measurements. The choice of the prior determines both the quality and uncertainty of recovered images. We propose turning score-based diffusion models into principled image priors ("score-based priors") for analyzing a posterior of images given measurements. Previously, probabilistic priors were limited to handcrafted regularizers and simple distributions. In this work, we empirically validate the theoretically-proven probability function of a score-based diffusion model. We show how to sample from resulting posteriors by using this probability function for variational inference. Our results, including experiments on denoising, deblurring, and interferometric imaging, suggest that score-based priors enable principled inference with a sophisticated, data-driven image prior.

Copyright and License

© 2023 IEEE.

Acknowledgement

This project was partially done while BTF was an intern at Google Research. The authors would like to thank Michael Brenner for his helpful discussions throughout the project. They thank Yang Song, Zelda Mariet, Tianwei Yin, Patrick Kidger, and Mauricio Delbracio for their insightful feedback. Thanks also to Aviad Levis for his help with EHT software and Patrick Kidger for his help with Diffrax. BTF and KLB acknowledge funding from NSF Awards 2048237 and 1935980 and the Amazon AI4Science Partnership Discovery Grant. BTF is supported by the NSF GRFP.

Additional details

Created:
February 13, 2024
Modified:
February 13, 2024