PICS Colloquium: “Representations Learnt from Synthetic Volumes Enable Training-free Medical Image Analysis”
April 26, 2024 at 2:00 PM - 3:00 PM
Organizer
Venue
Current medical image analysis projects involve months to years of data annotation and custom technical development. This talk introduces methods to train networks that generalize out-of-the-box to new modalities, anatomies, and datasets all without retraining for the specific use case. Our key contributions include (A) generative models driven by biomedical shape priors that synthesize wildly variable training data, and (B) a multi-scale dense representation learning algorithm that leverages the synthetic data to learn contrast-invariant representations. We will show that a single U-Net pretrained in this manner can then extract features that enable state-of-the-art 3D multimodality image registration and can also serve as a general-purpose foundation model for few-shot segmentation across arbitrary biomedical datasets. We will also briefly demonstrate translational applications of the proposed methods to ongoing studies of disordered pregnancies in fetal and maternal MRI.

