Loading Events

PICS Colloquium: “Representations Learnt from Synthetic Volumes Enable Training-free Medical Image Analysis”

April 26, 2024 at 2:00 PM - 3:00 PM
Details
Date: April 26, 2024
Time: 2:00 PM - 3:00 PM
Event Category: Colloquium
  • Event Tags:
  • Organizer
    Penn Institute for Computational Science (PICS)
    Phone: 215-573-6037
    Venue
    PICS Conference Room 534 – A Wing , 5th Floor 3401 Walnut Street
    Philadelphia
    PA 19104
    Google Map

    Current medical image analysis projects involve months to years of data annotation and custom technical development. This talk introduces methods to train networks that generalize out-of-the-box to new modalities, anatomies, and datasets all without retraining for the specific use case. Our key contributions include (A) generative models driven by biomedical shape priors that synthesize wildly variable training data, and (B) a multi-scale dense representation learning algorithm that leverages the synthetic data to learn contrast-invariant representations. We will show that a single U-Net pretrained in this manner can then extract features that enable state-of-the-art 3D multimodality image registration and can also serve as a general-purpose foundation model for few-shot segmentation across arbitrary biomedical datasets. We will also briefly demonstrate translational applications of the proposed methods to ongoing studies of disordered pregnancies in fetal and maternal MRI.