Loading Events

CIS Seminar: “Intrinsic images, lighting and relighting without any labeling”

November 9, 2023 at 3:30 PM - 4:30 PM
Details
Date: November 9, 2023
Time: 3:30 PM - 4:30 PM
  • Event Tags:
  • Organizer
    Computer and Information Science
    Phone: 215-898-8560
    Venue
    Wu and Chen Auditorium (Room 101), Levine Hall 3330 Walnut Street
    Philadelphia
    PA 19104
    Google Map

    I will show the results of simple experiments that suggest that very good modern depth and normal predictors are strongly sensitive to lighting – if you relight a scene in a reasonable way, the reported depth will change. This is intolerable. To fix this problem, we need to be able to produce many different lightings of the same scene.   I will describe a method to do so.  First, one learns a method to estimate albedo from images without any labelled training data (which turns out to perform well under traditional evaluations).  Then, one forces an image generator to produce many different images that have the same albedo — with care, these are relightings of the same scene.  Finally, a GAN inverter allows us to apply the process to real images.  I will show some interim results suggesting that learned relightings might genuinely improve estimates of depth, normal and albedo.