BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Penn Engineering Events - ECPv6.16.3//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Penn Engineering Events
X-ORIGINAL-URL:https://seasevents.nmsdev7.com
X-WR-CALDESC:Events for Penn Engineering Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20240310T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20241103T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20260308T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20261101T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20250320T110000
DTEND;TZID=America/New_York:20250320T120000
DTSTAMP:20260602T132640
CREATED:20250303T184346Z
LAST-MODIFIED:20250303T184346Z
UID:13514-1742468400-1742472000@seasevents.nmsdev7.com
SUMMARY:ESE Spring Seminar - "Can Robots Learn from Machine Dreams? - Robot Learning via GenAI-powered World Models"
DESCRIPTION:Over the past decade\, large-scale pre-training followed by alignment has revolutionized natural language processing and computer vision. Yet\, robotics remains constrained by the scarcity of real-world data. In this talk\, I will present our systematic approach to overcoming this bottleneck by building increasingly rich world models from data. I will first introduce our distilled feature field work that represents a robot’s action in relation to multi-modal descriptors in a static environment. Building upon this foundation\, I will demonstrate LucidSim\, a GenAI-powered simulator that significantly narrows the sim-to-real gap in the visual domain. I will show the initial steps we have taken toward a robot foundation model by extending this framework from legged locomotion to manipulation tasks. These results suggest that synthetic data sourced from world models can accelerate robot learning beyond what is possible with real-world data alone. I will conclude by outlining a roadmap that begins with enabling machines to dream a million worlds that will ultimately allow AI to enter the physical world.
URL:https://seasevents.nmsdev7.com/event/ese-spring-seminar-title-tba-5/
LOCATION:Raisler Lounge (Room 225)\, Towne Building\, 220 South 33rd Street\, Philadelphia\, PA\, 19104\, United States
CATEGORIES:Seminar,Colloquium
ORGANIZER;CN="Electrical and Systems Engineering":MAILTO:eseevents@seas.upenn.edu
END:VEVENT
END:VCALENDAR