BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Penn Engineering Events - ECPv6.16.3//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Penn Engineering Events
X-ORIGINAL-URL:https://seasevents.nmsdev7.com
X-WR-CALDESC:Events for Penn Engineering Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20230312T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20231105T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20240310T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20241103T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20241118T110000
DTEND;TZID=America/New_York:20241118T120000
DTSTAMP:20260602T231423
CREATED:20241029T131551Z
LAST-MODIFIED:20241029T131551Z
UID:12506-1731927600-1731931200@seasevents.nmsdev7.com
SUMMARY:Fall 2024 GRASP Seminar: Yunzhu Li\, Columbia University\, “Foundation Models for Robotic Manipulation: Opportunities and Challenges”
DESCRIPTION:*This seminar will be held in-person in Levine 307 as well as virtually via Zoom. \nABSTRACT\nFoundation models\, such as GPT-4 Vision\, have marked significant achievements in the fields of natural language and vision\, demonstrating exceptional abilities to adapt to new tasks and scenarios. However\, physical interaction—such as cooking\, cleaning\, or caregiving—remains a frontier where foundation models and robotic systems have yet to achieve the desired level of adaptability and generalization. In this talk\, I will discuss the opportunities for incorporating foundation models into classic robotic pipelines to endow robots with capabilities beyond those achievable with traditional robotic tools. The talk will focus on three key improvements in (1) task specification\, (2) low-level\, and (3) high-level scene modeling. The central idea behind this research is to translate the commonsense knowledge embedded in foundation models into structural priors that can be integrated into robot learning systems. This approach leverages the strengths of different modules (e.g.\, VLM for task interpretation and constrained optimization for motion planning)\, achieving the best of both worlds. I will demonstrate how such integration enables robots to interpret instructions provided in free-form natural language\, and how foundation models can be augmented with additional memory mechanisms\, such as an action-conditioned scene graph\, to handle a wide range of real-world manipulation tasks. Toward the end of the talk\, I will discuss the limitations of the current foundation models\, challenges that still lie ahead\, and potential avenues to address these challenges.
URL:https://seasevents.nmsdev7.com/event/fall-2024-grasp-seminar-yunzhu-li-columbia-university-foundation-models-for-robotic-manipulation-opportunities-and-challenges/
LOCATION:Levine 307\, 3330 Walnut Street\, Philadelphia\, PA\, 19104\, United States
CATEGORIES:Seminar
ORGANIZER;CN="General Robotics%2C Automation%2C Sensing and Perception (GRASP) Lab":MAILTO:grasplab@seas.upenn.edu
END:VEVENT
END:VCALENDAR