BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Penn Engineering Events - ECPv6.15.18//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Penn Engineering Events
X-ORIGINAL-URL:https://seasevents.nmsdev7.com
X-WR-CALDESC:Events for Penn Engineering Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20230312T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20231105T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20240310T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20241103T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20240416T110000
DTEND;TZID=America/New_York:20240416T120000
DTSTAMP:20260403T172245
CREATED:20240326T125329Z
LAST-MODIFIED:20240326T125329Z
UID:11081-1713265200-1713268800@seasevents.nmsdev7.com
SUMMARY:ESE Spring Seminar - "Scaling Deep Learning Up and Down"
DESCRIPTION:Deep learning with neural networks has emerged as a key approach for discovering patterns and modeling relationships in complex data. AI systems powered by deep learning are used widely in applications across a broad spectrum of scales. There are strong needs for scaling deep learning both upward and downward. Scaling up highlights the pursuit of scalability – the ability to utilize increasingly abundant computing and data resources to achieve superior capabilities\, overcoming diminishing returns. Scaling down represents the demand for efficiency – there is limited data for many application domains\, and deployment is often in compute-limited settings. \nIn this talk\, we present several studies in both directions. For scaling up\, we first explore the design of scalable neural network architectures that are widely adopted in various fields. We then discuss an intriguing observation on modern vision datasets and its implication on scaling training data. For scaling down\, we introduce simple\, effective\, and popularly used approaches for compressing convolutional networks and large language models\, alongside interesting empirical findings. Notably\, a recurring theme in this talk is the careful examination of implicit assumptions in the literature\, which often leads to surprising revelations that reshape community understanding. Finally\, we discuss exciting avenues for future deep learning and vision research\, such as next-gen architectures and dataset modeling.
URL:https://seasevents.nmsdev7.com/event/ese-spring-seminar-scaling-deep-learning-up-and-down/
LOCATION:Raisler Lounge (Room 225)\, Towne Building\, 220 South 33rd Street\, Philadelphia\, PA\, 19104\, United States
CATEGORIES:Colloquium
ORGANIZER;CN="Electrical and Systems Engineering":MAILTO:eseevents@seas.upenn.edu
END:VEVENT
END:VCALENDAR