BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Penn Engineering Events - ECPv6.16.3//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Penn Engineering Events
X-ORIGINAL-URL:https://seasevents.nmsdev7.com
X-WR-CALDESC:Events for Penn Engineering Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20230312T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20231105T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20240310T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20241103T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20241002T120000
DTEND;TZID=America/New_York:20241002T131500
DTSTAMP:20260603T050155
CREATED:20240709T173718Z
LAST-MODIFIED:20240709T173718Z
UID:11697-1727870400-1727874900@seasevents.nmsdev7.com
SUMMARY:ASSET Seminar: "Towards Pluralistic Alignment: Foundations for Learning from Diverse Human Preferences"
DESCRIPTION:Abstract: \nLarge pre-trained models trained on internet-scale data are often not ready for safe deployment out-of-the-box. They are heavily fine-tuned and aligned using large quantities of human preference data\, usually elicited using pairwise comparisons. While aligning an AI/ML model to human preferences or values\, it is important to ask whose preference and values we are aligning it to? The current approaches of alignment are severely limited due to their inherent uniformity assumption. While there is rich literature on learning preferences from human judgements using comparison queries\, the models often focus on learning average preference over the population due to the limitations on the amount of data available per individual or on learning an individual’s preference using a lot of queries.  Furthermore\, the knowledge of the metric\, i.e.\, the way humans judge similarity and dissimilarity\, is assumed to be known which does not hold in practice. We aim to overcome these limitations by building mathematical foundations for learning from diverse human preferences. \nIn this talk\, I will present\, PAL\, a personalize-able reward modelling framework for pluralistic alignment\, which captures diversity in preferences while also capturing commonalities that can be learned by pooling together data from individuals. I will also discuss some recent theoretical results on per user sample complexity for generalization and fundamental limitations when there are limited pairwise comparisons. \nBased on work with Daiwei Chen\, Yi Chen\, Aniket Rege\, Zhi Wang\, Geelon So\, Greg Canal\, Blake Mason\, Gokcan Tatli\, and Rob Nowak. References: \n\nPAL: Pluralistic Alignment Framework for learning from heterogeneous preferences  (preprint\, 2024)\nOne-for-all: Simultaneous metric and preference learning (appeared in Neurips 2022)\nMetric learning via limited pairwise comparisons (appeared in UAI 2024)\, and\nLearning Populations of Preferences via pairwise comparisons (appeared in AISTATS 2024).\n\nZoom Link (if unable to attend in-person): https://upenn.zoom.us/j/95536358996
URL:https://seasevents.nmsdev7.com/event/asset-seminar-ramya-korlakai-vinayak-university-of-wisconsin-madison/
LOCATION:Raisler Lounge (Room 225)\, Towne Building\, 220 South 33rd Street\, Philadelphia\, PA\, 19104\, United States
END:VEVENT
END:VCALENDAR