BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Penn Engineering Events - ECPv6.16.3//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Penn Engineering Events
X-ORIGINAL-URL:https://seasevents.nmsdev7.com
X-WR-CALDESC:Events for Penn Engineering Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20230312T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20231105T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20240310T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20241103T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20241008T153000
DTEND;TZID=America/New_York:20241008T163000
DTSTAMP:20260603T045939
CREATED:20240927T162100Z
LAST-MODIFIED:20240927T162100Z
UID:12243-1728401400-1728405000@seasevents.nmsdev7.com
SUMMARY:CIS Special Industry Seminar: "Improving Foundation Models Using Human Data"
DESCRIPTION:Foundation models including LLMs and multi-modal models released by OpenAI (GPT)\, Anthropic (Claude)\, Google (Gemini)\, Meta (Llama)\, and others have shown very impressive capabilities across a range of tasks. Some key drivers of this performance — such as investments in GPUs/compute\, model size\, and pre-training data — are relatively well understood. \nThis presentation will focus on a less understood\, yet extremely powerful lever that creates significant differentiation and competitive advantage among state-of-the-art models: the use of expert human data for Evaluations (“Evals”)\, Supervised Fine Tuning (“SFT”)\, Reinforcement Learning with Human Feedback (“RLHF”)\, and Direct Preference Optimization (“DPO”). \nThe talk will also outline some best practices for maximizing returns on financial investments in human data to achieve optimal model performance. This includes effective strategies for sourcing\, vetting\, hiring\, and managing expert human data teams\, as well as task design for Evals\, SFT\, RLHF\, and DPO\, along with processes and tooling to optimize team performance\, data quality and throughput. \nThis talk is open to Penn students\, COLM attendees\, and anyone in the Philadelphia area interested in AI\, data science\, or machine learning. You don’t need to be affiliated with the conference or the university — if you’re part of the DS/ML/AI community\, you’re welcome to join us.
URL:https://seasevents.nmsdev7.com/event/cis-special-industry-seminar-improving-foundation-models-using-human-data/
LOCATION:Wu and Chen Auditorium (Room 101)\, Levine Hall\, 3330 Walnut Street\, Philadelphia\, PA\, 19104\, United States
ORGANIZER;CN="Computer and Information Science":MAILTO:cherylh@cis.upenn.edu
END:VEVENT
END:VCALENDAR