BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Penn Engineering Events - ECPv6.16.3//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Penn Engineering Events
X-ORIGINAL-URL:https://seasevents.nmsdev7.com
X-WR-CALDESC:Events for Penn Engineering Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20240310T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20241103T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20260308T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20261101T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20250225T153000
DTEND;TZID=America/New_York:20250225T163000
DTSTAMP:20260602T144721
CREATED:20250211T013503Z
LAST-MODIFIED:20250211T013503Z
UID:13292-1740497400-1740501000@seasevents.nmsdev7.com
SUMMARY:CIS Seminar: " Specializing LLMs for Reliability"
DESCRIPTION:Large language models (LLMs) have advanced the frontiers of AI reasoning: they can synthesize information from multiple sources\, derive new conclusions\, and explain those conclusions to their users. However\, LLMs do not do this reliably. They hallucinate facts\, convincingly state incorrect deductions\, and exhibit logical fallacies like confirmation bias. In this talk\, I will describe my lab’s work on making LLM systems reliable by introspecting their behavior. First\, I will demonstrate that better understanding of LLMs helps us train them to be more reliable reasoners. Our work shows that model interpretation techniques can advance training methodology and dataset curation for reasoning models. Second\, I will argue that automating fine-grained evaluation of LLM output provides a level of understanding necessary for further progress. I will describe the ingredients of effective automated evaluators and a state-of-the-art factuality evaluation system\, MiniCheck\, showing that analyzing the nature of hallucinations can help reduce them. Finally\, I will describe how deeper understanding of LLMs will let us tackle their most fundamental limitations\, such as their inconsistency when given different inputs. I will propose how these pieces might soon be combined to form reliable AI systems.
URL:https://seasevents.nmsdev7.com/event/cis-seminar-specializing-llms-for-reliability/
LOCATION:Amy Gutmann Hall\, Room 414\, 3333 Chestnut Street\, Philadelphia\, 19104\, United States
ORGANIZER;CN="Computer and Information Science":MAILTO:cherylh@cis.upenn.edu
END:VEVENT
END:VCALENDAR