BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Penn Engineering Events - ECPv6.15.18//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Penn Engineering Events
X-ORIGINAL-URL:https://seasevents.nmsdev7.com
X-WR-CALDESC:Events for Penn Engineering Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20210314T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20211107T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20220313T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20221106T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20230312T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20231105T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20220127T110000
DTEND;TZID=America/New_York:20220127T120000
DTSTAMP:20260406T070716
CREATED:20220121T154409Z
LAST-MODIFIED:20220121T154409Z
UID:6088-1643281200-1643284800@seasevents.nmsdev7.com
SUMMARY:ESE Spring Colloquium - "The One Learning Algorithm Hypothesis--           Towards Universal Machine Learning Models and Architectures"
DESCRIPTION:We revisit the “One Learning Algorithm Hypothesis” of Andrew Ng (Google Brain) according to which the brain of higher-level animals and of humans processes and perceives sensory data (vision\, sound\, haptics) with the same abstract algorithmic architecture. We develop models\, based on our earlier work on automatic target recognition with radar and other sensors\, face recognition and image classification\, which employ a multi-resolution preprocessor\, followed by a group-invariance based feature extractor\, followed by a machine learning (ML) module that employs the two fundamental algorithms of Kohonen Learning Vector Quantization (LVQ)\, for supervised learning\, and Self-Organizing Map (SOM)\, for unsupervised learning. In addition the model and algorithms utilize a “global” feedback from the output of the overall system back to the feature extractor and to the multiresolution preprocessor. We first summarize briefly our older results with such algorithms and their remarkable\, domain agnostic\, performance on various applications. We then provide our recent results on the mathematical analysis of the resulting Tree Structure Learning Vector Quantization (TSLVQ) ML architecture and algorithms. We introduce and integrate Deterministic Annealing (DA) with our older architecture and demonstrate the resulting tremendous reduction in data required for learning and application. The new algorithms allow even on-line progressive learning. We utilize Bregman divergences as dissimilarity measures\, which allows us to provide direct transition from “dissimilarity distance” to probability of error\, which cannot be achieved with the commonly used metric-based dissimilarity measures. We show that many deep learning network architectures can be mapped to this “universal” architecture. We show that the integrated algorithm converges to the true Bayes decision surface\, albeit with variable resolution at various parts of it\, as required. The latter brings a tight connection to integrated hypothesis testing with compressed data. We demonstrate the results in various applications and close with future directions and extensions.
URL:https://seasevents.nmsdev7.com/event/ese-spring-colloquium-the-one-learning-algorithm-hypothesis-towards-universal-machine-learning-models-and-architectures/
LOCATION:Raisler Lounge (Room 225)\, Towne Building\, 220 South 33rd Street\, Philadelphia\, PA\, 19104\, United States
CATEGORIES:Seminar,Colloquium
ORGANIZER;CN="Electrical and Systems Engineering":MAILTO:eseevents@seas.upenn.edu
END:VEVENT
END:VCALENDAR