The rapid integration of AI into educational settings presents opportunities and challenges—this talk will discuss findings from three large-scale field studies investigating the impact of AI on student learning. First, we found that unfettered access to ChatGPT negatively impacted short-term student learning outcomes. Second, to understand longer-term effects, we examined learning in chess academies. Contrary to the popular strategy of promoting student agency, our findings show that self-regulated learning—where students decide when to request AI help—can substantially harm learning by diminishing engagement/motivation. Third, we found that training students with “adversarial examples” significantly improved their ability to identify and correct ChatGPT-generated hallucinations, enabling effective human-AI collaboration. Taken together, these studies suggest that while providing students with unguided AI tools can be detrimental, targeted interventions that train students to critically engage with AI can be beneficial.

Zoom: https://upenn.zoom.us/j/95189835192