Events
On this page, we aim to keep you up-to-date on events relevant to AI in Education.
Member Events 2023
June 14th 4:00pm - 5:00pm (EST) over Zoom. [Slides Notes]
Introductory meeting
Speaker Series
If you are interested in presenting, please contact the leadership team. Guidelines for speakers can be found here.
July 12th 4:00pm - 5:00pm (EST) over Zoom. [Slides]
Title: “Khanmigo” Demonstration & Lessons Learned Building GenAI Apps
Presenter: Kristen Dicerbo, Chief Learning Officer, Khan Academy
Title: Open Source Revolution: Large Models on Small Hardware
Presenter: Chris Ormerod, Principal Data Scientist, Cambium Assessment
August 9th 4:00pm - 5:00pm (EST) over Zoom. [Slides]
Title : Exploring Automated Distractor and Feedback Generation for Math Multiple-choice Questions via In-context Learning
Presenter: Andrew Lan, University of Massachusetts Amherst
Recording : [link] (Passcode: BaF?W=@6)
September 13th 4:00pm - 5:00pm (EST). [Slides]
Title: Automated Item Development for Language Assessment: Using GPT to create complex reading and listening tasks
Presenter: Andrew Runge, Duolingo
Recording : [link] (Passcode: MA4^r8E#)
October 11th 4:00pm - 5:00pm (EST) [Slides]
Title: Bias in Large Language Models in Education: Sources, Measures, and Mitigation Strategies
Presenter: Réne Kizilcec, Assistant Professor, Purdue University [link]
November 8th 4:00pm - 5:00pm (EST) [Slides]
Title: Exploring the Results of the NAEP Math and Reading Automated Scoring Challenges: Implications for Fairness
Presenter: Maggie Beiting-Parrish, Federation of American Scientists [link]
December 13th 4:00pm - 5:00pm (EST) [Slides]
Title: Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference
Presenter: Zachary Levonian [link]
Member Events 2024
February 14th 4:00pm - 5:00pm (EST) [Slides]
Title: An Application of Text Embeddings to Support Alignment of Educational Content Standards
Presenters: Harold Doran & Reese Butterfuss, Human Resources Research Organization
March 14th 4:00pm - 5:00pm (EST) [Slides]
Title: Using Large Language Models for Item Development beyond Language Testing: Barriers and Opportunities
Presenter: Victoria Yaneva, National Board of Medical Examiners
April 11th-14th : NCME Annual Conference
Consider this Schedule of Talks about AI and Measurement or Education
May 8th 4:00pm - 5:00pm (EST) [Slides]
Title: Natural Language Processing for Improving Student Learning Outcomes
Presenter: Rose E. Wang, Stanford University [link]
June 12th 4:00pm - 5:00pm (EST) [Slides]
Title: Write On with Cambi: The development of an argumentative writing feedback tool
Presenters: Christopher Ormerod, Amy Burkhardt, and Milan Patel from Cambium Assessment
July 10th 4:00pm - 5:00pm (EST) [Slides]
Title: Examining Automated Writing Evaluation Tools
Presenters: Corey Palermo from Measurement Inc. and Josh Wilson from the University of Delaware [link]
August 14th 4:00pm - 5:00pm (EST) [Slides]
Title: Securing Tests with AI: Initial Explorations in Item Generation
Presenter: Sergio Araneda from Caveon
September 11th 4:00pm - 5:00pm (EST) [Slides]
(Speaker Cancellation)
October 9th 4:00pm - 5:00pm (EST) [Slides]
Title: Enhancing Automated Scoring Engines with Generative AI: A Dual-Study
Presenter: Justin O. Barber and Edward W. Wolfe from Pearson [link]
November 13th 4:00pm - 5:00pm (EST) [Slides]
Title: Human-AI Partnerships to Support Collaborative Learning
Presenter: Peter Foltz, University of Colorado, Boulder [link]
Member Events 2025
January 8th 4:00pm - 5:00pm (EST) [Slides]
Title: Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs
Presenter: Alex Scarlatos, University of Massachusetts Amherst [link]
February 26th 4:00pm - 5:00pm (EST) [Slides]
Title: Vignettes on Algorithmic Fairness and Generative AI Evaluation
Presenters: Sanmi Koyejo, Sang Truong, and Angelina Wang, Stanford University [link]
March 19th 4:00pm - 5:00pm (EST) [Slides]
Title: Generating Automatic Feedback for Open-Ended Questions with Fine-Tuned LLMs: A Comparison of GPT and Llama
Presenter: Okan Bulut, and Elisabetta Mazzullo, University of Alberta [link]
April 23th-26th : NCME Annual Conference
https://www.ncme.org/event/annual-meeting/upcoming-meeting2025
May 14th: 4:00pm - 5:00pm (EST) [Slides]
Title: Finding Words Associated with DIF: Predicting Differential Item Functioning using LLMs and Explainable AI
Presenter: Hotaka Maeda, Smarter Balanced [Slides]
June 11th: 4:00pm - 5:00pm (EST) [Slides]
Title: Leveraging LLMs as respondents for item evaluation and item generation: A psychometric analysis
Presenters: Yunting Liu, Shreya Bhandari, and Zachary Pardos, UC Berkeley School of Education [link]
July 10th: 4:00pm - 5:00pm (EST) [Slides]
Title: Complementary Minds: Quantifying Human–AI Strengths and Robustness for Question Answering
Presenter: Maharshi Gor, The University of Maryland [link]
August 13th: 4:00pm - 5:00pm (EST) [Slides]
Title: Henry Makinde, The University of North Carolina at Greensboro
Presenter: AI-Generated Medical Certification Items Using LLMs [link]
September 10th: 4:00pm - 5:00pm (EST) [Slides]
Title: AI-Based Automated Scoring in Multilingual Large-Scale Assessments
Presenter: Ummugul Bezirhan (Boston College) [link]
October : AIME-Con!!!
December 10th: 4:00pm - 5:00pm (EST) [Slides]
Title: Predicting Item Difficulty for Pretest Items in Large-Scale Assessments
Member Events 2026
January 14th: 4:00pm - 5:00pm (EST) ) [Slides]
Title: When Language Models Model Items and Examinees: Methodological Considerations for Evaluation
Presenter: Ikkyu Choi (ETS) [link]
February 18th: 4:00pm - 5:00pm (EST) [Slides]
Title: GenAI Evidence Hub for Assessment: Initial Insights & Methods to Interpret AI Research Results
Presenter: John Whitmer (Learning Data Insights), Aaron Wong (University of Minnesota), Maggie Beiting-Parrish
March 18th: 1:30pm - 2:30pm (EST) [Slides]
Title: Measuring Machines: Psychometrics for AI Development and Evaluation
Presenter: Jodi Casabianca (Broadmetrics) [link]
NCME 2026 Annual Meeting
Moving Measurement Forward
May 13th: 4:00pm - 5:00pm (EST) [Slides]
Title: Beyond Additional Human Scores: Automated Scoring Reliability Estimation in ILSAs
Presenter: Jenny (Ji Yoon) Jung, TIMSS & PIRLS International Study Center
June 13th: 4:00pm - 5:00pm (EST)
Title: TBD
Presenter: TBD
Please send any new entries to John Whitmer jwhitmer@fas.org and Maggie Beiting-Parrish Magdalen.Beiting@ed.gov