Events
On this page, we aim to keep you up-to-date on events relevant to AI in Education.
Member Events 2023
June 14th 4:00pm - 5:00pm (EST) over Zoom. [Slides Notes]
Introductory meeting
Speaker Series
If you are interested in presenting, please contact the leadership team. Guidelines for speakers can be found here.
July 12th 4:00pm - 5:00pm (EST) over Zoom. [Slides]
Title: “Khanmigo” Demonstration & Lessons Learned Building GenAI Apps
Presenter: Kristen Dicerbo, Chief Learning Officer, Khan Academy
Title: Open Source Revolution: Large Models on Small Hardware
Presenter: Chris Ormerod, Principal Data Scientist, Cambium Assessment
August 9th 4:00pm - 5:00pm (EST) over Zoom. [Slides]
Title : Exploring Automated Distractor and Feedback Generation for Math Multiple-choice Questions via In-context Learning
Presenter: Andrew Lan, University of Massachusetts Amherst
Recording : [link] (Passcode: BaF?W=@6)
September 13th 4:00pm - 5:00pm (EST). [Slides]
Title: Automated Item Development for Language Assessment: Using GPT to create complex reading and listening tasks
Presenter: Andrew Runge, Duolingo
Recording : [link] (Passcode: MA4^r8E#)
October 11th 4:00pm - 5:00pm (EST) [Slides]
Title: Bias in Large Language Models in Education: Sources, Measures, and Mitigation Strategies
Presenter: Réne Kizilcec, Assistant Professor, Purdue University [link]
November 8th 4:00pm - 5:00pm (EST) [Slides]
Title: Exploring the Results of the NAEP Math and Reading Automated Scoring Challenges: Implications for Fairness
Presenter: Maggie Beiting-Parrish, Federation of American Scientists [link]
December 13th 4:00pm - 5:00pm (EST) [Slides]
Title: Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference
Presenter: Zachary Levonian [link]
Member Events 2024
February 14th 4:00pm - 5:00pm (EST) [Slides]
Title: An Application of Text Embeddings to Support Alignment of Educational Content Standards
Presenters: Harold Doran & Reese Butterfuss, Human Resources Research Organization
March 14th 4:00pm - 5:00pm (EST) [Slides]
Title: Using Large Language Models for Item Development beyond Language Testing: Barriers and Opportunities
Presenter: Victoria Yaneva, National Board of Medical Examiners
April 11th-14th : NCME Annual Conference
Consider this Schedule of Talks about AI and Measurement or Education
May 8th 4:00pm - 5:00pm (EST) [Slides]
Title: Natural Language Processing for Improving Student Learning Outcomes
Presenter: Rose E. Wang, Stanford University [link]
June 12th 4:00pm - 5:00pm (EST) [Slides]
Title: Write On with Cambi: The development of an argumentative writing feedback tool
Presenters: Christopher Ormerod, Amy Burkhardt, and Milan Patel from Cambium Assessment
July 10th 4:00pm - 5:00pm (EST) [Slides]
Title: Examining Automated Writing Evaluation Tools
Presenters: Corey Palermo from Measurement Inc. and Josh Wilson from the University of Delaware [link]
August 14th 4:00pm - 5:00pm (EST) [Slides]
Title: Securing Tests with AI: Initial Explorations in Item Generation
Presenter: Sergio Araneda from Caveon
September 11th 4:00pm - 5:00pm (EST) [Slides]
(Speaker Cancellation)
October 9th 4:00pm - 5:00pm (EST) [Slides]
Title: Enhancing Automated Scoring Engines with Generative AI: A Dual-Study
Presenter: Justin O. Barber and Edward W. Wolfe from Pearson [link]
November 13th 4:00pm - 5:00pm (EST) [Slides]
Title: Human-AI Partnerships to Support Collaborative Learning
Presenter: Peter Foltz, University of Colorado, Boulder [link]
Member Events 2025
January 8th 4:00pm - 5:00pm (EST) [Slides]
Title: Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs
Presenter: Alex Scarlatos, University of Massachusetts Amherst [link]
February 26th 4:00pm - 5:00pm (EST) [Slides]
Title: Vignettes on Algorithmic Fairness and Generative AI Evaluation
Presenters: Sanmi Koyejo, Sang Truong, and Angelina Wang, Stanford University [link]
March 19th 4:00pm - 5:00pm (EST) [Slides]
Title: Generating Automatic Feedback for Open-Ended Questions with Fine-Tuned LLMs: A Comparison of GPT and Llama
Presenter: Okan Bulut, and Elisabetta Mazzullo, University of Alberta [link]
April 23th-26th : NCME Annual Conference
https://www.ncme.org/event/annual-meeting/upcoming-meeting2025
May 14th: 4:00pm - 5:00pm (EST) [Slides]
Title: Finding Words Associated with DIF: Predicting Differential Item Functioning using LLMs and Explainable AI
Presenter: Hotaka Maeda, Smarter Balanced [Slides]
June 11th: 4:00pm - 5:00pm (EST) [Slides]
Title: Leveraging LLMs as respondents for item evaluation and item generation: A psychometric analysis
Presenters: Yunting Liu, Shreya Bhandari, and Zachary Pardos, UC Berkeley School of Education
July 10th: 4:00pm - 5:00pm (EST)
Title: TBD
Presenter: Maharshi Gor, The University of Maryland
AIME-Con
Innovation and Evidence: Shaping the Future of AI in Educational Measurement
| Presenting Organization | Artificial Intelligence in Measurement and Education (AIME) Special Interest Group of the National Council on Measurement in Education (NCME) |
|---|---|
| Location | Pittsburgh, Pennsylvania, United States Wyndham Grand Pittsburgh Downtown |
| Dates | October 27 through October 29, 2025 |
| Modality | In-person |
| Call for Proposals | See the call for proposals here. |
| Proposal Deadline | June 15, 2025; 11:59pm EST |
For more information, visit the official AIME-Con website:
https://www.ncme.org/event/special-conferences/aime-conference
Please send any new entries to John Whitmer jwhitmer@fas.org and Maggie Beiting-Parrish Magdalen.Beiting@ed.gov