Events

On this page, we aim to keep you up-to-date on events relevant to AI in Education.

Member Events 2023


June 14th 4:00pm - 5:00pm (EST) over Zoom. [Slides Notes]

Introductory meeting


Speaker Series

If you are interested in presenting, please contact the leadership team. Guidelines for speakers can be found here.


July 12th 4:00pm - 5:00pm (EST) over Zoom. [Slides]

Title: “Khanmigo” Demonstration & Lessons Learned Building GenAI Apps

Presenter: Kristen Dicerbo, Chief Learning Officer, Khan Academy

Title: Open Source Revolution: Large Models on Small Hardware

Presenter: Chris Ormerod, Principal Data Scientist, Cambium Assessment


August 9th 4:00pm - 5:00pm (EST) over Zoom. [Slides]

Title : Exploring Automated Distractor and Feedback Generation for Math Multiple-choice Questions via In-context Learning

Presenter: Andrew Lan, University of Massachusetts Amherst

Recording : [link] (Passcode: BaF?W=@6)


September 13th 4:00pm - 5:00pm (EST). [Slides]

Title: Automated Item Development for Language Assessment: Using GPT to create complex reading and listening tasks

Presenter: Andrew Runge, Duolingo

Recording : [link] (Passcode: MA4^r8E#)


October 11th 4:00pm - 5:00pm (EST) [Slides]

Title: Bias in Large Language Models in Education: Sources, Measures, and Mitigation Strategies

Presenter: Réne Kizilcec, Assistant Professor, Purdue University [link]


November 8th 4:00pm - 5:00pm (EST) [Slides]

Title: Exploring the Results of the NAEP Math and Reading Automated Scoring Challenges: Implications for Fairness

Presenter: Maggie Beiting-Parrish, Federation of American Scientists [link]


December 13th 4:00pm - 5:00pm (EST) [Slides]

Title: Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference

Presenter: Zachary Levonian [link]


Member Events 2024

February 14th 4:00pm - 5:00pm (EST) [Slides]

Title: An Application of Text Embeddings to Support Alignment of Educational Content Standards

Presenters: Harold Doran & Reese Butterfuss, Human Resources Research Organization


March 14th 4:00pm - 5:00pm (EST) [Slides]

Title: Using Large Language Models for Item Development beyond Language Testing: Barriers and Opportunities

Presenter: Victoria Yaneva, National Board of Medical Examiners


April 11th-14th : NCME Annual Conference

Consider this Schedule of Talks about AI and Measurement or Education


May 8th 4:00pm - 5:00pm (EST) [Slides]

Title: Natural Language Processing for Improving Student Learning Outcomes

Presenter: Rose E. Wang, Stanford University [link]


June 12th 4:00pm - 5:00pm (EST) [Slides]

Title: Write On with Cambi: The development of an argumentative writing feedback tool

Presenters: Christopher Ormerod, Amy Burkhardt, and Milan Patel from Cambium Assessment


July 10th 4:00pm - 5:00pm (EST) [Slides]

Title: Examining Automated Writing Evaluation Tools

Presenters: Corey Palermo from Measurement Inc. and Josh Wilson from the University of Delaware [link]


August 14th 4:00pm - 5:00pm (EST) [Slides]

Title: Securing Tests with AI: Initial Explorations in Item Generation

Presenter: Sergio Araneda from Caveon


September 11th 4:00pm - 5:00pm (EST) [Slides]

(Speaker Cancellation)


October 9th 4:00pm - 5:00pm (EST) [Slides]

Title: Enhancing Automated Scoring Engines with Generative AI: A Dual-Study

Presenter: Justin O. Barber and Edward W. Wolfe from Pearson [link]


November 13th 4:00pm - 5:00pm (EST) [Slides]

Title: Human-AI Partnerships to Support Collaborative Learning

Presenter: Peter Foltz, University of Colorado, Boulder [link]

Member Events 2025

January 8th 4:00pm - 5:00pm (EST) [Slides]

Title: Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs

Presenter: Alex Scarlatos, University of Massachusetts Amherst [link]


February 26th 4:00pm - 5:00pm (EST) [Slides]

Title: Vignettes on Algorithmic Fairness and Generative AI Evaluation

Presenters: Sanmi Koyejo, Sang Truong, and Angelina Wang, Stanford University [link]


March 19th 4:00pm - 5:00pm (EST) [Slides]

Title: Generating Automatic Feedback for Open-Ended Questions with Fine-Tuned LLMs: A Comparison of GPT and Llama

Presenter: Okan Bulut, and Elisabetta Mazzullo, University of Alberta [link]


April 23th-26th : NCME Annual Conference

https://www.ncme.org/event/annual-meeting/upcoming-meeting2025

AI Talks


May 14th: 4:00pm - 5:00pm (EST) [Slides]

Title: Finding Words Associated with DIF: Predicting Differential Item Functioning using LLMs and Explainable AI

Presenter: Hotaka Maeda, Smarter Balanced [Slides]


June 11th: 4:00pm - 5:00pm (EST) [Slides]

Title: Leveraging LLMs as respondents for item evaluation and item generation: A psychometric analysis

Presenters: Yunting Liu, Shreya Bhandari, and Zachary Pardos, UC Berkeley School of Education


July 10th: 4:00pm - 5:00pm (EST)

Title: TBD

Presenter: Maharshi Gor, The University of Maryland


AIME-Con

Innovation and Evidence: Shaping the Future of AI in Educational Measurement

Presenting Organization Artificial Intelligence in Measurement and Education (AIME) Special Interest Group of the National Council on Measurement in Education (NCME)
Location Pittsburgh, Pennsylvania, United States
Wyndham Grand Pittsburgh Downtown
Dates October 27 through October 29, 2025
Modality In-person
Call for Proposals See the call for proposals here.
Proposal Deadline June 15, 2025; 11:59pm EST

For more information, visit the official AIME-Con website:

https://www.ncme.org/event/special-conferences/aime-conference


Please send any new entries to John Whitmer and Maggie Beiting-Parrish