Events
On this page, we aim to keep you up-to-date on events relevant to AI in Education.
Member Events 2023
June 14th 4:00pm - 5:00pm (EST) over Zoom. [Slides Notes]
Introductory meeting
Speaker Series
If you are interested in presenting, please contact the leadership team. Guidelines for speakers can be found here.
July 12th 4:00pm - 5:00pm (EST) over Zoom. [Slides]
Title: “Khanmigo” Demonstration & Lessons Learned Building GenAI Apps
Presenter: Kristen Dicerbo, Chief Learning Officer, Khan Academy
Title: Open Source Revolution: Large Models on Small Hardware
Presenter: Chris Ormerod, Principal Data Scientist, Cambium Assessment
August 9th 4:00pm - 5:00pm (EST) over Zoom. [Slides]
Title : Exploring Automated Distractor and Feedback Generation for Math Multiple-choice Questions via In-context Learning
Presenter: Andrew Lan, University of Massachusetts Amherst
Recording : [link] (Passcode: BaF?W=@6)
September 13th 4:00pm - 5:00pm (EST). [Slides]
Title: Automated Item Development for Language Assessment: Using GPT to create complex reading and listening tasks
Presenter: Andrew Runge, Duolingo
Recording : [link] (Passcode: MA4^r8E#)
October 11th 4:00pm - 5:00pm (EST) [Slides]
Title: Bias in Large Language Models in Education: Sources, Measures, and Mitigation Strategies
Presenter: Réne Kizilcec, Assistant Professor, Purdue University [link]
November 8th 4:00pm - 5:00pm (EST) [Slides]
Title: Exploring the Results of the NAEP Math and Reading Automated Scoring Challenges: Implications for Fairness
Presenter: Maggie Beiting-Parrish, Federation of American Scientists [link]
December 13th 4:00pm - 5:00pm (EST) [Slides]
Title: Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference
Presenter: Zachary Levonian [link]
Member Events 2024
February 14th 4:00pm - 5:00pm (EST) [Slides]
Title: An Application of Text Embeddings to Support Alignment of Educational Content Standards
Presenters: Harold Doran & Reese Butterfuss, Human Resources Research Organization
March 14th 4:00pm - 5:00pm (EST) [Slides]
Title: Using Large Language Models for Item Development beyond Language Testing: Barriers and Opportunities
Presenter: Victoria Yaneva, National Board of Medical Examiners
April 11th-14th : NCME Annual Conference
Consider this Schedule of Talks about AI and Measurement or Education
May 8th 4:00pm - 5:00pm (EST) [Slides]
Title: Natural Language Processing for Improving Student Learning Outcomes
Presenter: Rose E. Wang, Stanford University [link]
June 12th 4:00pm - 5:00pm (EST) [Slides]
Title: Write On with Cambi: The development of an argumentative writing feedback tool
Presenters: Christopher Ormerod, Amy Burkhardt, and Milan Patel from Cambium Assessment
July 10th 4:00pm - 5:00pm (EST) [Slides]
Title: Examining Automated Writing Evaluation Tools
Presenters: Corey Palermo from Measurement Inc. and Josh Wilson from the University of Delaware [link]
August 14th 4:00pm - 5:00pm (EST) [Slides]
Title: Securing Tests with AI: Initial Explorations in Item Generation
Presenter: Sergio Araneda from Caveon
September 11th 4:00pm - 5:00pm (EST) [Slides]
(Speaker Cancellation)
October 9th 4:00pm - 5:00pm (EST) [Slides]
Title: Enhancing Automated Scoring Engines with Generative AI: A Dual-Study
Presenter: Justin O. Barber and Edward W. Wolfe from Pearson
Active Publication Opportunities
The 49th International Association for Educational Assessment (IAEA) Annual Conference
The 49th International Association for Educational Assessment (IAEA) Annual Conference, hosted by ETS in Philadelphia, Pennsylvania, U.S., will provide an opportunity for industry thought leaders, training providers, and practitioners to examine current and recent advancements in educational assessments, focusing on the theme How Can AI Help Improve Educational Assessments? While AI has gained broader interest globally in education and beyond with the creation of chat GPT and the subsequent emergence of many other tools and applications based on generative AI, forms of AI have been used in assessments for decades, including automatic item generation for new assessments, natural language processing (NLP) or large-language model (LLM) methods for automatic scoring of essays (e.g., ETS e-rater), or onthefly individualized assessment assembly based on computer-adaptive testing (CAT).
Place: Philadelphia, PA
Date: September 22–25, 2024
2024 NCME Special Conference on Classroom Assessment
This year’s special conference is being co-hosted by the University of Illinois at Chicago and the Chicago Public Schools, with support from the Center for Assessment. These hosts continue NCME’s longstanding commitment to improving assessment practices that privilege deeper learning for all, and that happen directly between teachers and their students.
Place: Chicago, IL
Date: September 19-20, 2024
Please send any new entries to John Whitmer jwhitmer@fas.org and Maggie Beiting-Parrish Magdalen.Beiting@ed.gov