Events

On this page, we aim to keep you up-to-date on events relevant to AI in Education.

Member Events 2023


June 14th 4:00pm - 5:00pm (EST) over Zoom. [Slides Notes]

Introductory meeting


Speaker Series

If you are interested in presenting, please contact the leadership team. Guidelines for speakers can be found here.


July 12th 4:00pm - 5:00pm (EST) over Zoom. [Slides]

Title: “Khanmigo” Demonstration & Lessons Learned Building GenAI Apps

Presenter: Kristen Dicerbo, Chief Learning Officer, Khan Academy

Title: Open Source Revolution: Large Models on Small Hardware

Presenter: Chris Ormerod, Principal Data Scientist, Cambium Assessment


August 9th 4:00pm - 5:00pm (EST) over Zoom. [Slides]

Title : Exploring Automated Distractor and Feedback Generation for Math Multiple-choice Questions via In-context Learning

Presenter: Andrew Lan, University of Massachusetts Amherst

Recording : [link] (Passcode: BaF?W=@6)


September 13th 4:00pm - 5:00pm (EST). [Slides]

Title: Automated Item Development for Language Assessment: Using GPT to create complex reading and listening tasks

Presenter: Andrew Runge, Duolingo

Recording : [link] (Passcode: MA4^r8E#)


October 11th 4:00pm - 5:00pm (EST) [Slides]

Title: Bias in Large Language Models in Education: Sources, Measures, and Mitigation Strategies

Presenter: Réne Kizilcec, Assistant Professor, Purdue University [link]


November 8th 4:00pm - 5:00pm (EST) [Slides]

Title: Exploring the Results of the NAEP Math and Reading Automated Scoring Challenges: Implications for Fairness

Presenter: Maggie Beiting-Parrish, Federation of American Scientists [link]


December 13th 4:00pm - 5:00pm (EST) [Slides]

Title: Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference

Presenter: Zachary Levonian [link]


Member Events 2024

February 14th 4:00pm - 5:00pm (EST) [Slides]

Title: An Application of Text Embeddings to Support Alignment of Educational Content Standards

Presenters: Harold Doran & Reese Butterfuss, Human Resources Research Organization


March 14th 4:00pm - 5:00pm (EST) [Slides]

Title: Using Large Language Models for Item Development beyond Language Testing: Barriers and Opportunities

Presenter: Victoria Yaneva, National Board of Medical Examiners


April 11th-14th : NCME Annual Conference

Consider this Schedule of Talks about AI and Measurement or Education


May 8th 4:00pm - 5:00pm (EST) [Slides]

Title: Natural Language Processing for Improving Student Learning Outcomes

Presenter: Rose E. Wang, Stanford University [link]


June 12th 4:00pm - 5:00pm (EST) [Slides]

Title: Write On with Cambi: The development of an argumentative writing feedback tool

Presenters: Christopher Ormerod, Amy Burkhardt, and Milan Patel from Cambium Assessment


July 10th 4:00pm - 5:00pm (EST) [Slides]

Title: Examining Automated Writing Evaluation Tools

Presenters: Corey Palermo from Measurement Inc. and Josh Wilson from the University of Delaware [link]


August 14th 4:00pm - 5:00pm (EST) [Slides]

Title: Securing Tests with AI: Initial Explorations in Item Generation

Presenter: Sergio Araneda from Caveon


September 11th 4:00pm - 5:00pm (EST) [Slides]

(Speaker Cancellation)


October 9th 4:00pm - 5:00pm (EST) [Slides]

Title: Enhancing Automated Scoring Engines with Generative AI: A Dual-Study

Presenter: Justin O. Barber and Edward W. Wolfe from Pearson [link]


November 13th 4:00pm - 5:00pm (EST) [Slides]

Title: Human-AI Partnerships to Support Collaborative Learning

Presenter: Peter Foltz, University of Colorado, Boulder [link]


January 8th 4:00pm - 5:00pm (EST) [Slides]

Title: Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMs

Presenter: Alex Scarlatos, University of Massachusetts Amherst [link]


INNOVATIONS IN TESTING CONFERENCE!

The Association of Test Publishers (ATP)

Better Together: Testing the Limits. Learn from the assessment industries’ leading organizations at Innovations, the testing community conference. Share the latest technology and concepts in innovations, foster networking for professional growth, and refresh your expertise. We challenge you to test the limits by showcasing your organization’s cutting-edge solutions and sharing research findings to lead the way.

Date: March 23-26, 2025

Place: Orlando, FL


Please send any new entries to John Whitmer and Maggie Beiting-Parrish