On this page, we aim to keep you up-to-date on events relevant to AI in Education.

Member Events 2023

June 14th 4:00pm - 5:00pm (EST) over Zoom. Slides Notes

Introductory meeting

Speaker Series

If you are interested in presenting, please contact the leadership team. Guidelines for speakers can be found here.

July 12th 4:00pm - 5:00pm (EST) over Zoom. Slides

Title: “Khanmigo” Demonstration & Lessons Learned Building GenAI Apps

Presenter: Kristen Dicerbo, Chief Learning Officer, Khan Academy

Title: Open Source Revolution: Large Models on Small Hardware

Presenter: Chris Ormerod, Principal Data Scientist, Cambium Assessment

August 9th 4:00pm - 5:00pm (EST) over Zoom. Slides

Title : Exploring Automated Distractor and Feedback Generation for Math Multiple-choice Questions via In-context Learning

Presenter: Andrew Lan, University of Massachusetts Amherst

Recording : [link] (Passcode: BaF?W=@6)

September 13th 4:00pm - 5:00pm (EST). Slides

Title: Automated Item Development for Language Assessment: Using GPT to create complex reading and listening tasks

Presenter: Andrew Runge, Duolingo

Recording : [link] (Passcode: MA4^r8E#)

October 11th 4:00pm - 5:00pm (EST) Slides

Title: Bias in Large Language Models in Education: Sources, Measures, and Mitigation Strategies

Presenter: Réne Kizilcec, Assistant Professor, Purdue University [link]

November 8th 4:00pm - 5:00pm (EST) Slides

Title: Exploring the Results of the NAEP Math and Reading Automated Scoring Challenges: Implications for Fairness

Presenter: Maggie Beiting-Parrish, Federation of American Scientists [link]

December 13th 4:00pm - 5:00pm (EST)

Title: Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference

Presenter: Zachary Levonian [link]

Member Events 2024

February 14th 4:00pm - 5:00pm (EST) Slides

Title: An Application of Text Embeddings to Support Alignment of Educational Content Standards

Presenters: Harold Doran & Reese Butterfuss, Human Resources Research Organization

March 14th 4:00pm - 5:00pm (EST) Slides

Title: Using Large Language Models for Item Development beyond Language Testing: Barriers and Opportunities

Presenter: Victoria Yaneva, National Board of Medical Examiners

April 11th-14th : NCME Annual Conference

Consider this Schedule of Talks about AI and Measurement or Education

May 8th 4:00pm - 5:00pm (EST) Slides

Title: Natural Language Processing for Improving Student Learning Outcomes

Presenter: Rose E. Wang, Stanford University [link]

June 12th 4:00pm - 5:00pm (EST) Slides

Title: Write On with Cambi: The development of an argumentative writing feedback tool

Presenters: Christopher Ormerod, Amy Burkhardt, and Milan Patel from Cambium Assessment

July 10th 4:00pm - 5:00pm (EST) Slides

Title: Examining Automated Writing Evaluation Tools

Presenters: Corey Palermo from Measurement Inc. and Josh Wilson from the University of Delaware

Active Publication Opportunities

The 49th International Association for Educational Assessment (IAEA) Annual Conference

The 49th International Association for Educational Assessment (IAEA) Annual Conference, hosted by ETS in Philadelphia, Pennsylvania, U.S., will provide an opportunity for industry thought leaders, training providers, and practitioners to examine current and recent advancements in educational assessments, focusing on the theme How Can AI Help Improve Educational Assessments? While AI has gained broader interest globally in education and beyond with the creation of chat GPT and the subsequent emergence of many other tools and applications based on generative AI, forms of AI have been used in assessments for decades, including automatic item generation for new assessments, natural language processing (NLP) or large-language model (LLM) methods for automatic scoring of essays (e.g., ETS e-rater), or onthefly individualized assessment assembly based on computer-adaptive testing (CAT).

Place: Philadelphia, PA

Date: September 22–25, 2024

The Teaching & Learning with AI conference

Teaching & Learning with AI is designed for instructors, higher education professionals, librarians, researchers, and policymakers who are interested in exploring the potential of AI in higher ed across the higher education landscape. If you want to learn more about how you can leverage AI to improve learning outcomes, research, services, and operations, then this is a must-attend event.

Place: Orlando, FL

Date: July 22–24, 2024

Please send any new entries to John Whitmer and Maggie Beiting-Parrish