Artificial Intelligence in Measurement and Education
Introductions
Executive Board
Outline
AIME Updates
Research Presentation: Ummugul Bezirhan, Boston College
Additional SIG Updates & Calls for Participation
Early Bird Deadline Approaching
Register by September 18 to secure the discounted rate before prices increase. Space is limited, so register today: AIME-Con Registration.
Special NCME Membership Promotion:
Become a member of the National Council on Measurement in Education (NCME) before registering to take advantage of the lower member registration fee. Even better—if you become a member and attend AIME-Con 2025, your membership will be extended through December 31, 2026 at no extra cost.
Professional Training Sessions:
Enhance your experience by signing up for our specialized 2- and 4-hour training sessions led by experts. View extended session descriptions to find the perfect fit for your professional development needs.
Explore the Full Program: Check out the online program to see all the exciting sessions planned: AIME-Con Online Program
We look forward to seeing you in Pittsburgh for what promises to be an outstanding and energizing conference!
AIME Updates
NCME 2026 Annual Meeting
Date: April 8-11, 2026
Location: Los Angeles, California
Theme: Moving Measurement Forward
Call for Proposals: Friday, September 12, 2025, at 11:59 PM PDT
The NCME Annual Meeting was a great success for AI. We encourage our members to collaborate towards organizing coordinated sessions over individual papers.
2026 Annual Meeting Program Chairs: Pamela Kaliski and Stefanie Wind
GenAI Evidence Hub for Assessment
Building on prior efforts of this working group, we have received a grant to expand the “evidence hub” to ~250 research papers in several applied areas of GenAI.
Project will:
Develop Evidence Rubric – refine and publish a rubric grounded in contemporary measurement standards.
Human Coding of ≥ 250 Studies – trained coders will apply the rubric, achieving Cohen’s kappa (κ) ≥ 0.80 on a 50-paper calibration set.
Publish Results & Annotated Corpus – release practitioner guidance, a searchable database of coded studies, and a technical appendix on LLM-based auto-coding (target ≤ 0.05 κ divergence from human ratings).
We are currently reviewing the rubric, research design, and literature. If you’re interested in contributing research papers or reviewing research design, please contact John (john@ld-insights.com)
Research Presentation
Ummugul Bezirhan, Boston College
AI-Based Automated Scoring in Multilingual Large-Scale Assessments
Additional SIG Updates & Calls for Participation
The International Review of Research in Open and Distributed Learning (IRRODL)
This special issue will explore the rapidly evolving role of AI, including generative AI (GenAI) and artificial intelligence in education (AIED), across a range of online and distributed learning environments. We welcome empirical, theoretical, and conceptual papers that investigate the design, implementation, outcomes, and critical implications of AI technologies in educational settings.
The deadline for submissions is October 31, 2025.
https://www.irrodl.org/index.php/irrodl/announcement/view/35
