NCME Conference 2025

Conference Schedule

Wednesday April 23rd - Training Sessions

Time	Session
8:00am - 12:00pm	Best Practices for Artificial-Intelligence Scoring Location: Colorado CD
1:00pm - 5:00pm	Cloud Computing and Artificial Intelligence in Psychometric Applications Location: Colorado IJ
	Introduction to AI-based Automated Item Generation and Automated Scoring Location: Penrose 2

Thursday April 24th - Day 1

Time	Session
8:00am - 9:30am	Generative AI in Education: Applied Ethics & Evaluating Model Performance Location: Denver 1-2
9:45am - 11:15am	A Framework to Guide Development and Evaluation of AI-Based Formative Assessment Systems Location: Denver 1-2
	Innovations in Using Large Language Models for Automated Scoring and Automated Writing Evaluation Location: Denver 5-6
1:30pm - 3:00pm	Automating Item Development with Artificial Intelligence: From Generation to Evaluation Location: Colorado AB
	Comparing Approaches for Using Large Language Models for Scoring and Specialized Assessments Location: Denver 5-6
3:15pm - 4:15pm	Applications of Generative AI to Mathematics Education: Opportunities and Challenges Location: Penrose 2
	Using AI to Address Challenges in Scoring and Automated Feedback Location: Denver 4
3:35pm - 5:05pm	Toward Responsible Use of AI in Education Research and Development Location: Convention Center Room 705 (joint NCME/AERA)
4:30pm - 6:00pm	Generative-AI automatic item generation for large-scale language assessments Location: Denver 4

Friday April 25th - Day 2

Time	Session
9:45am - 11:15am	AI Innovative Applications in Automated Scoring Location: Colorado AB
	Comparing Approaches to Reduce Vulnerabilities and Improve Performance of Large Language Models in Assessment Location: Denver 3
	Revolutionizing Big Data with Advanced AI and Machine Learning Location: Penrose 2
11:30am - 1:00pm	Innovations in Automated Scoring Modeling Location: Colorado AB
1:30pm - 3:00pm	LLM respondents in Measurement Location: Colorado AB
	Computation Psychometrics in the Wild: Scalable Procedures for Maining Test Scores Location: Denver 1-2
2:30pm - 3:00pm	AIME In-Person SIGIMIE Meeting Location: The Gold Coin Room
4:30pm - 6:00pm	From Principles to Practice: Operationalizing Responsible AI in Educational Measurement Location: Colorado EF
	Using Large Language Models for Alignment and Progression Tasks Location: Colorado CD

Saturday April 26th - Day 3

Time	Session
8:00am - 9:30am	Generative AI in Education: Applied Ethics & Evaluating Model Performance Location: Denver 1-2
	Recent Theoretical AI Developments in Educational Assessment Location: Denver 5-6
9:45am - 11:15am	Leveraging Large-Language Models for Operational Large-Scale Assessments: Opportunities and Challenges Location: Denver 1-2
	Psychometrically-driven Product Development in the Age of AI Location: Colorado EF
11:30am - 1:00pm	Expanding Automated Scoring Validity & Generalizability using AI Location: Denver 1-2
	Understanding AI and Human Ratings: Complementary Roles of AI and Human Raters Location: Denver 3
3:15pm - 4:15pm	Applications of Large Language Models to Automated Scoring and Feedback Location: Colorado IJ