Session Details

611: Ditch the Quiz: Using AI Scenarios to Measure What Your Workforce Can Actually Do

November 5, 2026 2:45 pm - 3:30 pm

Multiple-choice quizzes tell us what people remember, but they rarely show us what they can actually do. For complex roles, the gap between "knowing" and "doing" is a missed opportunity for growth. While traditional assessments can feel slow or impersonal, a "middle path" has emerged: AI-powered scenario assessments.

This session introduces a universal instructional design methodology to transform static job standards into dynamic, role-specific scenario simulations. We’ll move beyond theory and dive into the craft of architecting real-world challenges. You’ll learn to assess skill application against objective behavioral rubrics while providing instant, growth-oriented feedback that empowers your workforce. We’ll spend 70% of our time in hands-on application, including:

  • The Deconstruction Workshop: Working in collaborative groups, you'll take a "static" job standard and use learner persona data to pinpoint "critical moments"
  • Behavioral Rubric Mapping: Translating skills into clear, observable actions
  • Human-in-the-Loop Validation: Discussing a simple framework for working with SMEs to validate your scenarios and rubrics for realism and cultural nuance
  • Scenario Narrative Design: Structuring a narrative that effectively tests the behaviors defined in your rubric

In this session, you will learn to:

  • Master a universal workflow for moving from written job standards to a functional, interactive scenario simulation
  • Identify high-stakes "critical moments" in any job role that are best suited for simulated assessment
  • Define specific, observable behaviors that allow AI to evaluate learner performance objectively across tiered proficiency levels
  • Draft immersive scenario narratives to trigger measurable learner decisions

To get the most out of this session, attendees should have a foundational grasp of instructional design and skill mapping. While we’ll explore AI-driven practice, no technical "coding" or complex prompting skills are required.

Track: Data & MeasurementLevel: Beginner/IntermediateFormat: Standard Session (45 Min.)