The Smarter Assessment Podcast

AI Conversational Testing: A Deeper Dive, with Wallace Judd, PhD (E15)

A few weeks ago, we introduced the topic of AI-driven conversational testing. This webinar will dive deeper into the details. * Test definition & design * Item development * How scoring works * Reporting * Use in interviews * Quality Assurance * LMS Integration We then see a demo of the platform in action. Want to try it yourself? Head to https://dotell.netlify.app [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa1JmQ0RQNFpDQ2hER1BJRXdjV1VyZFJiSnhVZ3xBQ3Jtc0tsNnRnUGZZNWhoS2oxWGRzZzlEazlvRV93WWJZdk1BclR0TjIwQUY0bV9LRFI2UW16cVEyb0dTTjVDNGUwY3dfbUlIZ0pKNTIxSTdwOXJWYlI1aU5YSjdEaUMybHRXeERucWtGS1V3Y0Z5YmRrY3BUbw&q=https%3A%2F%2Fdotell.netlify.app%2F&v=OVvT7vnhpVU]. This week's guest: Wallace Judd, PhDDr. Judd is the founder and Chief Scientist at Authentic Testing, where he is one of the industry thought leaders in psychometrics and educational assessment. Originally an elementary teacher, where he wrote 13 educational books and kits as well as patented the Overhead Demonstration Calculator, Dr. Judd then received his PhD from Stanford with a dissertation in IRT under Lee Chronbach. He then worked in testing and training for Xerox PARC, Apple, Kelly Services and Netscape. Dr. Judd started Mentrix Corporation, where he developed the Judd Test Series, the first commercially available hands-on performance tests for personal computers. He later sold Mentrix to Kelly Services where he became a Research Fellow and V.P. of Research and Development. He consulted on the Construction Hazards ID program which was the first Virtual Reality certification to be accredited by ANAB under ISO/IEC 17024. Dr. Judd was an ANSI Assessor for 9 years, and authored the 17024 Compliance Handbook to help more organizations achieve this milestone.

Human vs Artificial Intelligence in Online Proctoring (E14)

As remote-proctored online testing becomes more and more common, we are often provided with a choice during implementation: when is human proctoring a better fit, and when should you use AI? Join two CEOs from the front lines of online assessment for an unscripted, in-depth webinar that cuts through the marketing noise and gives you the real framework for making smarter proctoring decisions.In this session, we'll break down exactly how both AI and human proctoring work, then give you practical guidelines for choosing the right approach for your specific context, whether that is the exam stakes, test volume, accessibility requirements, or data privacy concerns.From there, we'll share concrete best practices for getting the most out of human proctoring — including proctor recruitment, training, supervision, and environmental controls — followed by a broader toolkit of security strategies that go beyond proctoring itself, from lockdown browsers and audit tracking to item isomorphs, adaptive testing, and automated item generation. We'll also address the elephant in the room: AI-assisted cheating.This webinar is for you if you are: * A testing program manager or psychometrician evaluating proctoring vendors * A credentialing or certification professional responsible for exam integrity * An HR or L&D leader deploying high-stakes assessments at scale * Anyone making decisions about remote vs. in-person exam delivery HOST: Nathan Thompson, PhD, is the CEO and cofounder of Assessment Systems, home of the powerful assessment ecosystem, FastTest. Originally a psychometrician, Nate’s focus is the development of software to make assessment professionals more effective and efficient.GUEST: Don Kassner is the CEO and founder of MonitorEDU, an industry visionary that also founded ProctorU when online proctoring was still a new idea. He’s served as the VP of Sales at an online testing platform and the president of a university, which gives him a perspective from multiple angles in the world of learning and assessment.

E13: Novel Item Types in Assessment: A Guide to Design and Development

Traditional items like multiple choice, essay, and short answer can only measure so much. Today’s candidates—and the roles they’re preparing for—demand more authentic, skills-based assessment. In this live webinar, a leading certification exam development expert will explore how novel item types such as simulations, performance-based tasks, and interactive scenarios can dramatically improve the validity, fidelity, and defensibility of your exams. You’ll learn when and why to move beyond traditional items, how simulations and performance assessments can better reflect real-world job tasks, and what practical considerations matter most when designing and scoring these item types. The session will also address common challenges—such as cost, scalability, and psychometric rigor—and share proven strategies to overcome them. Whether you manage high-stakes exam programs, design assessments, are a subject matter expert, or are exploring ways to modernize your exams, this webinar will provide actionable insights you can apply immediately. Join us to see how innovative item types can elevate candidate experience, strengthen stakeholder confidence, and improve the validity of your assessments. Sign up for a free account in our industry-leading assessment authoring and delivery platform, FastTest: https://assess.com/fasttest/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbTNzemRIUmtWenlRWC0xbXNHaFRWNWtNR0hwUXxBQ3Jtc0trbFFtWlRFLTl6WHJMZWZfZmdjdDNuWVVCSkJYUVl5WmdIeXd3UDFVVElWOHZLVnY1NDZ3cE0tYkVqVUc1Y3RET2NzelJYQ2FmSmlpSUJPSzNhNlNqM0NQRHIzSjQ3TWljX2F3Uk5jdmVPel9VTllROA&q=https%3A%2F%2Fassess.com%2Ffasttest%2F&v=WN1rAvA-Vrg]ABOUT THE PRESENTER Belinda Brunner has over twenty years of experience in high-stakes assessment, both in the US and internationally. She has worked with assessment programs in a wide range of industry sectors, from construction to healthcare to higher education admissions. She is a co-author of the “Technology-Enhanced Items” chapter of the International Testing Commission/Association of Test Publishers’ Guidelines for Technology-Based Assessment (2023).

E12: Leveraging Bloom's Taxonomy in Test Development

Bloom's Taxonomy is a common approach to classifying the cognitive demands of a test question. In this practical webinar, we will discuss how this framework can help you design assessments more effectively and write better items to drive validity in assessment. We'll talk about how to conceptualize questions that go beyond simple recall, align with learning objectives, and avoid common pitfalls. Whether you're new to test development or looking to refine your approach, you'll leave with actionable strategies to elevate your testing practices. ABOUT THE PRESENTER Belinda Brunner has over twenty years of experience in high-stakes assessment, both in the US and internationally. She has worked with assessment programs in a wide range of industry sectors, from construction to healthcare to higher education admissions. She is a co-author of the “Technology-Enhanced Items” chapter of the International Testing Commission/Association of Test Publishers’ Guidelines for Technology-Based Assessment (2023).

E11: Best Practices for Remote Oral and Practical Assessments - Patrick Ochoa and Kaiti Hofer

Oral and practical assessments have long been a part of the educational process, especially for complex or hands-on professions. This video discusses best practices to deliver such assessments online, while maintaining security and validity. Presenters: Patrick Ochoa - VP of Partnerships at Assessment Systems https://assess.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbnQzVkNoUTNZaURGNTJIQ0ZDblpKQkpPRUZMZ3xBQ3Jtc0tucGVzbDAxNkMxMjUzMXBHNDl0WlYtTE15ZktIVkNjMU9Fa1pVdnBJYWRjZ2pZMDJteXUxY3ppeXBtdWpWcG50enZJZTlQOUpkTGJhSjVYVXZtWlZJY0VuNzU4ZkM2RDd1dDFWb1F5blZONjFDSGlGTQ&q=https%3A%2F%2Fassess.com%2F&v=WgSHBfKuUFg] Kaiti Hofer - Director of High-Stakes Assessments at MonitorEDU https://monitoredu.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbXRZR1l3MzlUR2tEX0VfYW40NVVRekpIQnE3UXxBQ3Jtc0tuRzh3RFBzRURacWl4VmZIR1dZTFU1cjJNUlpic0RlX1lYd1RLTmNhVzQzOGFKZVB2WTZwMkdqVS1ocHEwcWp3dnl6S0Y2Nll6Q01ua01yelVpTmZGelEzLWtXNUpBWURDUDZsQi1rN3owRFZlSDJZWQ&q=https%3A%2F%2Fmonitoredu.com%2F&v=WgSHBfKuUFg]