AI Can't Read the Room: Myra Roldan on Why Human Judgment Still Wins

AI Can't Read the Room: Myra Roldan on Why Human Judgment Still Wins

Everyone says they're behind on AI. According to Myra Roldan, Chief AI Officer of UnDesto AI, if everyone's behind, then no one really is — and that hype is costing organizations real money. In this episode, Vanessa sits down with Myra, a 15+-year AI veteran, framework builder, and contributor to Vanessa's upcoming book, for a refreshingly honest conversation about what AI can and can't do for the modern organization. Together they pull apart the most expensive misconceptions: that personal AI use translates to business readiness, that everyone is suddenly a programmer, and that a 90% "adoption" rate means anything when people are really just using AI to read meeting notes. The throughline is one Kirkpatrick Partners has championed for years — AI is a powerful accelerator, but human judgment, context, and ethics still decide whether the work is any good. Myra and Vanessa also explore why the Kirkpatrick Model can evaluate an entire AI implementation, not just a training program, and why a negative return early on is normal, not a reason to quit. In this episode: • Why "we're behind on AI" is usually a myth — and an expensive one • The difference between AI adoption and real, value-creating usage • How to measure AI's impact with the Kirkpatrick Model and Return on Expectations • Why your people — not the tools — are your real business intelligence Ready to evaluate AI with rigor? Join the Kirkpatrick AI-Powered Evaluation Specialist Certification at https://www.kirkpatrickpartners.com/event/kirkpatrick-ai-specialist-1/ [https://www.kirkpatrickpartners.com/event/kirkpatrick-ai-specialist-1/] Connect with Myra: https://www.linkedin.com/in/myraroldan/ [https://www.linkedin.com/in/myraroldan/] https://www.undesto.ai/ [https://www.undesto.ai/] Enterprise Performance Intelligence (EPI) Maturity Assessment Think your organization is measuring impact? Most aren't. The EPI Maturity Assessment helps you quickly identify where you stand—and what's needed to better connect learning to performance and results. 👉 Take the assessment [https://kirkpatrickmaturityassessment.scoreapp.com/] and get clarity on your next step. Building a Culture of Evaluation Order the book behind the Culture of Evaluation framework and updated Kirkpatrick Model. The book comes with a Companion Guide to help support you on the journey. 👉 Order the book now [https://www.amazon.com/Building-Culture-Evaluation-Kirkpatrick-Performance/dp/1963392337/] Kirkpatrick Learning and Performance Center of Excellence Certification builds capability. Accreditation builds systems. The Kirkpatrick Certified Organization accreditation recognizes organizations that have embedded the Kirkpatrick Four Levels® into how they actually operate — through governance, SOPs, feedback loops, and cross-functional accountability. If your evaluation capability would disappear when a key person leaves, this is the credential designed to fix that. Founding Organization status is now open — first year of annual maintenance waived for inaugural cohort members. 👉 Learn more and apply [https://www.kirkpatrickpartners.com/kirkpatrick-learning-and-performance-center-of-excellence/] Not ready to apply yet because you need to build the systems? Grab the SOPs. We're building a library of Kirkpatrick-standard SOPs — governance frameworks, evaluation procedures for all four levels, planning templates, and implementation guides — so you can build your infrastructure before you apply. 👉 Learn more [https://www.kirkpatrickpartners.com/kirkpatrick-learning-and-performance-center-of-excellence/] Kirkpatrick Collective If you're ready to move beyond activity and start driving real performance, the Kirkpatrick Collective brings together leaders focused on applying evaluation in the real world. Get practical tools, shared insight, and the structure to make better, evidence-based decisions. 👉 Join the Collective [https://www.kirkpatrickcollective.com/] and start building evaluation as a capability—not just an activity. Learn more about the Kirkpatrick Model [https://www.kirkpatrickpartners.com/the-kirkpatrick-model/] Watch the Show on YouTube! [https://youtu.be/tWrqcRuStdE] Submit your Questions/Stories: [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast. #KirkpatrickPodcast #LearningImpact #PerformanceImprovement #TrainingEvaluation #CultureOfEvaluation #KirkpatrickModel

Is it Really Survey Fatigue? Or Is It Survey-Action Fatigue. — Dr. Benjamin Granger

Ask executives whether they act on the feedback they get from employees, and 85 to 95% will say absolutely. Ask the frontline the same question, and the score drops by 30 to 50 points. That gap is the heart of this episode. Vanessa sits down with Dr. Benjamin Granger, Chief Workplace Psychologist at Qualtrics, a contributor to her book Building a Culture of Evaluation and author of A Leader Worth Following. Together they unpack one of the most persistent findings in Ben's research: most leaders aren't failing to act on feedback — they're failing to communicate the action they took. The connection between what people said and what changed never gets made explicit, so employees conclude nothing happened at all. That, Ben argues, is the real driver of survey fatigue. It isn't that surveys are too long (though many are). It's "survey-in-action fatigue" — people stop responding because they never see their input go anywhere. Close the loop, and engagement follows. Key takeaways: the action gap is usually a communication gap; people stop responding when they never see results; closing the loop builds the trust a culture of evaluation depends on; and even the work you can't publicize still needs to be communicated. Connect with Dr. Ben on LinkedIn: https://www.linkedin.com/in/benjamin-granger-7147991b/ Grab his book, A Leader Worth Following: https://a.co/d/0bHdxAUB [https://a.co/d/0bHdxAUB] Enterprise Performance Intelligence (EPI) Maturity Assessment Think your organization is measuring impact? Most aren't. The EPI Maturity Assessment helps you quickly identify where you stand—and what's needed to better connect learning to performance and results. 👉 Take the assessment [https://kirkpatrickmaturityassessment.scoreapp.com/] and get clarity on your next step. Building a Culture of Evaluation Order the book behind the Culture of Evaluation framework and updated Kirkpatrick Model. The book comes with a Companion Guide to help support you on the journey. 👉 Order the book now [https://www.amazon.com/Building-Culture-Evaluation-Kirkpatrick-Performance/dp/1963392337/] Kirkpatrick Learning and Performance Center of Excellence Certification builds capability. Accreditation builds systems. The Kirkpatrick Certified Organization accreditation recognizes organizations that have embedded the Kirkpatrick Four Levels® into how they actually operate — through governance, SOPs, feedback loops, and cross-functional accountability. If your evaluation capability would disappear when a key person leaves, this is the credential designed to fix that. Founding Organization status is now open — first year of annual maintenance waived for inaugural cohort members. 👉 Learn more and apply [https://www.kirkpatrickpartners.com/kirkpatrick-learning-and-performance-center-of-excellence/] Not ready to apply yet because you need to build the systems? Grab the SOPs. We're building a library of Kirkpatrick-standard SOPs — governance frameworks, evaluation procedures for all four levels, planning templates, and implementation guides — so you can build your infrastructure before you apply. 👉 Learn more [https://www.kirkpatrickpartners.com/kirkpatrick-learning-and-performance-center-of-excellence/] Kirkpatrick Collective If you're ready to move beyond activity and start driving real performance, the Kirkpatrick Collective brings together leaders focused on applying evaluation in the real world. Get practical tools, shared insight, and the structure to make better, evidence-based decisions. 👉 Join the Collective [https://www.kirkpatrickcollective.com/] and start building evaluation as a capability—not just an activity. Learn more about the Kirkpatrick Model [https://www.kirkpatrickpartners.com/the-kirkpatrick-model/] Watch the Show on YouTube! [https://youtu.be/JTDf2EnwOyw] Submit your Questions/Stories: [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast. #KirkpatrickPodcast #LearningImpact #PerformanceImprovement #TrainingEvaluation #CultureOfEvaluation #KirkpatrickModel

Scaling Evaluation: From Pockets of Excellence to Enterprise Capability

In this episode of The Kirkpatrick Podcast, Vanessa sits down with Ted Kniker — co-founder of IMPACT Paradigm Associates, former Chief of Evaluation at the U.S. Department of State, and contributing author to Raising America: Building a More Perfect Union — to tackle one of the most pressing questions in evaluation today: how do you actually scale it across an entire organization? Ted brings hard-won perspective from 24 years in federal government and consulting across hundreds of organizations. The conversation gets real fast, covering why scaling evaluation is not the same as multiplying activity, why strong evaluation on one team almost never transfers to the enterprise, and what it actually takes to move from isolated pockets of excellence to true organizational capability. Key takeaways: • Scaling evaluation means creating alignment on shared outcomes — not adding more dashboards and reports. • Program evaluation can succeed on talent; enterprise evaluation has to succeed through systems. • The biggest red flag: when your organization is "information rich but decision poor." • Leaders signal whether evaluation is a compliance exercise, a political weapon, or a genuine learning function — and that signal determines whether it scales. • Standardize at the outcome/results level, not the measurement level; that's where the Kirkpatrick Model shines at enterprise scale. Connect with Ted on LinkedIn. To learn how the Kirkpatrick Model can help your organization build a true culture of evaluation, visit kirkpatrickpartners.com. Enterprise Performance Intelligence (EPI) Maturity Assessment Think your organization is measuring impact? Most aren't. The EPI Maturity Assessment helps you quickly identify where you stand—and what's needed to better connect learning to performance and results. 👉 Take the assessment [https://kirkpatrickmaturityassessment.scoreapp.com/] and get clarity on your next step. Building a Culture of Evaluation Order the book behind the Culture of Evaluation framework and updated Kirkpatrick Model. The book comes with a Companion Guide to help support you on the journey. 👉 Order the book now [https://www.amazon.com/Building-Culture-Evaluation-Kirkpatrick-Performance/dp/1963392337/] Kirkpatrick Learning and Performance Center of Excellence Certification builds capability. Accreditation builds systems. The Kirkpatrick Certified Organization accreditation recognizes organizations that have embedded the Kirkpatrick Four Levels® into how they actually operate — through governance, SOPs, feedback loops, and cross-functional accountability. If your evaluation capability would disappear when a key person leaves, this is the credential designed to fix that. Founding Organization status is now open — first year of annual maintenance waived for inaugural cohort members. 👉 Learn more and apply [https://www.kirkpatrickpartners.com/kirkpatrick-learning-and-performance-center-of-excellence/] Not ready to apply yet because you need to build the systems? Grab the SOPs. We're building a library of Kirkpatrick-standard SOPs — governance frameworks, evaluation procedures for all four levels, planning templates, and implementation guides — so you can build your infrastructure before you apply. 👉 Learn more [https://www.kirkpatrickpartners.com/kirkpatrick-learning-and-performance-center-of-excellence/] Kirkpatrick Collective If you're ready to move beyond activity and start driving real performance, the Kirkpatrick Collective brings together leaders focused on applying evaluation in the real world. Get practical tools, shared insight, and the structure to make better, evidence-based decisions. 👉 Join the Collective [https://www.kirkpatrickcollective.com/] and start building evaluation as a capability—not just an activity. Learn more about the Kirkpatrick Model [https://www.kirkpatrickpartners.com/the-kirkpatrick-model/] Watch the Show on YouTube! [https://youtu.be/cnPbabSoHIk] Submit your Questions/Stories: [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast. #KirkpatrickPodcast #LearningImpact #PerformanceImprovement #TrainingEvaluation #CultureOfEvaluation #KirkpatrickModel

Is Your System Killing Your Evaluation Strategy?

In this episode of the Kirkpatrick Podcast, Vanessa Milara Alzate makes a bold claim: your evaluation efforts aren't failing because of your model, your data, or your people. They're failing because of your system. Vanessa reframes the perennial conversation around leadership alignment and evaluation by shifting the focus to system alignment — the processes, tools, incentives, reporting structures, and governance that either enable or block behavior change. Drawing on James Clear's Atomic Habits framework and her own experience building consistent workout and wellness habits, she illustrates how even the most committed people can't perform consistently inside inconsistent systems. Key takeaways from this episode: • Systems — not mindsets alone — determine whether evaluation sticks. If your system rewards activity over outcomes or tracks completion instead of performance, it's designed to fail. • Four common system failures: disconnected processes, misaligned measures, no feedback loops, and undefined ownership of behavior change. • Governance isn't bureaucracy. It's the clarity that answers who owns what, what gets measured, and how data drives decisions. • Kirkpatrick certification alone isn't enough. You also have to build the systems and processes that keep evaluation running — even when your certified person leaves. • A Center of Excellence builds the governance structure that transforms evaluation from an isolated activity into an organizational capability. Learning Impact Maturity Assessment Think your organization is measuring impact? Most aren't. The Learning Impact Maturity Assessment helps you quickly identify where you stand—and what's needed to better connect learning to performance and results. 👉 Take the assessment [https://kirkpatrickmaturityassessment.scoreapp.com/] and get clarity on your next step. Building a Culture of Evaluation Order the book behind the Culture of Evaluation framework and updated Kirkpatrick Model. The book comes with a Companion Guide to help support you on the journey. 👉 Order the book now [https://www.amazon.com/Building-Culture-Evaluation-Kirkpatrick-Performance/dp/1963392337/] Kirkpatrick Collective If you're ready to move beyond activity and start driving real performance, the Kirkpatrick Collective brings together leaders focused on applying evaluation in the real world. Get practical tools, shared insight, and the structure to make better, evidence-based decisions. 👉 Join the Collective [https://www.kirkpatrickcollective.com/] and start building evaluation as a capability—not just an activity. Learn more about the Kirkpatrick Model [https://www.kirkpatrickpartners.com/the-kirkpatrick-model/] Watch the Show on YouTube! [https://youtu.be/nQ6mLTZZkC4] Submit your Questions/Stories: [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast. #KirkpatrickPodcast #LearningImpact #PerformanceImprovement #TrainingEvaluation #CultureOfEvaluation #KirkpatrickModel

From Content Creation to Performance Architecture: The New Mandate for L&D

AI is forcing a difficult but necessary question for learning and development leaders: if knowledge is now instant, searchable, and increasingly automated, where does L&D create value? For years, many organizations built learning systems around access to information, course completion, and content delivery. That model made sense when knowledge was harder to distribute and change moved more slowly. But work has changed. AI can now draft messages, build presentations, generate training content, summarize data, and recommend next steps. The differentiator is no longer whether employees can find an answer. The differentiator is whether they can judge the answer, apply it in context, identify risk, and make better decisions. This episode explores why the future of L&D depends on shifting from training tasks to enabling performance. The opportunity is not to create more content faster. The opportunity is to clarify what good performance looks like, define observable behaviors, connect those behaviors to business results, and help leaders make better decisions with better evidence. Takeaways 1. Stop treating knowledge transfer as the finish line. The real business question is whether people can think, decide, and perform in real situations. 2. Design for judgment, not just task execution. AI can support the work, but people still need to validate outputs, identify inaccuracies, and manage risk. 3. Measure what matters to the business. Completion rates and attendance do not answer questions about productivity, efficiency, behavior change, or results. 4. Use evaluation as an alignment system. Evaluation should connect learning, performance, leadership expectations, and organizational outcomes. 5. Develop L&D capability for the future of work. The skills that matter now include consulting, decision support, performance analysis, executive presence, and measurement strategy. 6. Move from content creator to performance architect. L&D teams that clarify what matters and connect behavior to results will lead the next era of organizational performance. Listen now and subscribe to The Kirkpatrick Podcast for practical insight on evaluation, performance, and business impact. Kirkpatrick Collective If you're ready to move beyond activity and start driving real performance, the Kirkpatrick Collective brings together leaders focused on applying evaluation in the real world. Get practical tools, shared insight, and the structure to make better, evidence-based decisions. 👉 Join the Collective [https://www.kirkpatrickcollective.com/] and start building evaluation as a capability—not just an activity. Learning Impact Maturity Assessment Think your organization is measuring impact? Most aren't. The Learning Impact Maturity Assessment helps you quickly identify where you stand—and what's needed to better connect learning to performance and results. 👉 Take the assessment [https://kirkpatrickmaturityassessment.scoreapp.com/] and get clarity on your next step. Learn more about the Kirkpatrick Model [https://www.kirkpatrickpartners.com/the-kirkpatrick-model/] Watch the Show on YouTube! [https://youtu.be/pV-r2weRHvY] Submit your Questions/Stories: [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] Do you have a question you would like us to answer on the Kirkpatrick Podcast? Have a story about how the Kirkpatrick Podcast or other Kirkpatrick events/programs have positively impacted your career? We would love to hear from you! Follow this link [https://forms.clickup.com/9011060482/f/8chkqr2-11311/2729WK2WKFBVYO5CZG] to submit your questions and/or stories, and we may just share them on the next episode of the Kirkpatrick Podcast. #KirkpatrickPodcast #LearningImpact #PerformanceImprovement #TrainingEvaluation #CultureOfEvaluation #KirkpatrickModel