07 - How do we measure the impact of training? Kirkpatrick's Level 4 Evaluation

07 - How do we measure the impact of training? Kirkpatrick's Level 4 Evaluation

In this episode of Key Connections for Educators, the focus is on the final level of Kirkpatrick's four levels of evaluation: results. The discussion emphasizes the importance of tying training to meaningful outcomes, such as increased sales, better productivity, or improved student performance. Hannah shares insights from her experiences in both corporate training and public education, highlighting how to measure outcomes against stakeholders' expectations, establish quality assurance benchmarks, and ensure that educational initiatives align with strategic goals. Essential strategies for measuring progress, the role of partnerships in achieving success, and tips on effective curriculum design are also covered. 00:00 Introduction to Kirkpatrick's Levels of Evaluation 00:26 Connecting Training to Results 01:16 Measuring Expectations and ROI vs ROE 02:37 Building Quality Assurance Benchmarks 04:34 Aligning Training with Strategic Initiatives 05:40 Importance of Clear Objectives and Prioritization 10:51 Partnerships in Education and Training 14:47 Implementing Level 4 Results in Training 17:46 Gathering and Communicating Results 22:51 Conclusion and Call to Action

06 - How do you measure the application of learning? Tackling Kirkpatrick's Level 3

In this episode of Key Connections for Educators, Nate and Hannah dive into the complexities of measuring behavior change as part of Kirkpatrick's four levels of training evaluation. They discuss the challenges of obtaining feedback on trainees' application of learned skills in the workplace, exploring timing issues, real-world barriers, and inherent biases. The conversation is enriched with practical strategies like scheduling follow-up calls, utilizing rubrics, and fostering group dialogues for a comprehensive assessment. The episode encourages educators to share their methods for reducing bias in behavior evaluations and provides actionable insights for both corporate trainers and K-12 educators. 00:00 Introduction to Measuring Educational Impact 00:16 Review of Kirkpatrick's Four Levels 01:29 Three Challenges in Measuring Behavior Change 04:01 Increasing the Volume of Level Threes 08:08 Group Discussions and Peer Influence 09:54 Classroom vs Real World 12:27 Addressing Bias in Evaluations 18:17 Capstone Events and Real-World Applications 21:39 Conclusion and Audience Engagement

05 - This test is making me more confident! Kirkpatrick's level 2 evaluations

n this episode of Key Connections for Educators, we delve into the second level of the Kirkpatrick Evaluation Model. We discuss how confidence in one's abilities can serve as a marker for learning and why it might be more appropriate in a level two evaluation rather than level one. The hosts share personal experiences and practical examples of implementing evaluation methods that build student confidence while accurately measuring learning outcomes. The episode also covers the significance of pre-testing and differentiating content to avoid redundancy in training programs. Join the conversation and share your thoughts on utilizing confidence-based questions to assess your students' progress. 00:00 Introduction and Recap 00:19 Exploring Confidence in Evaluations 01:32 Diving into Level Two Evaluations 03:53 Pre-Testing and Efficient Training 07:14 Effective Testing Strategies 16:06 Real-World Application and Conclusion

04 - Feedback is a gift for educations: Kirkpatrick's level 1 evaluation

In this episode of Key Connections for Educators, Nate and Hannah delve into the pivotal question of how to communicate the value of education and training to stakeholders. They explore the importance of engaging with and understanding the needs of these stakeholders to demonstrate that training programs provide a significant return on investment. The discussion introduces Kirkpatrick's model of evaluation, focusing on the first level: reaction. The hosts emphasize the critical role of reaction feedback in measuring training effectiveness and the potential dangers of misinterpreting this data. They share personal anecdotes and practical advice on leveraging qualitative and quantitative feedback to improve educational and training programs. 00:00 Welcome and Introduction 00:14 Communicating the Value of Education 01:17 Understanding Stakeholder Needs 02:03 Effective Training and Measurement 02:19 The Role of Quality in Training 03:43 Coaching and Training Analogies 05:05 Evaluating Training Effectiveness 05:31 Kirkpatrick's Model: Level One 06:49 Gathering and Using Feedback 14:08 Summary and Final Thoughts

03 - Communicating our value as educators

In this episode, Hannah and Nate delve into the transformative role of educators in fostering intrinsic motivation and growth mindset in students. They discuss the importance of student-led, engaging education that encourages perseverance and critical thinking, breaking free from outdated models. The conversation extends to the rapid changes in the corporate and educational landscapes, highlighting the need for continual learning and proficient change management. Key points include strategies for trainers and leaders to manage resistance to change by aligning goals and promoting growth. Notable references include Liz Wiseman's 'Multipliers' and John Dewey's educational philosophy. 00:00 Introduction and Episode Overview 00:11 The Role of Educators in Inspiring Intrinsic Motivation 01:33 Engaging Students Through Ownership of Learning 02:00 Real-Life Classroom Experiences 04:56 The Industrial Revolution's Impact on Education 06:23 The Shift Towards Growth Mindset 07:23 The Future of Education and Critical Thinking 08:22 Embracing the Growth Mindset 08:56 Perseverance and Grit in Education 09:38 The Role of Education in Social Progress 10:17 Navigating Constant Change 12:03 Understanding Resistance to Change 13:29 Communicating the Value of Education 15:08 Call to Action for Educators