SMM204 A Proven Checklist Tool for Objective Program Evaluation
1:00 PM - 1:45 PM Wednesday, March 28
Expo Hall: Management & Measurement Stage
Consistent program evaluation can be a challenge. Organizations must invest time and manpower wisely in order to generate feedback that will improve training outcomes and produce a positive ROI. Asking a department to judge its own work compromises objectivity, whereas hiring outside consultants generates tension. So what’s a better option? A substantive rubric aligned with a standards-based evaluative tool. This approach can help you achieve results that a mere survey, or departmental self-evaluation, cannot.
In this session, you will learn how to implement a product evaluation checklist to help you more effectively evaluate and critique your own learning programs. You’ll discover how evidence-based best practices are reflected in this evaluation tool’s 12 broad criteria, and how you can best use them to generate an objective score that is readily comparable between departments, units, and businesses as well as across training types. Once you’ve mastered the tool, you’ll then brainstorm ways to leverage evaluation scores within your own businesses to help meet training goals, drive better outcomes, and further department and asset development.
In this session, you will learn:
- About the advantages of employing a proven rubric to evaluate a program’s alignment with learning science
- About the meaning and importance of this rubric’s 12 essential categories
- How to conduct a program review
- How to conduct a post-review session with stakeholders that will minimize friction and facilitate next steps and improvements
- How to leverage the checklist’s findings to drive an organization to positive change
Audience:
Novice to advanced designers, developers, managers, directors, and senior leaders (VP, CLO, executive, etc.).
Technology discussed in this session:
Kaplan’s Educational Product Evaluation Checklist.
Kristin Murner
Learning Design Lead
CreatorUp
Kristin Murner, the learning design lead at CreatorUp, has worked in traditional, online, and for-profit education for over 20 years. Her favorite projects have been teaching undergraduate marketing on an Army base, working with NYC public school teachers on SHSAT prep-course improvement, and quickly creating and co-hosting free educator-facing webinars to help teachers and faculty pivot to online learning during the COVID-19 shutdown. At CreatorUp, Kristin works cross-functionally to ensure all learning content is measurable, sticky, and awesome. She holds a BS in physics, an MBA in marketing, and an MSEd in instructional design and technology.
Bob Verini
Director, Academic Quality
Kaplan Test Prep
Bob Verini is a director of academic quality in Kaplan Test Prep’s learning science department, with 35 years of experience in creating and delivering instruction in on-site and online classroom environments. For the last decade he has been teaching online courses exclusively, and he created the company’s first training program to help veteran teachers understand and absorb the best practices of the new medium. An accomplished journalist for Daily Variety and other publications, Bob is often recognized for his appearances on Jeopardy! as the winner of 1987’s Tournament of Champions and a veteran of numerous invitational tournaments.