SXAPI102 Identifying Competency Gaps with xAPI Analytics and Dashboards
11:00 AM - 11:45 AM Wednesday, October 24
Expo Hall: xAPI Central Showcase Stage
A high-consequence pipeline operator in the US delivers a large number of safety and operations–focused training using test scores to document compliance and understanding. With pure SCORM content, their insight into the performance of users at an objective level was limited. Even though students passed the test on a topic, some objectives were failed regularly, identifying issues in content, test design, and training processes.
In this session you’ll learn how, after enabling content and tests with xAPI, the group was able to identify competency gaps and export xAPI data into Microsoft’s Power BI software, allowing them to create analytic dashboards to track which objectives were and were not mastered. Finally, you’ll learn how they overhauled the safety training program to minimize the importance of overall test scores and require learners to master each identified objective. Failure to master an objective results in a review of the content until the learner satisfies all objectives. With this additional insight, senior leadership stated, “The ability to see these analytics puts L&D in a whole new light.”
In this session, you will learn:
- How the group used xAPI to track student interactions and assessments at an objective level
- How they created a series of visualizations and leadership dashboards to identify which students mastered or failed different objectives
- How they tracked SCORM CMI interactions using a SCORM-xAPI wrapper
- How LRS data, along with student demographic data from the LMS, was automatically ported to Power BI using Microsoft Flow
Advanced designers, managers, and senior leaders (directors, VP, CLO, executive, etc.).
Technology discussed in this session:
Microsoft’s Power BI will be discussed as one of many valuable business intelligence tools for analyzing xAPI data. Business intelligence tools can also be used to combine and compare xAPI data with other data sources for robust visualizations.
Art Werkenthin, president of RISC, built his first learning management system (LMS) in 1988 and now has over 25 years' experience working with LMS in the oil and gas, retail, finance, and other industries. Art is keenly interested in the xAPI specification, and RISC was an early adopter of this technology. Interested in expanding the xAPI to the LMS, Art has served for the past three years on the ADL cmi5 committee. In 2015, RISC demonstrated the first implementation of a cmi5 runtime engine embedded in its LMS. Art has presented on cmi5 at several conferences, including mLearnCon, DevLearn, and xAPI Camp.