‘Geek-Free’ xAPI Captures Rich Data in Any ID Model

It’s here: xAPI is the emerging learning data and analyticsspecification that will replace—and completely supersede—SCORM in coming years.Also called Experience API, xAPI is an open, industry-wide specification forsending, storing, and retrieving activity about learning and performanceexperiences. It offers instructional designers (IDs) the ability to captureand use far more data about the learning experience than they ever could before.Even better: xAPI captures rich data in any ID model.

Until recently, an xAPI implementation required customprogramming and integration, putting even proof-of-concept projects out ofreach for many IDs. With the advent of “geek-free”tools offering xAPI out of the box, xAPIis ready for mass adoption.

This offers IDs a huge leap from the limited data set that theytypically work with in a SCORM-based eLearning environment. SCORM tracks thesame set of somewhat useful data for every piece of eLearning in the LMS:status, score, time, a bookmark, questions, and dates. SCORM is predictable. IDscan count on rapid authoring tools to send this data, and LMSs can report onit. The interoperability that the SCORM specification enabled has led to theincredible growth—and fragmentation—of the eLearning industry.

It’s also incredibly bland. With SCORM, the L&D team canrun the same report on eLearning offered for sales training, for compliance, forsafety, for soft skills, and so on. If all that matters is completion ofassigned courses, this makes sense. When the focus shifts to actual learning, though,IDs need more and better data. That’s where xAPI comes in. With xAPI, IDs can:

• Gatherdata from more than just eLearning
• Learnmore about the learning experience
• Learnmore about learners’ performance
• Correlatelearning with performance
• Offermore targeted training
• Supportperformance in better ways
• Use datato learn with others
• Compareperformance and learning across learners
• Deliverand track training outside of the LMS

Note: The actions in this list have been achievable for adecade using basic web technologies; xAPI is not revolutionary in itstechnology so much as in the interoperability that occurs when the same sharedspecification is used for reporting and tracking data.

If I can send any data,what data should I send?

Leaving data strategy and analytics aside, the answer tothis question can be deceptively simple. IDs are familiar with instructionaldesign models and approaches that provide insights into the data that’stantalizingly out of reach with SCORM. Let’s look at three common ID models andwhat xAPI makes possible.

70-20-10 and xAPI

The 70-20-10model suggests that 70 percent of our knowledge comes from experience; 20percent comes from interactions with others, such as peers, mentors, andmanagers; and a paltry 10 percent comes from formal learning.

With traditional SCORM-based LMSs, IDs can track only theportion of that 10 percent that happens in eLearning—leaving a reported 95percent of learning and performing experience un-measured.

With xAPI, though, the instructional designer can track:

Within the 10 percent from formal learning: xAPI makes available moredetail about what goes on during the learning experience. It also can bring indata from non-eLearning tools, including performance support tools.

Within the 20 percent from interactions with others: xAPI cancapture social tool interaction, reports of coaching conversations, data fromobservation checklists and rubrics—and much more.

Within the 70 percent from experience: xAPI collects data fromsystems of work where employee performance is recorded (manufacturing systems,sales systems, customer relationship management, enterprise resource planning,logistics systems, service desk software, etc.).

Kirkpatrick Levels of Evaluation and xAPI

The KirkpatrickLevels of Evaluation offer another example of what kinds of data L&Dteams could be tracking with xAPI:

Level 1—Satisfaction: Most LMSs offer a basic level 1 evaluation onformal learning. With xAPI, this type of data can be collected on a variety oflearning experiences, including social, informal, and performance supportsystems.

Level 2—Knowledge: SCORM 2004 does a decent job of tracking testresults. With xAPI, it’s possible to track other types of hands-on or practicalassessments and scored observations.

Level 3—Application: LMSs that track Level 3 typically rely onsurveys of individuals or their supervisors. With xAPI, it’s possible to pulldata directly from systems of work where employee performance is recorded.

Level 4—Results: It is beyond the capability of nearly all LMSs totrack actual organizational results, so reporting at this level—if done at all—isexternal to the learning environment. xAPI enables us to bring outside datainto the learning ecosystem to analyze Level 4.

Moments of Learning Need and xAPI

Expanding from the formal training world to informal learningand performance support, xAPI can provide meaningful data from all five ofConrad Gottfredson and Bob Mosher’s FiveMoments of Learning Need (as well as additions, bringing the total to NineMoments of Learning Need):  

Before learners know they need to know something, IDs can use xAPIto gather data about work performance and use that information to pinpointlearning needs.

 When learners are preparing to enter the trainingenvironment, measuring the experience of a variety of preparatory exercises—suchas scavenger hunts, pre-reading, discussion groups, and self-diagnostic tools—allowsfor a more personalized and targeted learning experience once formal learningbegins.

 When learners are learningsomething new or learning more, expanding the breadth and depthof what they have already learned, xAPI offers far more insight into what goeson in the formal eLearning experience than SCORM ever could.

1. Before learners know they need to know something, IDs can use xAPIto gather data about work performance and use that information to pinpointlearning needs.

2. When learners are preparing to enter the trainingenvironment, measuring the experience of a variety of preparatory exercises—suchas scavenger hunts, pre-reading, discussion groups, and self-diagnostic tools—allowsfor a more personalized and targeted learning experience once formal learningbegins.

3 and 4. When learners are learningsomething new or learning more, expanding the breadth and depthof what they have already learned, xAPI offers far more insight into what goeson in the formal eLearning experience than SCORM ever could.

5. When learners remember and review what they’ve learned, boosters, post-course drills,and other practice exercises can be tracked using xAPI; the data can be used topredict who might need additional support on the job.

6. When learners apply their new skills and knowledge onthe job, they might need support in the moment. With xAPI, IDs can connectexperience and usage statistics from performance support tools to the formallearning tools, drawing a more complete picture of who is learning and usingwhat, and to what effect, on the job.

7. When problems arise or thingsbreak and the learner must solve aproblem, xAPI can offer insights into who is using troubleshooting tools, whatsearch terms they are using, what resources learners are sharing in discussiongroups, and how the peer community is accepting these resources.

8. When something changes and an employee needs to learna new way of doing something—which often takes place in a more formal learningenvironment—xAPI makes it possible to bring in data from the individual’s workexperience. This results in more carefully targeted training.

9. Learners may need to teach what they know and help othersapply it. Expert communities and mentoring supports can leverage xAPI data tobetter understand the learning experience among these experienced learners.

 

This is only a beginning; xAPI can apply to—and enhance—justabout any instructional design model or approach. All instructional design modelsoffer insight into what data about the learning and performance experience wecan and should track.

What to do with all this data

Once the L&D team has figured out what data to record toinform the learning experience, the options for actually capturing and sendingthat data fall into four basic categories:

1. Use an eLearning authoring tool. Theleading eLearningauthoring platforms offer varying degrees of support for xAPI. At theminimum, they send the same data that a SCORM system would send, formatted asxAPI statements. They might include additional basic information, such asscreens viewed and questions attempted. These tools can send additional datavia embedded JavaScript. Tools with more robust xAPI support will capture andsend xAPI data on just about any action the learner completes in a course,interacting with on-screen elements, playing videos, downloading files, etc.,without needing programming.
2. Send data from another tool. A small—butgrowing—number of software tools offer xAPI integrations that do the heavylifting of coding. These tools offer survey authoring, observation checklists,flash cards, social learning, learning pathway creation, and more, allcapturing detailed data on the learners’ activities. When investigating newlearning technology, ask whether there is an existing or in-development xAPIintegration.
3. Write custom code. If this is an opportunityto learn to code, take it! Otherwise, work with a software developer to writesome custom code to do what’s needed. Using xAPI is not at all difficult forexperienced developers.
4. Export and convert data. Particularlywhen working with an organization’s work systems, IDs may find that the data theyneed is not set up for xAPI. It might be feasible to extract data inspreadsheet or .csv format and convert it to xAPI statements, which would allowfor reporting on learning and performance data in one place.

Of course, sending the data is only half the story.Organizations will need to make decisions about the learning ecosystem in orderto receive, store and analyzeall this data—and in many cases, this is a much larger conversation, as itinvolves multiple departments and considerations, and generally moreinvestment, to accomplish. An upcoming article on xAPI ecosystems will includeseveral options.

In the meantime, The eLearning Guild offers a number of opportunities tolearn more about how xAPI captures rich data, meet xAPI experts, and talk with vendorsabout their xAPI-ready platforms and tools. DevLearn2018 Conference & Expo will kick off with the xAPICamp pre-conference workshop; it will also include an xAPI Central Showcasein the expo with stage programming that will feature vendor demos and real-lifecase studies.