Advertisement

307 Designing and Assessing Learning in VR Using an Evidence-Centered Approach

3:00 PM - 4:00 PM Wednesday, October 20

Virtual reality (VR) development is quite an investment, so it's important for learning designers to be confident that their VR solutions are able to produce the highest ROI. The challenge that many face is that the affordances of VR can be both a blessing and a curse when designing experiences. The perception of unlimited possibilities can often pose challenges for learning designers: They may not know where to start or they may have so many ideas that they struggle to sift out all but the most viable ones. What if there were a method of designing VR experiences that ensures you're fulfilling the intended learning goals and behavior changes you wish to see? One that can also produce data that measures learning and drives evidence-based insights about user's competency levels?

This session will help you design and measure learning within your VR solutions and help you embed assessments directly within the experience using an Evidence-Centered Design for Assessment (ECD). In the ECD framework, evidence of learning is directly tied to and measured by a user's actions within the VR space, providing empirical data that you and your company can use to make inferences about their competency levels. You'll discover how you can leverage the three main models of the ECD framework to ensure that your VR designs are strategic and measurable. You'll start by examining how developing a competency model enables you to make claims about a learner using evidence collected within your VR solution. You'll see firsthand how it shifts unobservable facets to observable indicators and provides a tangible way to identify the key behavioral evidence of a learner's proficiency. Next, you'll look at what qualifies as 'evidence' within the Evidence Model, and mechanisms for how it can be measured within your VR training. You'll draw insights from use cases and the tactics they've used to measure evidence. Then, you'll uncover how to use this model to inform the design of immersive VR experiences such as scenarios, tasks, or activities within the task model to elicit evidence of learning. You'll come away from this session knowing how to design evidence-based VR experiences that have a lasting, positive impact on the success of both the learners and your company.

In this session, you will learn:

  • How to use Evidence-Centered Design for Assessment as both a design framework and a diagnostic measurement tool for VR solutions
  • The intricacies of the competency model, evidence model, and task model, and how their interconnections fuel both design and evaluation
  • How to use and develop a competency model to narrow the focus of your VR training on the most critical knowledge or skills pertaining to your learning objectives
  • How empirical data collected within the task model can be measured by the evidence model to reveal insights about learner's proficiency levels
  • How you can adapt the ECD framework to fit your VR training needs

Session Trailer:

https://youtu.be/Vglvr4T1apQ

Kristin Torrence

Head of Learning Engineering

Talespin

Kristin Torrence serves as the head of learning engineering at Talespin, where she focuses on applying learning sciences, instructional design, and data science practices to design, instrument, and validate XR learning solutions. Her background is in cognitive science, game-based learning, and instructional design and she is particularly interested in the intersection of learning science, XR, and learning analytics. She co-founded XR in LXD, a meetup, and community of practice for IDs/LXDs interested in designing XR, and she is an active member of the Immersive Learning Research Network (iLRN), XR Women, and the IEEE Industry Consortium on Learning Engineering (ICICLE).

<  Back to session list Top ^