From Myths to Principles Part 4 Myth: Learners learn faster

 

From Myths to Principles: Navigating Instructional Design in Immersive Environments
Part 4 Myth: Learners learn faster

Credit: Burst and Canva


Dispelling Myths


With some background established on boom and bust cycles in the hype for immersive experiences (Parts 1, 2, and 3), we need to dismiss the rather rampant myths about learning within immersive experiences. In the hype, learning advantages have been overstated and over simplified. Web pages post outrageous claims (and I’ll show you!). Keynote presentations banty incredible promises (yup, it was recorded). This series addresses the four primary myths about learning within immersive experiences: that is, that it is faster, greater, active, and induces empathy.

In this Part 4, I’ll address the “learners learn faster in immersive experiences” myth. For those of you that follow my writing, you’ll know that this is Round 3 of me taking on this myth. My argument has not changed; remember this article series is an update, but not every point needs updating. However, I continue to communicate about this because the “VR learning is faster” myth continues to circulate– mostly in the reference to “4 times faster” and the PwC report. So, TLDR, the VR experience was designed to be 29 minutes long. That’s it. No longer. The classroom equivalent in content experience was designed to be 2 hours long. That’s it. 29 minutes is ¼ of 120 minutes. Someone inverted ¼ to 4x (which is factually true) and PwC who appears to have had a cozy contract with Oculus/Meta at the time, went out to trumpet the ‘four times’ from the rooftops. But students do NOT learn faster. They experienced a learning event that was designed to be faster. Had the learners spent 120 minutes in the headset, someone would have probably greedily snatched the headset off their heads and told them that they overstayed their welcome (and wondered what they were doing for the extra 91 minutes).


Myth: Learners learn faster in immersive experiences


The first myth asserts that learners learn faster with immersive experiences. Particularly, the phrase “four times faster” has taken root in the publications and in public discourse. A google search on the phrase “VR is 4 times faster” returns a plethora of results repeating the myth.

4x in the wild. And it’s not hard to catch, yo.

The source of this phrase is suggested to be one non-peer reviewed industry report by PricewaterhouseCoopers. Within the report, VR-based learning was “4x faster than classroom training on average” (Eckert & Mower, 2020, p. 8). The results of this report were then repeated in academic literature.

Pie graph showing classroom training took 2 hours, e-learning training took 45 minutes, and VR training took 29 minutes. Text: We were able to train employees up to four times faster in VR than in the classroom and 1.5 times faster than e-learn.
Do not make pie graphs that do not add up to one whole thing.


Referring to the same report, D. Clark (an educational researcher not known for getting data wrong, but he did) wrote enthusiastically that “VR was x4 faster than classroom and x1.5 faster than e-learning” (2021, p. 190). Claims that learning is completed faster attempt to represent immersive experiences as a more efficient learning method, i.e., less time to learn equals learning faster.

Tracking down how many academic papers have cited the PwC report is difficult. I’ve seen numbers as little as 4 citations and much higher numbers if I start flexing my search. Part of the problem is that folks have not cited the report (even though it calls itself a study) correctly. Some credit PwC, a few find the Eckert and Mower authors, but in general the hand wave approach to referring to the 4x data is very prevalent.


The cause of this supposed faster learning was attributed to how a VR headset isolates the learner’s perception, so that the learner is focused on the learning task at hand. In other words, less distraction equals more focus. In the PricewaterhouseCoopers report, Likens seemed to hypothesize that, “A lot of courses that normally take an hour could be completed in 20 minutes through VR because people are so immersed in scenarios, there are fewer distractions and the learning is very concentrated” (Zielinski, 2021, para. 10).

To be clear, in the PwC case, classroom learning which covered the same content was designed to take two hours to complete. The immersive experience was designed to take 29 minutes. Given that 29 minutes is approximately one-quarter of two hours, PwC inverted the time ratio and touted the line that the immersive learning was four times faster. The problem is that it is not true that learning in the immersive experience was faster. The VR-based learning took less time because it was designed to be a 29-minute one-on-one learning experience designed for a shorter total time duration. When compared to classroom learning, it is already known that one-on-one personalized learning is generally faster; it moves at the speed of the learner, not at the speed of the class. Perhaps, this is how myths begin. A kernel of truth gets extended to something with no context. Lack of context is a noted and rising problem in educational research (Williamson, 2024).

Learning faster can be confused with greater efficiency. Efficiency could have a wide range of meanings beyond just taking less time. It could also mean wiser use of resources or less teaching burden on the instructor. Another example of the loose wordplay is on an industry webpage that displayed that VR training was 50% faster than a traditional in-person medical simulation. Not stated in the distilled summary of that study is that learners scored worse in the VR training than the traditional in-person medical simulation (Katz et al., 2020).


If faster equals worse performance, this might not be the efficiency that educators are looking for.

The myth that learning happens faster continues when educators fail to acknowledge that a different instructional method was being used. When supporting using virtual reality for chemistry studies, Muhsinah Morris, a chemistry professor and metaverse program director at Morehouse said “You can’t see molecules, but in my virtual reality classroom where I taught advanced inorganic chemistry, you can. You can actually build three-dimensional representations of molecules … The learning tends to happen faster. They go on to the real situation faster.” (D’Agostino, 2022, para. 5).

Side point: Learning Chemistry in Three Dimensions


Since this is my publishing space, I am going to spend some time on Mushinah Morris’ instructional and learning point here. Again, I was involved in the online teaching of chemistry for 14 years and my research speciality was science in VR, so I’ve got thoughts. If you would like to see her talk on video on this, she’s here in this video published by VictoryXR.

She is correct that molecules cannot currently be seen in everyday life. It makes chemistry, as a field, a more abstract or conceptual field along with physics when compared to the “you can see it before you” fields of biology or earth science. Teaching that something unseen exists and engages in reactions has always been the uphill battle of chemistry teachers. So she’s describing an accurate problem.

There is a tiny fly in the ointment, however, in that not many students at the college level fall into a chemistry course completely unfamiliar with chemistry at all. So learners in college chemistry probably were exposed to atoms in some other prior learning experience, be it high school, a museum, or a summer-camp like situation. So do her students need to learn atoms from the very beginning? I somewhat doubt that. 


HCHE Advanced Inorganic Chemistry


To massively further complicate her argument, she names and shows her chemistry course “Advanced Inorganic Chemistry”. That’s HCHE 421 at Morehouse University, which in 2021 had a prerequisite:

HCHE 322 Elementary Physical Chemistry, which itself has 3 prerequisites:

CHE 321/321L, Elementary Physical Chemistry and Lab (which has 4 prereqs: CHE 232, PHY 154, and MTH 161 and 162)

PHY 253 Electricity & Magnetism, which has 2 prerequisites: PHY 154 (C or better) and MTH 162

MTH 271 Introduction to Linear Algebra, which has 1 prerequisite: MTH 161

You see where I’m going here. It’s highly doubtful that students arriving in an advanced chemistry class after what is years at college, whose content focus is actually math (that’s what inorganic focuses on) and not spatial abilities (which arguably organic chemistry DOES focus on) have a substantial problem with visualizing atoms and molecules to the point where it is disturbing their learning performance. And therefore VR could make a difference. No. Not buying it. 

Covered in the mentioned course’s lab. That’s math, yo.

Nonetheless, I’ve known very smart and exposed people have trouble visualizing atoms. So it IS remotely possible and let’s pretend she is articulating only the beginning of the trouble of understanding for a lay crowd…not the only problem. Said another way, she’s speaking about VR’s affordances overall, maybe not specifically for her students in her aforementioned class. For example, some chemical reactions are easy to understand (like cooking) and some are difficult to understand (like how hair coloring works or cell electrical potentials).

It is interesting that she said “The learning tends to happen faster.” It’s a couched statement, for sure, with the word “tends”. In science that cannot be pinned down. So she gave herself an out. But what was she describing? At this point, we have to think about the instruction of chemistry.

How To Show Atoms and Molecules

Within the history of chemistry itself is the continuing saga of how will atoms be depicted? As in, how do you draw them? How are they really? And how does a teacher relay that ‘realness’ to the learners– and why? 


So we’ve had our:


Atoms are indivisible tiny units, folks. Thank you to the Greeks! There are no pictures from that time.


We’ve had Bohr’s heliocentric-like model folks wherein the atom looks like a solar system or set of concentric rings. To be fair, the heliocentric model really does help explain things like electron energy levels.

We’ve had our Thomson plum pudding folks– which never translated from its culture. Which is probably a shame. I like plums.


We’ve had our ‘cloud model’ folks – which are like the postmodern philosophers of chemistry. Truth for me, truth for you, we all get a truth, which isn’t true. But they told us that electrons cannot be pinned down and measured, they could be anywhere at any time but when we set about measuring them, that’s when they run away from us. Yes, I’m nodding to Heisenberg here. And wave/particle theory.

Cloud model of what an atom looks like.


After the heliocentric model, however, depictions of atoms needed to be displayed as three-dimensional, not just as two-dimensional on flat paper. By far, I’ve only selected some of the atomic model theories here. If you want to know more, study chemistry! It’s not hard.

But, now, going against Mushinah Morris’ arguments now, educators HAVE been working on that educational problem for years (with success, mind you).


First of all, delightful molecular (and atom) kits exist with physical manipulatives. Yeah, they look like tinker toys. I love them. They are good for at least 30 minutes of instruction, maybe more. They are usually plastic (boo, although there is nothing stopping them from being made of wood) and the kits would have to be purchased, stored, and de-germed from time to time. So they have their minor downsides.


Second of all, 2D screens can show 3D objects…that’s entirely possible.


Third, programming VR to follow mathematical principles – like, voila, chemistry DOES!– is actually not that hard. The first uses of VR in education that I know of were in the “physical”—that is mathematical sciences, physics and chemistry. Let’s face it. A computer understands 9.8 meters per second per second MUCH easier than a person does. (<- that’s one gravitational force).

And get this, purchasing a simulation to teach atoms is so drop-dead cheap that it’s actually free by now. I have recommended those simulations for courses before and seen learning scores do quite well, thank you. 

Looks pretty 3D to me



I seriously bet that if I had been able to place that counter proposal before her administrators, I’d win the budget proposal. Ha! Bonus points that I could prove that my students would score equally to her VR students on the final exam.

So in all, did she make a good point here? I’d say no but that’s because I recognize the instructional problem and I realize that the problem can be solved in a much cheaper and equally as efficient way. Also, she showed no data that “the learners learned faster”.

Side point to the side point: Mushinah Morris on YouTube is highly associated with VictoryXR, the vendor that she is using when referring to her VR-for-education accomplishments. Close association with XR vendors makes for suspicious conclusions. I’m not picking on Mushinah Morris unfairly. She’s gone on the record multiple times for her claims. I could easily pick (and will in the future) other education influencers that are selling the VR-for-education snake oil.

Back to my article

Further, there is at least one study (so far!) that refutes this focusing-causes-faster-learning claim. Makransky, Terkildsen, et al. (2019) found that immersive metaverse environments could be sensory overload for learners and therefore decrease the learner’s focus. On the whole, claims for increased speed can often be attributed to more efficient instructional methods. Immersive experiences can allow for the utilization of comparatively faster instructional methods.

The author finds this myth, that immersive experiences cause learners to learn faster, false. 

From Myths to Principles Part 3 The Case Against Virtual Campuses

 

From Myths to Principles: Navigating Instructional Design in Immersive Environments
Part 3 The Case Against Virtual Campuses

Virtual Campuses: 2010 and 2023. Not much has changed; they still don’t work.


I write this title with a tinge of irony. I’ve owned virtual campuses. I’ve worked on virtual campuses. If asked to work on a virtual campus again, I’d likely say yes.  So what’s my beef with virtual campuses?

I feel that a sober-eyed look at virtual campuses* is necessary.

Following the philosophy of ““those who cannot remember the past are condemned to repeat it” (Santayana), here is Part 3 of my series: From Myths to Principles; Navigating Instructional Design in Immersive Environments.

The rise and fall of the metaversity

In Part 2 of this series,I examined two examples from the history of immersive learning. First, I showed the parallels when companies like Meta and Linden Lab dominate a single platform for immersive learning designs. The lesson is that what is allowed one day can quickly become disallowed the next day. Second, I pointed out the inappropriate boasting and poor course design used in the “first course in virtual reality” by Stanford University. In these recent cases (Meta and Stanford University) there was a remarkable lack of awareness of the history of immersive learning. Said another way, mistakes of the past were repeated.

In another example of history repeating itself, ten colleges and universities adopted digital twin campuses in June 2022 using the ENGAGE platform with monetary support and donated VR headsets from Meta (Koenig, 2022). These metaversity locations recreated (or created!) campus buildings to allow learners to gather on the virtual campus. 

Eight years prior, Second Life (SL) campus buildings were “designed to mimic real-world architectural equivalents” but had become “abandoned ghost towns” (Wecker, 2014). 

The early Second Life virtual campus creations were often the result of student projects. Confusingly, the professors who designed and assigned these projects touted the work of creating faithful campus recreations as creative and thus, at the highest level of Bloom’s cognitive learning objectives. I’m inserting a heavy eye roll here because that’s really stretching the justification of working in virtual reality to an extreme point.  Plus, I have to point out: what does next year’s class build if this year’s class made the campus?  My point is that simply building campus buildings (so that you can have a virtual campus!) is a project idea that runs out of steam. Things got really interesting right after the SL virtual campuses were launched.  Everyone involved noticed that the spaces were not being utilized. 

Students were asked why they weren’t visiting the virtual campus. 

The answer was simple.

No one was there.

You see, you could have the most amazing design with all of the bells and whistles (really!), but if people were not there, then people found that there was no compelling reason to return. Admissions folks had no compelling reason to be in the virtual admissions building, same for financial aid teams. Even library teams today in virtual reality struggle to staff spaces with the same spread as IRL (in real life) libraries.

During a recent tour of the University of Maryland Global Campus metaversity campus, the audio connection failed. The host did not offer any tech support. The experience showcased empty buildings during what was a busy time of the academic semester. To be fair, I understand the implications of FERPA which might have predicted that students were in classroom spaces separate from public spaces. However, it is logical that on any campus, students could still be found  in public space buildings like the networking lounge. These accurate campus recreations rarely spur more than a passing interest to learners. 


The ten colleges and universities in this project are now facing the end of the project and the initial funding is ending. Steven Van Hook commented that, “Administrators may speak of their twin campuses in glittering terms on the record –then off the record talk about their regrets and what else they could have bought for the hundreds of thousands of dollars” (VWBPE, 2024). According to Temple University’s Kathy Hirsh Pasek, “A year ago, a lot of companies were going full steam ahead. Today’s that’s not true; they’ve rerouted a lot of their funds for AI and Twitter alternatives” (Coffey, 2023, para. 37) Institutions made the decision to adopt immersive experiences but do not appear to know how to make wise decisions when generous funding stops and societal attention moves on.

The key problems

Therefore, throughout these first three parts of this series, there are several challenges apparent. Instructional designers and administrators must wade through the myriad of claims derived from dubious research studies. It feels like chicanery to figure out which statements about immersive experiences for learning are authentic and do point the way to future positive outcomes and which statements are in doubt. The first issue is with interpreting research wisely. Every research study has inherent flaws; no one study can definitively provide answers to all of education’s questions. This situation is made worse when the research is translated into social media and seems to tout incredible claims (Lanier et al., 2019).

Therefore, the conundrum has been illuminated. The myths that appear to come from a research basis must be dispelled. Next, the very basis of the published research record is at risk of bias and problems. This series will inform on what characteristics to look for in published research.  Finally, if one were to step around the research interpretation problems, what is the system for building and using immersive experiences for its best advantage? This series will attempt to answer these questions. This series then forms the navigator role for instructional designers and administrators figuring out how to chart a route to a successful implementation.

Post Script

*virtual campuses

I’m using the term virtual campuses to specifically refer to real work recreations of campus spaces like quads and lecture halls. I am not referring to simulations (for example in science courses) or spaces specifically designed for social use (for example, dance halls).

Virtual campuses were designed as early as 1999 as text-based educational MUVEs (multi user virtual environments). This example classroom shows “the room’s description, list of contents, who  is in the room, the exits, and links to applications” (Maher, et al., 1999).

Technically, ‘Nobody else is here’ might have been foresight.

The metaversity concept is not to be confused with metauniversities, which are global collaborating universities (Costanza, et al., 2021). It appears as though the metaversity term became popular in 2021 and the company ENGAGE is not the only entity to claim it.

Coffey, L. (2023, July 11). “Metaversities” face virtual learning’s financial reality. Inside Higher Ed | Higher Education News, Events and Jobs. https://www.insidehighered.com/news/tech-innovation/teaching-learning/2023/07/11/metaversities-face-virtual-learnings-financial

Costanza, R., Kubiszewski, I., Kompas, T., & Sutton, P. C. (2021). A global metauniversity to lead by design to a sustainable well-being future. Frontiers in Sustainability, 2, 653721.

Koenig, R. (2022, June 6). With Money From Facebook, 10 Colleges Turn Their Campuses into ‘Metaversities.’ EdSurge. https://www.edsurge.com/news/2022-06-01-with-money-from-facebook-10-colleges-turn-their-campuses-into-metaversities

Lanier, M., Waddell, T. F., Elson, M., Tamul, D. J., Ivory, J. D., & Przybylski, A. (2019). Virtual reality check: Statistical power, reported results, and the validity of research on the psychology of virtual reality and immersive environments. Computers in Human Behavior, 100, 70–78. https://doi.org/10.1016/j.chb.2019.06.015

Maher, M. L., Skow, B., & Cicognani, A. (1999). Designing the virtual campus. Design Studies, 20(4), 319-342.

Wecker, M. (2014, April 22). What ever happened to Second Life? Chronicle Vitae. https://chroniclevitae.com/news/456-what-ever-happened-to-second-life

#VirtualCampus #edtech #VirtualUniversity

This article is simultaneously posted to LinkedIn and to my blog. My copyrights are retained. This article cannot be used to train AI.