![\"Image](\"https:\/\/blogger.googleusercontent.com\/img\/b\/R29vZ2xl\/AVvXsEjTMEXfnlPgqganqu8hpJPsGppe7jXNANIcR6uU8F26yrkApUt1OC4u9H_uSzA1pFjm25HkYOSQWFlsDwlQHJvkeQ90hUc6hNaKYM0Gw8YCBTU-KrSCSAQH2V4-_BbgH5P-UA9Z8Op2HW_M0_Eh8LIIYJxP4BoZLhT0KmLKcckO8PGoNX11o4MWNPqM\/w640-h640\/Misleading%20Headline.png\")
<\/a><\/div>\nOh, I snagged a live one! I really didn’t think this image would garner much attention as my posts rarely do on these topics. 2022 has been a bad year for keeping<\/i> XR friends.<\/p>\n
But I’ve been contacted directly by a nice LinkedIn link. <\/p>\n
Incoming message<\/h2>\n
(DM’ing instead of commenting on your recent post here.) <\/p>\n
Why are you distorting the facts? <\/p>\n
The article says:<\/p>\n
“The survey revealed that students showed an average of 68 %
\nimprovement in a test taken after learning with Futuclass VR lessons
\ncompared to the results before the 30-minute VR lesson.”<\/p>\n
This is very different from “started from zero and learned 68 out of 100
\n percent”. <\/p>\n
The source is here, wasn’t hard to find. https:\/\/futuclass.com\/blog\/how-VR-lessons-increased-chemistry-test-scores-by-68-percentage\/<\/a> <\/p>\n And looking up the teacher involved, quoted in the article, she has I’m all for criticizing messaging and methodology of these “research” Good sleuthing! I like that you want to look at the actual numbers. I did so. I did read the article before I made my post. <\/p>\n May I direct to a Here is the one you quoted and I do see it: This one is not clear what “to the results before<\/i>” is actually referring This appears to be describing more of the method: After testing I thought that was interesting because it implies other approaches that The next sentence is problematic: “Several studies have revealed that It quotes “four times more effective than traditional learning theory”. <\/p>\n Here is where we get to what the 68% was actually measuring: “With VR In that paragraph, it becomes clear that the 68% was the “average” That’s why I wrote: Learners learn after learning. <\/p>\n The 68% was the So that’s why I wrote what I wrote. _ _<\/p>\n About “the source isn’t here”<\/p>\n That’s purposeful from me. I’m not out to point out the company or publisher’s name or link my comments with them on the LinkedIn network – especially when I have something negative to say. I let my hashtags carry the weight of passing my opinion around my network:<\/p>\n<\/p>\n #XR<\/a> #VR<\/a> #VREducation<\/a> #VRForGood<\/a> #edtech<\/a> #Chemistry<\/a> #ChemistryIsHardIGetIt<\/a> #VRForLearning<\/a> #ReadCarefully<\/a> #WriteBetter<\/a><\/span><\/span><\/span><\/p>\n Note: this article came to me via<\/i> my LinkedIn network – via 2 friends, actually. So I’m only recirculating my opinion back out and NOT pointing out the article, company, or researchers.<\/p>\n Additionally, I posted to LinkedIn one image and one line of text “Let’s be careful out there” (a reference to the TV show Hill Street Blues). That’s it. I didn’t include a link.<\/p>\n _ _<\/p>\n About the comment about the researcher’s qualifications: I don’t actually think the researcher\/educator whose experience is IN this article wrote<\/i> this article. There is no author quote, so I’d have to go with someone at Futuclass wrote this. I say that because some of the quotes for the researcher are put up close to sentences on something different– and thus, it doesn’t make sense in terms of writing. Usually evidence supports a claim, not says something very different and off tangent. By the way, when I see this, I always try to figure in possible changes in translation between languages. For example, could this article have been originally written in Estonian and then translated to English and thus some things just don’t sound like native English? Yes, that’s possible. However, the problems I see in the writing are more along the lines of illogical ideas or “pushed” writing (advertising) than straight research. So that would not invade actual word-for-word translations, but it would remain at the sentence & paragraph level- which is what I think I see.<\/p>\n Here is an example:<\/p>\n Several studies have revealed that first-hand So the quote shows that Katrin wanted a mix of technology and practical work to create effective learning. That seems to be her point. But the sentence just before makes the (wild) claim of the four times (but I’m not sure what of four times). So the ideas don’t connect.<\/span><\/p>\n BTW, the link to her qualifications is in another language. Regardless, I respect that she might have done some nice work here. Actually if you look at her quotes in isolation AND look at the “other properties” section – particularly with reference to chemistry education – I think that this educator is cooking with gas, as in, she’s doing well.<\/span><\/p>\n Overall my opinion is that I wish the “other properties” section would have actually made the headline and NOT the quantitative data. There is some really good stuff there. It has been 5 days since this interaction and no follow-up response from my link. \ud83d\ude1f This is just another case of if it looks too good to be true (68% improvement!!), it probably is.
\nmultiple publications at hard science institutions at Tallinn
\nUniversity. I somehow doubt she’d agree in your assessment on her
\nscientific rigor. https:\/\/www.etis.ee\/Portal\/Persons\/Display\/95da33ee-9b4c-4e72-9cab-3e72e3791c0c<\/a>? <\/p>\n
\nreports, but when you skew the actual facts you’re undermining your own
\npoint.<\/p>\nSo, my response:
<\/h2>\n
\n <\/p>\n
\n few more sentences lower down in the article?
\n
\nSome of these will be confusing, so by the end of this, we’ll have to
\nlook at the entire article and not just stick with exact sentences. <\/p>\n
\n“As a result, students showed an average of 68 % improvement in a test
\ntaken after learning the metal oxides during a 30-minute lesson using VR
\n compared to the results before.”
\n <\/p>\n
\n to. Could it be referring to: other teaching, to non-teaching, to
\n“before” teaching? I read further down in the article to find out.
\n <\/p>\n
\ndifferent approaches, the best results proved to be with group work and
\npaper worksheets. Students with VR headsets were expected to communicate
\n what was going on and solve the worksheets together with the students
\nwithout the VR sets.
\n <\/p>\n
\nbut that this one was settled on and it included a non-tech component
\n(paper worksheets).
\n <\/p>\n
\nfirst-hand experience is four times more effective than traditional
\ntheory learning. \u201cI believe that we should mix the experience from VR
\nequipment and practical work and this would be effective learning,\u201d
\nadmits Katrin Soika.” <\/p>\n
\n The “four times” is clued me in. The statement implies that VR is 4
\ntimes as better than traditional teaching. This is debunked research (by
\n me). If it referring to the PwC study (https:\/\/www.5discovery.com\/wp-content\/uploads\/2020\/09\/pwc-understanding-the-effectiveness-of-soft-skills-training-in-the-enterprise-a-study.pdf<\/a>
\n ), that study had learning take place in 1\/4 the number of minutes that
\n a classroom equivalent would have taken. Those are not apples to apples
\n comparison, but it was published by PwC that they thought VR was, then,
\n 4x as effective. <\/p>\n
\neducation, learners are inspired to discover for themselves. Students
\nhave an opportunity to learn by doing rather than passively reading or
\nlistening. After the VR chemistry lessons students were surveyed about
\ntheir experience and the results were significant. The survey revealed
\nthat students showed an average of 68 % improvement in a test taken
\nafter learning with Futuclass VR lessons compared to the results before
\nthe 30-minute VR lesson.” <\/p>\n
\nimprovement **compared to the results before the 30-minute VR lesson**.
\n <\/p>\n
\nscore that they received (on average) after engaging in a learning event
\n – in this case – the 30 minute VR lesson.
\n <\/p>\n
\n
\nDo you think I missed anything else quantitative in the article? <\/p>\nThe source isn’t here<\/h3>\n
The researcher’s qualifications<\/h3>\n
\nexperience is four times more effective than traditional theory
\nlearning. \u201cI believe that we should mix the experience from VR
\nequipment and practical work and this would be effective learning,\u201d
\nadmits Katrin Soika.<\/p>\nConclusion
<\/span><\/h3>\n
<\/span><\/p>\n
<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"