The augmented reality portal and hints usage for assisting individuals with autism spectrum disorder, anxiety and cognitive disorders

Dyulicheva, Yulia Yu.; Kosova, Yekaterina A.; Uchitel, Aleksandr D.

URI: http://ceur-ws.org/Vol-2731/paper14.pdf
http://elibrary.kdpu.edu.ua/xmlui/handle/123456789/4412
https://doi.org/10.31812/123456789/4412

Date: 2020-11-08

Abstract:

The augmented reality applications are effectively applied in education and therapy for people with special needs. We propose to apply the augmented reality portal as a special tool for the teachers to interact with people at the moment when a panic attack or anxiety happens in education process. It is expected that applying the augmented reality portal in education will help students with ASD, ADHD and anxiety disorder to feel safe at discomfort moment and teachers can interact with them. Our application with the augmented reality portal has three modes: for teachers, parents, and users. It gives the ability to organize personalized content for students with special needs. We developed the augmented reality application aimed at people with cognitive disorders to enrich them with communication skills through associations understanding. Applying the augmented reality application and the portal discovers new perspectives for learning children with special needs. The AR portal creates illusion of transition to another environment. It is very important property for children with ADHD because they need in breaks at the learning process to change activity (for example, such children can interact with different 3D models in the augmented reality modes) or environment. The developed AR portal has been tested by a volunteer with ASD (male, 21 years old), who confirmed that the AR portal helps him to reduce anxiety, to feel calm down and relaxed, to switch attention from a problem situation.

Description:

1. Alberta Education: Focusing on Success: Teaching Students with Attention Deficit/Hyperactivity Disorder, grades 1 to 12. Alberta Education, Learning and Teaching Resources Branch, Edmonton. https://open.alberta.ca/dataset/e06f242f-eaf1-4567-a035- f56ef95a7435/resource/744e1402-d99d-46b0-b4e6-04f28073de29/download/2006- focusing-success-teaching-students-adhd.pdf (2006). Accessed 29 Nov 2019 2. Amos, G.A., Byrne, G., Chouinard, P.A., Godber, T.: Autism Traits, Sensory OverResponsivity, Anxiety, and Stress: A Test of Explanatory Models. Journal of Autism and Developmental Disorders 49(1), 98–112 (2019). doi:10.1007/s10803-018-3695-6 3. Anxiety and Depression Association of America. https://adaa.org/about-adaa/pressroom/facts-statistics (2020). Accessed 13 May 2020 4. Autism Society. https://www.autism-society.org/releases/cdc-releases-new-prevalencerates-of-people-with-autism-spectrum-disorder (2020). Accessed 13 May 2020 5. Baragash, R., Al-Samarraie, H., Alzahrani, A., Alfarraj, O.: Augmented Reality and Functional Skills Acquisition Among Individuals With Special Needs: A Meta-Analysis of Group Design Studies. European Journal of Special Needs Education 35(3), 382–397 (2019). doi:10.1080/08856257.2019.1703548 6. Berman, M.G., Jonides, J., Kaplan, S.: The cognitive benefits of interacting with nature. Psychological Science 19(12), 1207–1212 (2008). doi:10.1111/j.1467-9280.2008.02225.x 7. Brandão, J., Cunha, P., Vasconcelos, J., Carvalho, V., Soares, F.: An Augmented Reality Gamebook for Children with Autism Spectrum Disorders. In: The International Conference on E-Learning in the Workplace, 2015 June 10th -12th, New York, pp. 123–127 (2015) 8. Chen, C.-H., Lee, I.-J., Lin, L.-Y.: Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Research in Developmental Disabilities 36, 396–403 (2015). doi:10.1016/j.ridd.2014.10.015 9. Escobedo, L., Tentori, M.: Mobile Augmented Reality to Support Teachers of Children with Autism. In: Hervás, R., Lee, S., Nugent, C., Bravo, J. (eds.) Ubiquitous Computing and Ambient Intelligence. Personalisation and User Adapted Services. UCAmI. Lecture Notes in Computer Science, vol. 8867, pp. 60–67. Springer, Cham (2014). doi:10.1007/978-3- 319-13102-3_12 10. Geroimenko, V., El-Seoud, S., Halabi, O.: An Augmented Reality-Based Framework for Assisting Individuals with Autism and Cognitive Disorders. International Journal of Information and Education Technology 8(12), 904–907 (2018). doi:10.18178/ijiet.2018.8.12.1160 11. Grandin, T.: How does visual thinking work in the mind of a person with autism? A personal account. Philosophical Transactions of the Royal Society B: Biological Sciences 364(1522), 1437–1442 (2009). doi:10.1098/rstb.2008.0297 12. Green, S.A., Ben-Sasson, A., Soto, T.W., Carter, A.S.: Anxiety and sensory overresponsivity in toddlers with autism spectrum disorders: Bidirectional effects across time. Journal of Autism and Developmental Disorders 42(6), 1112–1119 (2012). doi:10.1007/s10803-011-1361-3 13. Horder, J., Wilson, C.E., Mendez, M.A., Murphy, D.G.: Autistic traits and abnormal sensory experiences in adults. Journal of Autism and Developmental Disorders 44(6), 1461–1469 (2014). doi:10.1007/s10803-013-2012-7 14. ICD-10 Version:2019: F84 Pervasive developmental disorders. https://icd.who.int/browse10/2019/en#/F84 (2020). Accessed 19 April 2020 15. ICD-10 Version:2019: Neurotic, stress-related and somatoform disorders (F40-F48). https://icd.who.int/browse10/2019/en#/F40-F48 (2020). Accessed 13 May 2020 16. Kolomoiets, T.H., Kassim, D.A.: Using the Augmented Reality to Teach of Global Reading of Preschoolers with Autism Spectrum Disorders. CEUR Workshop Proceedings 2257, 237–246 (2018) 17. Kramarenko, T.H., Pylypenko, O.S., Zaselskiy, V.I.: Prospects of using the augmented reality application in STEM-based Mathematics teaching. CEUR Workshop Proceedings 2547, 130–144 (2020) 18. Lavrentieva, O.O., Arkhypov, I.O., Kuchma, O.I., Uchitel, A.D.: Use of simulators together with virtual and augmented reality in the system of welders’ vocational training: past, present, and future. CEUR Workshop Proceedings 2547, 201–216 (2020) 19. Lee, I.-J., Chen, C.-H., Wang, C.-P., Chung, C.-H.: Augmented Reality Plus Concept Map Technique to Teach Children with ASD to Use Social Cues When Meeting and Greeting. The Asia-Pacific Education Researcher 27(3), 227–243 (2018). doi:10.1007/s40299-018- 0382-5 20. Lee, I.-J., Lin, L.-Y., Chen, C.-H., Chung, C.-H.: How to Create Suitable Augmented Reality Application to Teach Social Skills for Children with ASD. In: Mohamudally, N. (ed.) State of the Art Virtual Reality and Augmented Reality Knowhow. IntechOpen (2018). doi:10.5772/intechopen.76476 21. Leubner, D., Hinterberger, T.: Reviewing the Effectiveness of Music Interventions in Treating Depression. Frontiers in Psychology 8, 1109 (2017). doi:10.3389/fpsyg.2017.01109 22. Liu, R., Salisbury, J.P., Vahabzadeh, A., Sahin, N.T.: Feasibility of an Autism-Focused Augmented Reality Smartglasses System for Social Communication and Behavioral Coaching. Frontiers in Pediatrics 5(145) (2017). doi:10.3389/fped.2017.00145 23. McMahon, D., Cihak, D.F., Wright, R.: Augmented Reality as a navigation tool to employment opportunities for postsecondary education students with intellectual disabilities and Autism. Journal of Research on Technology in Education 47(3), 157–172 (2015). doi:10.1080/15391523.2015.1047698 24. Midak, L.Ya., Kravets, I.V., Kuzyshyn, O.V., Pahomov, J.D., Lutsyshyn, V.M., Uchitel, A.D.: Augmented reality technology within studying natural subjects in primary school. CEUR Workshop Proceedings 2547, 251–261 (2020) 25. Minshew, N.J., Meyer, J., Goldstein, G.: Abstract reasoning in autism – a disassociation between concept formation and concept identification. Neuropsychology 16, 327–334 (2002). doi:10.1037/0894-4105.16.3.327 26. Mintii, I.S., Soloviev, V.N.: Augmented Reality: Ukrainian Present Business and Future Education. CEUR Workshop Proceedings 2257, 227–231 (2018) 27. Moon, D.: How to build AR Portals in 5 mins w/ React Native & Viro AR. https://blog.viromedia.com/how-to-build-ar-portals-in-5-mins-w-react-native-viro-arb939850def94 (2017). Accessed 12 May 2020 28. Musalek, M., Vasek, L.: Possibilities of Using Realityas a Means for Therapy from Fear of Spiders. MATEC Web of Conference 292(3), 01041 (2019). doi:10.1051/matecconf/201929201041 29. Nechypurenko, P.P., Stoliarenko, V.G., Starova, T.V., Selivanova, T.V., Markova, O.M., Modlo, Ye.O., Shmeltser, E.O.: Development and implementation of educational resources in chemistry with elements of augmented reality. CEUR Workshop Proceedings 2547, 156– 167 (2020) 30. Nicolaidis, C., Kripke, C.C., Raymaker, D.: Primary Care for Adults on the Autism Spectrum. The Medical Clinics of North America 98(5), 1169–1191 (2016). doi:10.1016/j.mcna.2014.06.011 31. Osadchyi, V.V., Varina, H.B., Osadcha, K.P., Prokofieva, O.O., Kovalova, O.V., Kiv, A.E.: Features of implementation of modern AR technologies in the process of psychological and pedagogical support of children with autism spectrum disorders. In: Burov, O.Yu., Kiv, A.E. (eds.) Proceedings of the 3rd International Workshop on Augmented Reality in Education (AREdu 2020), Kryvyi Rih, Ukraine, May 13, 2020, CEUR-WS.org, online (2020, in press) 32. Quintero, J., Baldiris, S., Rubira, R., Cerón, J., Velez, G.: Augmented Reality in Educational Inclusion. A Systematic Review on the Last Decade. Frontiers in Psychology 20, 1836 (2019). doi:10.3389/fpsyg.2019.01835 33. Rahani, V.K., Vard, A., Majafi, M.: Claustrophobia Game: Design and Development of a New Virtual Reality Game for Treatment of Claustrophobia. Journal of Medical Signals & Sensors 8(4), 231–237 (2018). doi:10.4103/jmss.JMSS_27_18 34. Rashevska, N.V., Soloviev, V.N.: Augmented Reality and the Prospects for Applying Its in the Training of Future Engineers. CEUR Workshop Proceedings 2257, 192–197 (2018) 35. raywenderlich.com Tutorial Team, Language, C., Bandekar, N., Bello, A., Coron, T.: ARKit by Tutorials: Building Augmented Reality Apps in Swift 4. Razeware LLC (2018) 36. Robertson, A.E., Simmons, D.R.: The relationship between sensory sensitivity and autistic traits in the general population. Journal of Autism and Developmental Disorders 43(4), 775–784 (2013). doi:10.1007/s10803-012-1608-7 37. Safar, A.H., Al-Jafar, A.A., Al-Yousefi, Z.H.: The Effectiveness of Using Augmented Reality Apps in Teaching the English Alphabet to Kindergarten Children: A Case Study in the State of Kuwait. EURASIA Journal of Mathematics Science and Technology Education 13(2), 417–440 (2016). doi:10.12973/eurasia.2017.00624a 38. Shield, B., Greenland, E., Dockrell, J.: Noise in open plan classrooms in primary schools: A review. Noise and Health 12(49), 225–234 (2010) 39. Striuk, A.M., Rassovytska, M.V., Shokaliuk, S.V.: Using Blippar Augmented Reality Browser in the Practical Training of Mechanical Engineers. CEUR Workshop Proceedings 2104, 412–419 (2018) 40. Tentori, M., Escobedo, L., Balderas, G.: A smart environment for children with autism.: IEEE Pervasive Computing 14(2), 42–50 (2015). doi:10.1109/MPRV.2015.22 41. The Benefits of Sensory Rooms for Children with Autism and Social/Emotional Challenges. https://www.asd-1817.org/news-story?pk=1102483# (2019). Accessed 12 May 2020 42. Thoma, M.V., La Marca, R., Brönnimann, R., Finkel, L., Ehlert, U., Nater, U.V.: The Effect of Music on the Human Stress Response. PLoS One 8(8) (2013). doi:10.1371/journal.pone.0070156 43. Tobar-Muñoz, H., Fabregat, R., Baldiris, S.: Augmented Reality Game-Based Learning for Mathematics Skills Training in Inclusive Contexts. IE Comunicaciones: Revista Iberoamericana de Informática Educativa 21, 39–51 (2015) 44. Vullamparthi, A.J., Nelaturu, S.C.B.; Mallaya, D.D.; Chandrasekhar, S.: Assistive Learning for Children with Autism Using Augmented Reality. In: IEEE Fifth International Conference on Technology for Education (t4e 2013), 18-20 Dec. 2013, Kharagpur, India, pp. 43–46. IEEE (2013). doi:10.1109/T4E.2013.18 45. Witte, M., Spruit, A., Hooren, S., Moonen, X., Stams, G.: Effects of music interventions on stress-related outcomes: a systematic review and two meta-analyses. Health Psychology Review 14(2), 294–324 (2020). doi:10.1080/17437199.2019.1627897 46. Yeh, S.-C., Li, Y.-Y., Zhou, C., Chiu, P.-H., Chen, J.-W.: Effects of Virtual Reality and Augmented Reality on Induced Anxiety. IEEE Transactions on Neural Systems and Rehabilitation Engineering 26(7), 1345–1352 (2018). doi:10.1109/TNSRE.2018.2844083 47. Zelinska, S.O., Azaryan, A.A., Azaryan, V.A.: Investigation of Opportunities of the Practical Application of the Augmented Reality Technologies in the Information and Educative Environment for Mining Engineers Training in the Higher Education Establishment. CEUR Workshop Proceedings 2257, 204–214 (2018) 48. Zinonos, N.O., Vihrova, E.V., Pikilnyak, A.V.: Prospects of Using the Augmented Reality for Training Foreign Students at the Preparatory Departments of Universities in Ukraine. CEUR Workshop Proceedings 2257, 87–92 (2018)

Show full item record