Features of implementation of modern AR technologies in the process of psychological and pedagogical support of children with autism spectrum disorders

Osadchyi, Viacheslav V.; Varina, Hanna B.; Osadcha, Kateryna P.; Prokofieva, Olesia O.; Kovalova, Olha V.; Ків, Арнольд Юхимович

URI: http://ceur-ws.org/Vol-2731/paper15.pdf
http://elibrary.kdpu.edu.ua/xmlui/handle/123456789/4413
https://doi.org/10.31812/123456789/4413

Date: 2020-11-08

Abstract:

The article deals with the actual issue of the specificity and algorithm of the introduction of innovative AR technologies in the process of psychological and pedagogical support of children with autism spectrum disorders (ASD). An innovative element of theoretical and methodological analysis of the problem and empirical research is the detection of vectors of a constructive combination of traditional psycho-correctional and psycho-diagnostic approaches with modern AR technologies. The analysis of publications on the role and possibilities of using AR technologies in the process of support children with ASD (autism spectrum disorder) and inclusive environment was generally conducted by surfing on the Internet platforms containing the theoretical bases for data publications of scientific journals and patents. The article also analyzes the priorities and potential outcomes of using AR technologies in psycho-correction and educational work with autistic children. According to the results of the analysis of scientific researches, Unified clinical protocol of primary, secondary (specialized), tertiary (highly specialized) medical care and medical rehabilitation “Autism spectrum disorders (disorders of general development)”, approaches for correction, development and education of children with ASD, AR technologies were selected for further implementation in a comprehensive program of psychological and pedagogical support for children with ASD. The purpose of the empirical study is the search, analysis and implementation of multifunctional AR technologies in the psycho-correctional construct of psychological and pedagogical support of children with ASD. According to the results of the pilot study, the priorities and effectiveness of using AR technologies in the development of communicative, cognitive, emotional-volitional, mnemonic abilities of children and actualization of adaptive potential and adaptive, socially accepted behaviors are made. The possibilities and perspectives of using AR technologies as an element of inclusive environment, with regard to nosology and phenomenology, need further investigation.

Description:

1. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Computer Graphics and Applications 21(6), 34–47 (2001). doi:10.1109/38.963459 2. Bai, Z., Blackwell, A.F., Coulouris, G.: Making Pretense Visible and Graspable: An augmented reality approach to promote pretend play. In: 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 5-8 Nov. 2012, Atlanta, GA, USA. IEEE (2013). doi:10.1109/ismar.2012.6402567 3. Bai, Z., Blackwell, A.F., Coulouris, G.: Using Augmented Reality to Elicit Pretend Play for Children with Autism. IEEE Transactions on Visualization and Computer Graphics 21(5), 598–610 (2015). doi:10.1109/tvcg.2014.2385092 4. Billard, A., Robins, B., Nadel, J., Dautenhahn, K. Building: Robota, a Mini-Humanoid Robot for the Rehabilitation of Children with Autism. Assistive Technology 19(1), 37–49 (2007). doi:10.1080/10400435.2007.10131864 5. Boccanfuso, L., O’Kane, J.M.: Adaptive Robot Design with Hand and Face Tracking for Use in Autism Therapy. In: Ge, S.S., Li, H., Cabibihan, J.J., Tan, Y.K. (eds.) Social Robotics. ICSR 2010. Lecture Notes in Computer Science, vol. 6414, pp. 265–274. Springer, Berlin, Heidelberg (2010). doi:10.1007/978-3-642-17248-9_28 6. Cai, Y., Chia, N.K.H., Thalmann, D., Kee, N.K.N., Zheng, J., Thalmann, N.M.: Design and Development of a Virtual Dolphinarium for Children With Autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering 21(2), 208–217 (2013). doi:10.1109/tnsre.2013.2240700 7. Carmigniani, J., Furht, B., Anisetti, M., Ceravolo, P., Damiani, E., Ivkovic, M.: Augmented reality technologies, systems and applications. Multimedia Tools and Applications 51(1), 341–377 (2011). doi:10.1007/s11042-010-0660-6 8. Chen, C.-H., Lee, I.-J., Lin, L.-Y.: Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Research in Developmental Disabilities 36, 396–403 (2015). doi:10.1016/j.ridd.2014.10.015 9. Chorna, O.V., Hamaniuk, V.A., Uchitel, A.D.: Use of YouTube on lessons of practical course of German language as the first and second language at the pedagogical university. In: Kiv, A.E., Soloviev, V.N. (eds.) Proceedings of the 6th Workshop on Cloud Technologies in Education (CTE 2018), Kryvyi Rih, Ukraine, December 21, 2018. CEUR Workshop Proceedings 2433, 294–307. http://ceur-ws.org/Vol-2433/paper19.pdf (2019). Accessed 10 Sep 2019 10. Chung, C.-H., Chen, C.-H.: Augmented Reality Based Social Stories Training System for Promoting the Social Skills of Children with Autism. In: Soares, M., Falcão, C., Ahram, T. (eds.) Advances in Ergonomics Modeling, Usability & Special Populations. Advances in Intelligent Systems and Computing, vol. 486, pp. 495–505. Springer, Cham. (2016). doi:10.1007/978-3-319-41685-4_44 11. Cihak, D.F., Moore, E.J., Wright, R.E., McMahon, D.D., Gibbons, M.M., Smith, C.: Evaluating Augmented Reality to Complete a Chain Task for Elementary Students With Autism. Journal of Special Education Technology 31(2), 99–108 (2016). doi:10.1177/0162643416651724 12. Cipta, D. A., Avianty, D., Kurniawati, A.: Communication Board As Apparatus Montessori In Learning Mathematics Of Autism Students: Case Studi in SLB Autisme River Kids. Ukrainian Journal of Educational Studies and Information Technology 7(3), 25–31 (2019). doi:10.32919/uesit.2019.03.03 13. Cook, A.M., Adams, K., Volden, J., Harbottle, N., Harbottle, C.: Using Lego robots to estimate cognitive ability in children who have severe physical disabilities. Disability and Rehabilitation: Assistive Technology 6(4), 338–346 (2010). doi:10.3109/17483107.2010.534231 14. Cunha, P., Brandao, J., Vasconcelos, J., Soares, F., Carvalho, V.: Augmented reality for cognitive and social skills improvement in children with ASD. In: 2016 13th International Conference on Remote Engineering and Virtual Instrumentation (REV), 24-26 Feb. 2016, Madrid, Spain. IEEE (2016). doi:10.1109/rev.2016.7444495 15. Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., Donaldson, A., Varley, J.: Randomized, Controlled Trial of an Intervention for Toddlers With Autism: The Early Start Denver Model. Pediatrics 125(1), 17–23 (2009). doi:10.1542/peds.2009-0958 16. Dunleavy, M., Dede, C.: Augmented Reality Teaching and Learning. In: Spector, J., Merrill, M., Elen, J., Bishop, M. (eds.) Handbook of Research on Educational Communications and Technology, pp. 735–745. Springer, New York (2013). doi:10.1007/978-1-4614-3185-5_59 17. Escobedo, L., Nguyen, D.H., Boyd, L., Hirano, S., Rangel, A., Garcia-Rosas, D., Tentori, M., Hayes, G.: MOSOCO: a mobile assistive tool to support children with autism practicing social skills in real-life situations. In: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems - CHI’12, May 2012, pp. 2589–2598 (2012). doi:10.1145/2207676.2208649 18. Escobedo, L., Tentori, M., Quintana, E., Favela, J., Garcia-Rosas, D.: Using Augmented Reality to Help Children with Autism Stay Focused. IEEE Pervasive Computing 13(1), 38– 46 (2014). doi:10.1109/mprv.2014.19 19. Fernell, E., Eriksson, M., Gillberg, C.: Early diagnosis of autism and impact on prognosis: a narrative review. Clinical Epidemiology 5(1), 33–43 (2013). doi:10.2147/clep.s41714 20. French, L., Kennedy, E.M.M.: Annual Research Review: Early intervention for infants and young children with, or at-risk of, autism spectrum disorder: a systematic review. The Journal of Child Psychology and Psychiatry 59(4), 444–456 (2017). doi:10.1111/jcpp.12828 21. Geroimenko, V.: Augmented Reality Technology and Art: The Analysis and Visualization of Evolving Conceptual Models. In: 16th International Conference on Information Visualisation, 11-13 July 2012, Montpellier, France. IEEE (2012). doi:10.1109/iv.2012.77 22. Giullian, N., Ricks, D., Atherton, A., Colton, M., Goodrich, M., Brinton, B.: Detailed requirements for robots in autism therapy. In: 2010 IEEE International Conference on Systems, Man and Cybernetics, 10-13 Oct. 2010, Istanbul, Turkey. IEEE (2010). doi:10.1109/icsmc.2010.5641908 23. Hailpern, J., Karahalios, K., DeThorne, L., Halle, J.: Vocsyl: visualizing syllable production for children with ASD and speech delays. In: Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility - ASSETS’10, October 2010, pp. 297–298 (2010). doi:10.1145/1878803.1878879 24. Hashemi, J., Spina, T.V., Tepper, M., Esler, A., Morellas, V., Papanikolopoulos, N., Sapiro, G.: A computer vision approach for the assessment of autism-related behavioral markers. In: 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL), 7-9 Nov. 2012, San Diego, CA, USA (2012). doi:10.1109/devlrn.2012.6400865 25. Isotani, S., Reis, H.M., Alvares, D., Brandão, A.A.F., Brandão, L.O.: A DGS gesture dictionary for modelling on mobile devices. Interactive Learning Environments 26(3), 320– 336 (2018). doi:10.1080/10494820.2017.1325377 26. Johnson, C.P., Myers, S.M., Council on Children With Disabilities: Identification and Evaluation of Children With Autism Spectrum Disorders. Pediatrics 120(5), 1183–1215 (2007). doi:10.1542/peds.2007-2361 27. Kazhan, Yu.M., Hamaniuk, V.A., Amelina, S.M., Tarasenko, R.O., Tolmachev, S.T.: The use of mobile applications and Web 2.0 interactive tools for students’ German-language lexical competence improvement. In: Kiv, A.E., Shyshkina, M.P. (eds.) Proceedings of the 7 th Workshop on Cloud Technologies in Education (CTE 2019), Kryvyi Rih, Ukraine, December 20, 2019. CEUR Workshop Proceedings 2643, 392–415. http://ceur-ws.org/Vol2643/paper23.pdf (2020). Accessed 20 Jul 2020 28. Kolomoiets, T.H., Kassim, D.A.: Using the Augmented Reality to Teach of Global Reading of Preschoolers with Autism Spectrum Disorders. In: Kiv, A.E., Soloviev, V.N. (eds.) Proceedings of the 1st International Workshop on Augmented Reality in Education (AREdu 2018), Kryvyi Rih, Ukraine, October 2, 2018. CEUR Workshop Proceedings 2257, 237– 246. http://ceur-ws.org/Vol-2257/paper24.pdf (2018). Accessed 30 Nov 2018 29. Kompaniets, A., Chemerys, H.: Generalization of the experience of using research on psychology of behavior for designing UX design software products. Ukrainian Journal of Educational Studies and Information Technology 7(3), 1–10 (2019). doi:10.32919/uesit.2019.03.01 30. Kruglyk V.S., Osadchyi V.V.: Developing Competency in Programming among Future Software Engineers. Integratsiya obrazovaniya = Integration of Education 23(4), 587–606 (2019). doi: https://doi.org/10.15507/1991-9468.097.023.201904.587-606 31. Lorenzo, G., Gómez-Puerta, M., Arráez-Vera, G., Lorenzo-Lledó, A.: Preliminary study of augmented reality as an instrument for improvement of social skills in children with autism spectrum disorder. Education and Information Technologies 24, 181–204 (2019). doi:10.1007/s10639-018-9768-5 32. Marto, A., Almeida, H.A., Gonçalves, A.: Using augmented reality in patients with autism: A systematic review. In: Tavares, J., Natal Jorge, R. (eds.) VipIMAGE 2019. VipIMAGE 2019. Lecture Notes in Computational Vision and Biomechanics, vol. 34, pp. 454–463. Springer, Cham (2019). doi:10.1007/978-3-030-32040-9_46 33. Osadchyi, V., Osadcha, K., Eremeev, V.: The model of the intelligence system for the analysis of qualifications frameworks of European Countries. International Journal of Computing 16(3), 133–142 (2017) 34. Semerikov, S., Striuk, A., Striuk, L., Striuk, M., Shalatska, H.: Sustainability in Software Engineering Education: a case of general professional competencies. In: Semerikov, S., Chukharev, S., Sakhno, S., Striuk, A., Osadchyi, V., Solovieva, V., Vakaliuk, T., Nechypurenko, P., Bondarenko, O., Danylchuk, H. (eds.) The International Conference on Sustainable Futures: Environmental, Technological, Social and Economic Matters (ICSF 2020). Kryvyi Rih, Ukraine, May 20-22, 2020. E3S Web of Conferences 166, 10036 (2020). doi:10.1051/e3sconf/202016610036 35. Su Maw, S., Haga, C.: Effectiveness of cognitive, developmental, and behavioural interventions for Autism Spectrum Disorder in preschool-aged children: A systematic review and meta-analysis. Heliyon 4(9), e00763 (2018). doi:10.1016/j.heliyon.2018.e00763 36. Symonenko, S.: Complementing content of English courses for enhancing communication of IT-professionals for sustainable development. In: Semerikov, S., Chukharev, S., Sakhno, S., Striuk, A., Osadchyi, V., Solovieva, V., Vakaliuk, T., Nechypurenko, P., Bondarenko, O., Danylchuk, H. (eds.) The International Conference on Sustainable Futures: Environmental, Technological, Social and Economic Matters (ICSF 2020). Kryvyi Rih, Ukraine, May 20-22, 2020. E3S Web of Conferences 166, 10008 (2020). doi:10.1051/e3sconf/202016610008 37. Symonenko, S.V., Osadchyi, V.V., Sysoieva, S.O., Osadcha, K.P., Azaryan, A.A.: Cloud technologies for enhancing communication of IT-professionals. In: Kiv, A.E., Shyshkina, M.P. (eds.) Proceedings of the 7th Workshop on Cloud Technologies in Education (CTE 2019), Kryvyi Rih, Ukraine, December 20, 2019. CEUR Workshop Proceedings 2643, 225– 236. http://ceur-ws.org/Vol-2643/paper12.pdf (2020). Accessed 20 Jul 2020 38. Symonenko, S.V., Zaitseva, N.V., Osadchyi, V.V., Osadcha, K.P., Shmeltser, E.O.: Virtual reality in foreign language training at higher educational institutions. In: Kiv, A.E., Shyshkina, M.P. (eds.) Proceedings of the 2nd International Workshop on Augmented Reality in Education (AREdu 2019), Kryvyi Rih, Ukraine, March 22, 2019. CEUR Workshop Proceedings 2547, 37–49. http://ceur-ws.org/Vol-2547/paper03.pdf (2020). Accessed 10 Feb 2020 39. Tang, T.Y., Xu, J., Winoto, P.: An Augmented Reality-Based Word-Learning Mobile Application for Children with Autism to Support Learning Anywhere and Anytime: Object Recognition Based on Deep Learning. In: Antona, M., Stephanidis, C. (eds.) Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments. HCII 2019. Lecture Notes in Computer Science, vol. 11573, pp. 182–192. Springer, Cham (2019). doi:10.1007/978-3-030-23563-5_16 40. Tarasenko, R.O., Amelina, S.M., Kazhan, Yu.M., Bondarenko, O.V.: The use of AR elements in the study of foreign languages at the university. In: Burov, O.Yu., Kiv, A.E. (eds.) Proceedings of the 3rd International Workshop on Augmented Reality in Education (AREdu 2020), Kryvyi Rih, Ukraine, May 13, 2020, CEUR-WS.org, online (2020, in press) 41. Virnes, M., Kärnä, E., Vellonen, V.: Review of Research on Children with Autism Spectrum Disorder and the Use of Technology. Journal of Special Education Technology 30(1), 13–27 (2015). doi:10.1177/016264341503000102 42. Wedyan, M., AL-Jumaily, A., Dorgham, O.: The use of augmented reality in the diagnosis and treatment of autistic children: a review and a new system. Multimedia Tools and Applications 79, 18245–18291 (2020). doi:10.1007/s11042-020-08647-6 43. Wei, C., Yuan, L.: Reflection on college informationized teaching model under the background of educational informationization. In: 2019 IEEE International Conference on Computer Science and Educational Informatization, CSEI 2019, 16-19 Aug. 2019, Kunming, China, pp. 81–83. IEEE (2019). doi:10.1109/CSEI47661.2019.8939017

Show full item record