Augmented Reality Applications for Cultural Heritage Using Kinect Sensor

Rita Afyenni (1), Aldo Erianda (2), Putri Wahyuni (3), Ardian Firosha (4), Taufik Gusman (5), Sumema (6)
(1) Politeknik Negeri Padang, Limau Manis, Padang, 25164, Indonesia
(2) Politeknik Negeri Padang, Limau Manis, Padang, 25164, Indonesia
(3) Politeknik Negeri Padang, Limau Manis, Padang, 25164, Indonesia
(4) Politeknik Negeri Padang, Limau Manis, Padang, 25164, Indonesia
(5) Politeknik Negeri Padang, Limau Manis, Padang, 25164, Indonesia
(6) Politeknik Negeri Padang, Limau Manis, Padang, 25164, Indonesia
Fulltext View | Download
How to cite (IJASEIT) :
Afyenni, R., Erianda, A., Wahyuni, P., Firosha, A., Gusman, T., & Sumema. (2024). Augmented Reality Applications for Cultural Heritage Using Kinect Sensor. International Journal of Advanced Science Computing and Engineering, 6(3), 127–131. https://doi.org/10.62527/ijasce.6.3.221

There are quite a number of advantages gained from Microsoft Kinect which is a motion sensing device that also includes AR applications to aid in the preservation and promotion of cultural assets. In this work, a batik model was developed with the help of Microsoft Kinect by utilizing its core components consisting of a depth sensor, an RGB camera and a microphone array to allow motion tracking, gesture recognition, and voice command functionalities of the device.The depth sensing features of the device, in particular the structural light employed, transition to Time-of-Flight technology has improved the efficiency and applicability of the device towards AR. Kinect has the ability to create an immersive AR experience by accurately mapping virtual objects to the user’s environment, leveraging body joint tracking to create a 3D skeletal model. It is required to take into consideration the kinnect positioning technique which has importance in allowing 3D objects and models to align. Therefore, the conclusion addresses Kinect as it relates to human-computer interaction, in particular, concerning its potential to change body interaction in real time and how it sets the stage for future systems that require an active interaction across a number of fields including culture and heritage.

A. Nijholt, “Virtual Worlds: A New Open Access Journal of Virtual Reality, Augmented and Mixed Reality Technologies, and Their Uses,” Virtual Worlds, vol. 1, no. 1, pp. 18–19, Aug. 2022, doi: 10.3390/virtualworlds1010002.

J. Manjorin, “How Elearning Practitioners can Find Value in Augmented and Virtual Reality Technology,” eLearn, vol. 2017, no. 8, Aug. 2017, doi: 10.1145/3136555.3133321.

K. Swargiary, “Augmented Reality (AR) Technology on Student Engagement: An Experimental Research Study,” Qeios, Nov. 2023, doi: 10.32388/fnwgpu.

J. Y. Yoon, C. Lee, J. Choi, S. R. Chang, and J. Kim, “The effect of social media apps on shopping apps,” Journal of Business Research, vol. 148, pp. 23–32, Sep. 2022, doi: 10.1016/j.jbusres.2022.04.021.

S. Alatrash, S. Arnab, and K. Antlej, “Communicating engineering heritage through immersive technology: A VR framework for enhancing users’ interpretation process in virtual immersive environments,” Computers & Education: X Reality, vol. 3, p. 100040, Dec. 2023, doi: 10.1016/j.cexr.2023.100040.

M.-A. Moinnereau, A. A. Oliveira, and T. H. Falk, “Instrumenting a virtual reality headset for at-home gamer experience monitoring and behavioural assessment,” Frontiers in Virtual Reality, vol. 3, Oct. 2022, doi: 10.3389/frvir.2022.971054.

A. Theodoropoulos, D. Stavropoulou, P. Papadopoulos, N. Platis, and G. Lepouras, “Developing an Interactive VR CAVE for Immersive Shared Gaming Experiences,” Virtual Worlds, vol. 2, no. 2, pp. 162–181, May 2023, doi: 10.3390/virtualworlds2020010.

R. Kirollos and W. Merchant, “Comparing cybersickness in virtual reality and mixed reality head-mounted displays,” Frontiers in Virtual Reality, vol. 4, Feb. 2023, doi: 10.3389/frvir.2023.1130864.

Sinlapanuntakul, P., Korentsides, J., & Chaparro, B. S. (2023, August 2). Exploring the user experience (UX) of a multi-window augmented reality environment. Frontiers in Virtual Reality, 4. https://doi.org/10.3389/frvir.2023194019

M. C. Howard and M. M. Davis, “A Meta-analysis of augmented reality programs for education and training,” Virtual Reality, vol. 27, no. 4, pp. 2871–2894, Aug. 2023, doi: 10.1007/s10055-023-00844-6.

L. Kerawalla, R. Luckin, S. Seljeflot, and A. Woolard, “‘Making it real’: exploring the potential of augmented reality for teaching primary school science,” Virtual Reality, vol. 10, no. 3–4, pp. 163–174, Nov. 2006, doi: 10.1007/s10055-006-0036-4.

Salmi, H., Thuneberg, H., & Vainikainen, M. P. (2016, November 25). Making the invisible observable by Augmented Reality in informal science education

H. Salmi, H. Thuneberg, and M.-P. Vainikainen, “Making the invisible observable by Augmented Reality in informal science education context,” International Journal of Science Education, Part B, vol. 7, no. 3, pp. 253–268, Nov. 2016, doi: 10.1080/21548455.2016.1254358.

Z. Du, J. Liu, and T. Wang, “Augmented Reality Marketing: A Systematic Literature Review and an Agenda for Future Inquiry,” Frontiers in Psychology, vol. 13, Jun. 2022, doi: 10.3389/fpsyg.2022.925963.

Handayani, W., Afyenni, R., & Syukri, A. (2022). Optimalisasi Promosi Nagari Berbasis Website. In Proceeding Applied Business and Engineering Conference (Vol. 10, p. 10th).

Sonatha, Y., Azmi, M., Liza, R., Rasyidah, R., & Afyenni, R. (2024, February). Synergizing AHP and SMART: An Integrated Decision Support System for Best Employee Selection. In Proceedings of the 11th International Applied Business and Engineering Conference, ABEC 2023, September 21st, 2023, Bengkalis, Riau, Indonesia.