Augmented Reality Applications for Cultural Heritage Using Kinect Sensor

Rita Afyenni (1), Aldo Erianda (2), Putri Wahyuni (3), Ardian Firosha (4), Taufik Gusman (5), Sumema (6)
(1) Department of Information Technology, Politeknik Negeri Padang, Padang, Indonesia
(2) Department of Information Technology, Politeknik Negeri Padang, Padang, Indonesia
(3) Department of Information Technology, Politeknik Negeri Padang, Padang, Indonesia
(4) Department of Information Technology, Politeknik Negeri Padang, Padang, Indonesia
(5) Department of Information Technology, Politeknik Negeri Padang, Padang, Indonesia
(6) Department of Information Technology, Politeknik Negeri Padang, Padang, Indonesia
Fulltext View | Download
How to cite (IJASEIT) :
Afyenni, R., Erianda, A., Wahyuni, P., Firosha, A., Gusman, T., & Sumema. (2024). Augmented Reality Applications for Cultural Heritage Using Kinect Sensor. International Journal of Advanced Science Computing and Engineering, 6(3), 129–133. https://doi.org/10.62527/ijasce.6.3.221

There are quite a number of advantages gained from Microsoft Kinect which is a motion sensing device that also includes AR applications to aid in the preservation and promotion of cultural assets. In this work, a batik model was developed with the help of Microsoft Kinect by utilizing its core components consisting of a depth sensor, an RGB camera and a microphone array to allow motion tracking, gesture recognition, and voice command functionalities of the device.The depth sensing features of the device, in particular the structural light employed, transition to Time-of-Flight technology has improved the efficiency and applicability of the device towards AR. Kinect has the ability to create an immersive AR experience by accurately mapping virtual objects to the user’s environment, leveraging body joint tracking to create a 3D skeletal model. It is required to take into consideration the kinnect positioning technique which has importance in allowing 3D objects and models to align. Therefore, the conclusion addresses Kinect as it relates to human-computer interaction, in particular, concerning its potential to change body interaction in real time and how it sets the stage for future systems that require an active interaction across a number of fields including culture and heritage.

Nijholt, "Virtual worlds: A new open access journal of virtual reality, augmented and mixed reality technologies, and their uses," Virtual Worlds, vol. 1, no. 1, pp. 18-19, Aug. 2022, doi:10.3390/virtualworlds1010002.

J. Manjorin, "How eLearning practitioners can find value in augmented and virtual reality technology," eLearn, vol. 2017, no. 8, Aug. 2017, doi: 10.1145/3136555.3133321.

K. Swargiary, "Augmented reality (AR) technology on student engagement: An experimental research study," Qeios, Nov. 2023, doi:10.32388/fnwgpu.

J. Y. Yoon et al., "The effect of social media apps on shopping apps," J. Bus. Res., vol. 148, pp. 23-32, Sep. 2022, doi:10.1016/j.jbusres.2022.04.021.

S. Alatrash, S. Arnab, and K. Antlej, "Communicating engineering heritage through immersive technology: A VR framework for enhancing users' interpretation process in virtual immersive environments," Comput. Educ.: X Reality, vol. 3, p. 100040, Dec. 2023, doi: 10.1016/j.cexr.2023.100040.

M.-A. Moinnereau, A. A. Oliveira, and T. H. Falk, "Instrumenting a virtual reality headset for at-home gamer experience monitoring and behavioural assessment," Front. Virtual Reality, vol. 3, Oct. 2022, doi:10.3389/frvir.2022.971054.

A. Theodoropoulos et al., "Developing an interactive VR CAVE for immersive shared gaming experiences," Virtual Worlds, vol. 2, no. 2, pp. 162-181, May 2023, doi: 10.3390/virtualworlds2020010.

R. Kirollos and W. Merchant, "Comparing cybersickness in virtual reality and mixed reality head-mounted displays," Front. Virtual Reality, vol. 4, Feb. 2023, doi: 10.3389/frvir.2023.1130864.

P. Sinlapanuntakul, J. Korentsides, and B. S. Chaparro, "Exploring the user experience (UX) of a multi-window augmented reality environment," Front. Virtual Reality, vol. 4, Aug. 2023, doi:10.3389/frvir.2023.194019.

M. C. Howard and M. M. Davis, "A meta-analysis of augmented reality programs for education and training," Virtual Reality, vol. 27, no. 4, pp. 2871-2894, Aug. 2023, doi: 10.1007/s10055-023-00844-6.

L. Kerawalla et al., "'Making it real': Exploring the potential of augmented reality for teaching primary school science," Virtual Reality, vol. 10, no. 3-4, pp. 163-174, Nov. 2006, doi: 10.1007/s10055-006-0036-4.

H. Salmi, H. Thuneberg, and M.-P. Vainikainen, "Making the invisible observable by augmented reality in informal science education context," Int. J. Sci. Educ., Part B, vol. 7, no. 3, pp. 253-268, Nov. 2016, doi: 10.1080/21548455.2016.1254358.

Z. Du, J. Liu, and T. Wang, "Augmented reality marketing: A systematic literature review and an agenda for future inquiry," Front. Psychol., vol. 13, Jun. 2022, doi: 10.3389/fpsyg.2022.925963.

W. Handayani, R. Afyenni, and A. Syukri, "Optimalisasi promosi Nagari berbasis website," in Proc. Appl. Bus. Eng. Conf., vol. 10, 2022.

Y. Sonatha et al., "Synergizing AHP and SMART: An integrated decision support system for best employee selection," in Proc. 11th Int. Appl. Bus. Eng. Conf. (ABEC), Bengkalis, Indonesia, Sep. 2023, Feb. 2024.