Prospects of using augmented reality technologies in the development of navigation tools for the blind

Authors

  • A. A. Sokolov Kharkiv National University of Radioelectronics
  • O. G. Avrunin Kharkiv National University of Radio Electronics!

DOI:

https://doi.org/10.31649/1681-7893-2023-46-2-55-63

Keywords:

augmented reality, human health, depth map, spatial orientation of the blind, ARCore framework

Abstract

This article discusses the concept of building a portable navigation assistant for blind people, as well as the prospects for using modern technologies of augmented reality. Current directions of development and hardware requirements for using the ARCore framework in smartphones are highlighted. The maximum depth that can be obtained for various types of obstacles has been experimentally investigated.

Author Biographies

A. A. Sokolov, Kharkiv National University of Radioelectronics

аспірант кафедри біомедичної інженерії

O. G. Avrunin, Kharkiv National University of Radio Electronics!

д.т.н., професор,  завідувач кафедри біомедичної інженерії

References

World Health Organization: WHO. (2018, October 11). Blindness and vision impairment. Who.int; World Health Organization: WHO. https://www.who.int/en/news-room/fact-sheets/detail/blindness-and-visual-impairment

The blind among the blind. Inc.kiev.ua. Retrieved November 30, 2023, from https://inc.kiev.ua/index.php/statti/41-nezryachi-sered-slipikh

Dunai, L., Peris-Fajarnés, G., Lluna, E., & Defez, B. (2013). Sensory Navigation Device for Blind People. Journal of Navigation, 66(3), 349–362. https://doi.org/10.1017/s0373463312000574

4. Avrunin, O., & Bel'aninova, G. (2023). STRONG HEALTH and WELL-BEING are NURE'S PRIORITY. Grail of Science, 28, 83–87. https://doi.org/10.36074/grail-of-science.09.06.2023.11

Kolisnyk, K., Deineko, D., Sokol, T., Kutsevlyak, S., & Avrunin, O. (2019, October 1). Application of Modern Internet Technologies in Telemedicine Screening of Patient Conditions. IEEE Xplore. https://doi.org/10.1109/PICST47496.2019.9061252

Селиванова, К. Г., Maksym Tymkovych, & Maksym Tymkovych. (2021). Conception of a Mixed Reality Eyesight Training System Based on the Parallel Robot. https://doi.org/10.1109/picst54195.2021.9772244

Makarov, A. (n.d.). Augmented Reality Development: Technology, Tools, Devices. MobiDev. Retrieved November 30, 2023, from https://mobidev.biz/blog/augmented-reality-development-guide

AR-based Indoor Navigation. (2021, April 8). Grid Dynamics Blog. https://blog.griddynamics.com/ar-based-indoor-navigation/

OpenCV: Depth Map from Stereo Images. (n.d.). Docs.opencv.org. Retrieved November 30, 2023, from https://docs.opencv.org/3.1.0/dd/d53/tutorial_py_depthmap.html

Lepetit, V., Moreno-Noguer, F., & Fua, P. (2008). EPnP: An Accurate O(n) Solution to the PnP Problem. International Journal of Computer Vision, 81(2), 155–166. https://doi.org/10.1007/s11263-008-0152-6

Xiao-Shan Gao, Xiao-Rong Hou, Jianliang Tang, & Hang-Fei Cheng. (2003). Complete solution classification for the perspective-three-point problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(8), 930–943. https://doi.org/10.1109/tpami.2003.1217599

Collins, T., & Bartoli, A. (2014). Infinitesimal Plane-Based Pose Estimation. International Journal of Computer Vision, 109(3), 252–286. https://doi.org/10.1007/s11263-014-0725-5

Szeliski, R. (2022). Computer Vision: Algorithms and Applications, 2nd ed. Szeliski.org. Retrieved November 30, 2023, from https://szeliski.org/Book/

Ahmad, N., Ghazilla, R. A. R., Khairi, N. M., & Kasi, V. (2013). Reviews on Various Inertial Measurement Unit (IMU) Sensor Applications. International Journal of Signal Processing Systems, 256–262. https://doi.org/10.12720/ijsps.1.2.256-262.

Accueil. (n.d.). NOMADe. Retrieved November 30, 2023, from https://nomadeproject.eu/

May 2022 (ARCore SDK version 1.31) changes to Depth. (n.d.). Google for Developers. https://developers.google.com/ar/develop/depth/changes

Motola-Barnes, M. (). Haptic Actuators: Comparing Piezo to ERM and LRA. Blog.piezo.com. https://blog.piezo.com/haptic-actuators-comparing-piezo-erm-lra

A. Sokolov, O. Avrunin and A. Sokolov, "Theoretical Foundations for Designing Portable Systems for Oriented Blind People," 2022 IEEE 9th International Conference on Problems of Infocommunications, Science and Technology (PIC S&T), Kharkiv, Ukraine, 2022, pp. 379-382, doi: 10.1109/PICST57299.2022.10238588.

Zhang, X., Yao, X., Zhu, Y., & Hu, F. (2019). An ARCore Based User Centric Assistive Navigation System for Visually Impaired People. Applied Sciences, 9(5), 989. https://doi.org/10.3390/app9050989

Sokolov A. A. Peculiarities of spatial perception in training systems / A. A. Sokolov, O. G. Avrunin // Aviation, industry, society: materials of the 4th International. science and practice conf. (Kremenchuk, May 18, 2023) / Ministry of Internal Affairs of Ukraine, Kharkiv National University of Internal Affairs affairs, Kremenchuts. Flight College, Science Park "Science and Safety". - Kharkiv: KhNURE, 2023. - P. 358-361.

Lu, F., Zhou, H., Guo, L., Chen, J., & Pei, L. (2021). An ARCore-Based Augmented Reality Campus Navigation System. Applied Sciences, 11(16), 7515. https://doi.org/10.3390/app11167515.

Kukharchuk, Vasyl V., Sergii V. Pavlov, Volodymyr S. Holodiuk, Valery E. Kryvonosov, Krzysztof Skorupski, Assel Mussabekova, and Gaini Karnakova. 2022. "Information Conversion in Measuring Channels with Optoelectronic Sensors" Sensors 22, no. 1: 271. https://doi.org/10.3390/s22010271

Sergey I. Vyatkin, Olexander N. Romanyuk, Sergii V. Pavlov, and etc. "A function-based approach to real-time visualization using graphics processing units", Proc. SPIE 11581, Photonics Applications in Astronomy, Communications, Industry, and High Energy Physics Experiments 2020, 115810E (14 October 2020); https://doi.org/10.1117/12.2580212.

Leonid I. Timchenko, Natalia I. Kokriatskaia, Sergii V. Pavlov, and etc. "Q-processors for real-time image processing", Proc. SPIE 11581, Photonics Applications in Astronomy, Communications, Industry, and High Energy Physics Experiments 2020, 115810F (14 October 2020); https://doi.org/10.1117/12.2580230

Wójcik, W., Pavlov, S., Kalimoldayev, M. (2019). Information Technology in Medical Diagnostics II. London: Taylor & Francis Group, CRC Press, Balkema book. – 336 Pages, https://doi.org/10.1201/ 9780429057618. eBook ISBN 9780429057618.

Pavlov S. V. Information Technology in Medical Diagnostics //Waldemar Wójcik, Andrzej Smolarz, July 11, 2017 by CRC Press - 210 Pages. https://doi.org/10.1201/9781315098050. eBook ISBN 9781315098050.

Pavlov Sergii, Avrunin Oleg, Hrushko Oleksandr, and etc. System of three-dimensional human face images formation for plastic and reconstructive medicine // Teaching and subjects on bio-medical engineering Approaches and experiences from the BIOART-project Peter Arras and David Luengo (Eds.), 2021, Corresponding authors, Peter Arras and David Luengo. Printed by Acco cv, Leuven (Belgium). - 22 P. ISBN: 978-94-641-4245-7.

Downloads

Abstract views: 55

Published

2023-12-13

How to Cite

[1]
A. A. Sokolov and O. G. Avrunin, “Prospects of using augmented reality technologies in the development of navigation tools for the blind”, Опт-ел. інф-енерг. техн., vol. 46, no. 2, pp. 55–63, Dec. 2023.

Issue

Section

OptoElectronic/Digital Methods and Systems for Image/Signal Processing

Metrics

Downloads

Download data is not yet available.