Scientific publications and patents

V. M. Ivanov, S. V. Strelkov, D. A. Gulyaev, D. S. Godanyuk, I. A. Savvina, D. V. Ryzhkova, E. D. Sologub, A. Yu. V. Rutkovsky Development of medical navigation systems based on augmented reality technologies // Conference “Preventive and Clinical Medicine 2021”, dedicated to the 10th anniversary of the formation of the North-Western State Medical University named after I.I. Mechnikov, October 13-14, 2021 in St. Petersburg.

A method of preparing and performing head surgery using mixed reality from 08/31/2021.

Priority of invention from 06.10.

Ivanov V.M, Krivtsov A.M, Strelkov S.V, Kalakutskiy N.V, Yaremenko A.I. Designing an Adjustable Head Frame for Surgery Using Mixed Reality Technology Hololens 2 // Biomedical Journal of Scientific  & Technical Research |  38(5) – 2021. BJSTR. MS.ID.006212. p. 30736-30739

Positioning holograms during surgery is a major challenge when using mixed reality as the primary navigation tool. This article provides an overview of the developed adjustable frame that acts as a marker holder for mixed reality. This frame allows the technology to be applied in large quantities without the need to manufacture individual systems for each patient.

A. V. Lysenko, A. Ya. Razumova, A. I. Yaremenko, V. M. Ivanov, S. V. Strelkov Application of augmented reality technology in surgical interventions on the upper jaw. Clinical case // Institute of Dentistry No. 3 (92), 2021, pp.30-32 (RUSSIAN)

The aim of this study was to study the potential of intraoperative use of augmented reality technology in the treatment of an odontogenic cyst of the upper jaw.

Ivanov V.M., Krivtsov A.M., Strelkov S.V., Kalakutskiy N.V., Yaremenko A.I.; Petropavlovskaya M.Yu., Portnova M.N., Lukina O.V., Litvinov A.P. Intraoperative use of mixed reality technology in median neck and branchial cyst excision // Future Internet 2021, 13(8), 214; https://doi.org/10.3390/fi13080214 (Scopus)

The paper considers the possibilities, prospects, and drawbacks of the mixed reality (MR) technology application using mixed reality smartglasses Microsoft HoloLens 2. The main challenge was to find and develop an approach that would allow surgeons to conduct operations using mixed reality on a large scale, reducing the preparation time required for the procedure and without having to create custom solutions for each patient. Research was conducted in three clinical cases: two median neck and one branchial cyst excisions. In each case, we applied a unique approach of hologram positioning in space based on mixed reality markers. As a result, we listed a series of positive and negative aspects related to MR surgery, along with proposed solutions for using MR in surgery on a daily basis.

A marker holder for mixed reality head surgery.

Priority from 06.10.

Program for visualization of anatomical structures in the form of holograms and their positioning in space.

Date of state registration in the register of computer programs 03/16/2021

Ivanov, V.; Krivtsov, A.; Strelkov, S.; Gulyaev, D.; Godanyuk, D.; Kalakutsky, N.; Pavlov, A.; Petropavloskaya, M.; Smirnov, A.; Yaremenko, A. Surgical navigation systems based on augmented reality technologies. arXiv, 2021; arXiv:2106.00727 (Scopus)

This study considers modern surgical navigation systems based on augmented reality technologies. Augmented reality glasses are used to construct holograms of the patient’s organs from MRI and CT data, subsequently transmitted to the glasses. This, in addition to seeing the actual patient, the surgeon gains visualization inside the patient’s body (bones, soft tissues, blood vessels, etc.). The solutions developed at Peter the Great St. Petersburg Polytechnic University allow reducing the invasiveness of the procedure and preserving healthy tissues. This also improves the navigation process, making it easier to estimate the location and size of the tumor to be removed.

Vladimir Ivanov, Nikolay Kalakutskiy, Alexander Klygach, Sergey Strelkov. (2020). Superimposed anatomical structures in augmented reality. 3C Tecnología. Glosas de innovación aplicadas a la pyme. Edición Especial, Noviembre 2020, 21-31. 

The paper considers an approach to visualization of anatomical structures using augmented reality, which allows for more accurate planning of operations and reduces the degree of surgical intervention.

Ivanov, A.Klygach, S.Strelkov, S.Varzin Creating realistic 3d visualization of operation scene for open surgery with haptics feedback // The 22nd Multi-conference on Systems, Cybernetics and Informatics: WMSCI 2018, Orlando, USA, 2018, 3p.