Methods and software for capturing three-dimensional digital images using spatial demodulation

Authors

  • V. M. Borovytsky National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”
  • О. E. Gudz National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”

DOI:

https://doi.org/10.31649/1681-7893-2023-45-1-17-26

Keywords:

digital image processing, three-dimensional digital image, spatial modulation of illumination, optical microscope, demodulation

Abstract

The paper proposes the generalized technique of demodulation, which can be applied for capturing digital three-dimensional images in optical microscopes. This technique allows the calculation of the contrast of harmonic spatial modulation with any values of phase angles. The input data is a stack of digital images with harmonic spatial modulation. Three digital images with different phases of modulation captured in the same focus position are processed to get one data set about the contrast distribution. This data makes it possible to compose the three-dimensional images by the selection of the maximal values of the contrast in three-dimensional space. The paper contains the analytical solution of the system with three linear equations that helps to identify the principal parameters of harmonic spatial modulation, including its average value and contrast. As a result, the expression for contrast calculation is present in an analytical form. This expression is valid for any modulation phase angles that do not coincide. The paper contains MathCAD modeling, which illustrates the procedure of composing the three-dimensional images.

The modeling confirms the correctness of described calculations and demonstrates the built of the three-dimensional surface image as a composition of the contrast distribution map and the corresponded height map. The advantage of the proposed technique is the possibility to apply the economical units for the formation of a harmonious spatial modulation. These units can be installed on most optical microscopes with digital cameras and motorized focusing drives without purchasing expensive commercial software. It significantly reduces the price of transforming these optical microscopes into instruments for capturing digital three-dimensional images.

Author Biography

V. M. Borovytsky, National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”

д.т.н., професор кафедри комп’ютерно-інтегрованих оптичних та навігаційних систем приладобудівного факультету

References

J. Mertz. Introduction to Optical Microscopy. 2th ed. Cambridge: Cambridge University Press; 2019.

J. T. Frohn Super-Resolution Fluorescence Microscopy by Structured Light Illumination: dissertation … Doctor of technical sciences. Zurich: Jan Tillman Frohn; 2000. 43 p.

T. Wilson, C. J. R. Sheppard. “Theory and Practice of Scanning Optical Microscopy”. London: Academic Press; 1984.

A. Weigel. “Resolution in the ApoTome and the confocal laser scanning microscope: comparison”. Journal of Biomedical Optics, vol. 14(1) 2009; 014022: 8-1.

A. Mazhar. “Structured illumination enhances resolution and contrast in thick tissue fluorescence imaging”. Journal of Biomedical Optics, vol. 15(1) 2010; 014022: 3-1.

V. Borovytsky. “Digital optical microscope as a sampled imaging system: mathematical description, camera selection and focusing”. Proceedings of the SPIE 8486, Current Developments in Lens Design and Optical Engineering XIII; 2012 Oct 11; San Diego, United States.

Available from: https://www.spiedigitallibrary.org/conference-proceedings-of-spie/8486/1/Digital-optical-microscope-as-a-sampled-imaging-system--mathematical/10.1117/12.928955.full

M. A. A. Neil, R. Juskaitis, T. Wilson. “Method of obtaining optical sectioning using structured light in a conventional microscope”. Optics Letters, vol. 22(24) 1997; 001905: 1907-1905.

L. Schafer, D. Schuster. inventors; “Carl Zeiss Imaging Solutions Jena GmbH, assignee. Methods and devices for images processing with higher harmonics of an illumination grating”. United States patent US 20080069467. 2008 Mar 20.

D. Arbuckle. inventor; “Quorum technologies Inc., assignee. Projection device for patterned illumination and microscopy”. United States patent US 2009 0147354 A1. 2009 Jul 11.

H. Nakayama, Y. Ouchi, inventors; “Nikon corporation, assignee. Structured illumination device and structured illumination microscope device”. United States patent US 2009 0147354 A1. 2018 Feb 20.

V. Gerstner, F. Hecht, R. Lange, H. Bloos inventors; Carl Zeiss Jena GmbH, assignee. Assembly for increasing the depth discrimination of an optical imaging system. United States patent US 6 819 415 B2. 2004 Nov 16.

V. M. Borovytsky, V. I. Mykytenko, О. Ye. Hudz. Generalized demodulation technique for obtaining three-dimentional digital images and its software implementation. Bulletin of the Cherkasy State Technological University vol. 4 2021; 252780: 53-45.

V. M. Borovytsky, О. Ye. Hudz, S. Tuzhansky. “Method of calculation of the point spread function of an optical system”. Optical-electronic information and energy technologies, vol. 1(41) 2021; p. 69-77.

Z. Bian, C, Guo, S, Jiang, editors. “Autofocusing technologies for whole slide imaging and automated microscopy”. Journal Biophotonics vol. 13 2020.

Available from: https://doi.org/10.1002/jbio.202000227

Olympus Life Science Europe GmbH. Olympus OptiGrid M; 2009.

Available from: https://www.lri.se/pdf/olympus/optigridM.pdf

ZEISS Apotome 3: Product Info. Carl Zeiss Microscopy GmbH 2020;

Available from: https://asset-downloads.zeiss.com/catalogs/download/mic/e3af6c29-7d61-4cee-a563-6095486fb89a/EN_product-info_Apotome3_rel2-0.pdf

Olexander N. Romanyuk, Sergii V. Pavlov, and etc. "A function-based approach to real-time visualization using graphics processing units", Proc. SPIE 11581, Photonics Applications in Astronomy, Communications, Industry, and High Energy Physics Experiments 2020, 115810E (14 October 2020); https://doi.org/10.1117/12.2580212.

Downloads

Abstract views: 86

Published

2023-09-28

How to Cite

[1]
V. M. Borovytsky and Gudz О. E., “Methods and software for capturing three-dimensional digital images using spatial demodulation”, Опт-ел. інф-енерг. техн., vol. 45, no. 1, pp. 17–26, Sep. 2023.

Issue

Vol. 45 No. 1 (2023)

Section

OptoElectronic/Digital Methods and Systems for Image/Signal Processing

Metrics

Downloads

Download data is not yet available.

License

Автори, які публікуються у цьому журналі, погоджуються з наступними умовами:

  1. Автори залишають за собою право на авторство своєї роботи та передають журналу право першої публікації цієї роботи на умовах ліцензії Creative Commons Attribution License, котра дозволяє іншим особам вільно розповсюджувати опубліковану роботу з обов'язковим посиланням на авторів оригінальної роботи та першу публікацію роботи у цьому журналі.
  2. Автори мають право укладати самостійні додаткові угоди щодо неексклюзивного розповсюдження роботи у тому вигляді, в якому вона була опублікована цим журналом (наприклад, розміщувати роботу в електронному сховищі установи або публікувати у складі монографії), за умови збереження посилання на першу публікацію роботи у цьому журналі.
  3. Політика журналу дозволяє і заохочує розміщення авторами в мережі Інтернет (наприклад, у сховищах установ або на особистих веб-сайтах) рукопису роботи, як до подання цього рукопису до редакції, так і під час його редакційного опрацювання, оскільки це сприяє виникненню продуктивної наукової дискусії та позитивно позначається на оперативності та динаміці цитування опублікованої роботи (див. The Effect of Open Access).