Skip to main content
Log in

Analysis of the Dynamical Biological Objects of Optical Microscopy

  • PATTERN RECOGNITION AND IMAGE ANALYSIS MILIEU
  • Published:
Pattern Recognition and Image Analysis Aims and scope Submit manuscript

Abstract

We generalize the experience of the applied and theoretical investigations performed in the last 7‒8 years, including the generated algorithms and procedures for analyzing the behavior of the cells’ population as a system of dynamical objects by using a concept of the integral optical flow. We determine the main types of motion which make it possible to separate the key moments of the motion of cells in the population and describe the stages of the cells’ development and their interaction with each other. In order to describe the motion based on the integral optical flow, we generate maps which make possible to determine the moment at which the state starts to change and classify the main types of motion in the cells’ population: directed motion, aggregation (cells motion towards each other), dispersion (cells’ motion in different directions with respect to the common center), division (formation of several new cells in the place where the old one was), and apoptosis (cell destruction). We develop the algorithms for analyzing cells’ motion by using the integral optical flow. The generated procedure is intended for nondestructively checking the development of the cells’ population and it can be used in automatic systems of cell engineering. The procedure based on integral optical flow analysis and motion maps makes it possible to monitor the development of the cells’ population at the new level by considering the interaction of cells.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.

Similar content being viewed by others

REFERENCES

  1. F. Ascione, “Investigation of cell dynamics in vitro by time lapse microscopy and image analysis,” Chem. Eng. Trans. 38, 517–522 (2014).

    Google Scholar 

  2. S. Huh et al., “Automated mitosis detection of stem cell populations in phase-contrast microscopy images,” IEEE Trans. Med. Imaging 30 (3), 586–596 (2011).

    Article  Google Scholar 

  3. V. G. Panteleev, O. V. Egorova, and E. I. Klykova, Computer Microscopy (Tekhnosfera, Moscow, 2005) [in Russian].

    Google Scholar 

  4. L. Kang et al., “Cell population tracking and lineage construction with spatiotemporal context,” Med. Image Anal. 12, 546–566 (2008).

    Article  Google Scholar 

  5. P. Perner, “Tracking living cells in microscopic images and description of the kinetics of the cells,” Procedia Comput. Sci. 60, 352–361 (2015).

    Article  Google Scholar 

  6. S. L. Kuznetsov and N. N. Mushkambarov, Histology, Cytology, and Embryology: Handbook (Med. Inf. Agenstvo, Moscow, 2012) [in Russian].

    Google Scholar 

  7. G. G. Avtadilov, Medical Morphometry: Manual (Meditsina, Moscow, 1990) [in Russian].

    Google Scholar 

  8. L. Kang et al., “Cell population tracking and lineage construction with spatiotemporal context,” Med. Image Anal. 12, 546–566 (2008).

    Article  Google Scholar 

  9. M. E. Ambӗuhl et al., “High-resolution cell outline segmentation and tracking from phase-contrast microscopy images,” J. Microsc. 245 (2), 161–170 (2012).

    Article  Google Scholar 

  10. F. Ascione, “Investigation of cell dynamics in vitro by time lapse microscopy and image analysis,” Chem. Eng. Trans. 38, 5 (2014).

    Google Scholar 

  11. B. Babenko, M.-H. Yang, and S. Belongie, “Robust object tracking with online multiple instance learning,” IEEE Trans. Pattern Anal. Mach. Intell. 33 (8), 1619–1632 (2011).

    Article  Google Scholar 

  12. J. F. Henriques, R. Caseirio, P. Martins, and J. Batista, “High-speed tracking with kernelized correlation filters,” IEEE Trans. Pattern Anal. Mach. Intell. 37 (3), 583–596 (2015).

    Article  Google Scholar 

  13. Z. Kalal, K. Mikolajczyk, and J. Matas, “Tracking-learning-detection,” IEEE Trans. Pattern Anal. Mach. Intell. 34 (7), 1409–1422 (2012).

    Article  Google Scholar 

  14. Z. Kalal, K. Mikolajczyk, and J. Matas, “Forward-backward error: Automatic detection of tracking failures,” in 20th International Conference on Pattern Recognition (Istanbul, 2010), pp. 2756–2759.

  15. D. S. Bolme, J. R. Beveridge, B. A. Draper, and L. Yui Man, “Visual object tracking using adaptive correlation filters,” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition (San Francisco, CA, 2010), pp. 2544–2550.

  16. A. Lukežič, T. Vojíř, L. Čehovin, J. Zajc, and M. K. Matas, “Discriminative correlation filter with channel and spatial reliability,” Int. J. Comput. Vision 126, (7), 671–688 (2018).

    Article  MathSciNet  Google Scholar 

  17. Yongliang Ma, “An object tracking algorithm based on optical flow and temporal–spatial context,” Cluster Comput. 22 (3) (2019). Accessed August 20, 2019.https://doi.org/10.1007/s10586-017-1487-y

  18. Lukežič, T. Vojíř, L. Čehovin, J. Zajc, and M. K. Matas, “Discriminative correlation filter with channel and spatial reliability,” Int. J. Comput. Vision 126, (7), 671–688 (2018).

    Article  MathSciNet  Google Scholar 

  19. Yongliang Ma, “An object tracking algorithm based on optical flow and temporal–spatial context,” Cluster Comput. 22 (3) (2019). Accessed August 20, 2019.https://doi.org/10.1007/s10586-017-1487-y

  20. O. Nedzvedz, S. Ablameyko, and H. Chen, “Application of the integral optical flow for identification of the cell population motion in the microscopic images,” Central Eur. Res. J. 3 (2), 80–88 (2017).

    Google Scholar 

  21. Ch. Chen, Sh. Ye, H. Chen, O. V. Nedzvedz, and S. V. Ablameyko, “Integral optical flow and its application for monitoring dynamic objects from a video sequence,” J. Appl. Spectrosc. 84 (1), 120–128 (2017).

    Article  Google Scholar 

  22. Huafeng Chen, Shiping Ye, O. Nedzvedz, S. Ablameyko, and Zhican Bai, “Motion maps and their applications for dynamic object monitoring,” Pattern Recognit. Image Anal. 29 (1), 131–143 (2019).

    Article  Google Scholar 

  23. Chaoxiang Chen, Alexander Nedzvedz, Olga Nedzvedz, Shiping Ye, Huafeng Chen, and Sergey Ablameyko, “Determination of blood flow characteristics in eye vessels in video sequence,” Informatica (Ljubljana) 43 (4), 515–525 (2019).

    Google Scholar 

  24. H. Chen, O. Nedzvedz, S. Ye, A. Nedzvedz, and S. Ablameyko, “Dynamic wound changes monitoring in microscopic video sequence by using integral optical flow,” J. Appl. Spectrosc. 86 (3), 435–442 (2019).

    Article  Google Scholar 

  25. O. V. Nedzvedz, S. V. Ablameiko, K. R. Khadzhi-Manich, and A. Savich, “Processing of microscopic images of fibers for the analysis of wood structure,” Zh. Beloruss. Gos. Univ., Ser. Mat. Inf., No. 1, 95–104 (2018).

Download references

Funding

This work is supported by the National High-End Foreign Experts’ Program (GDW20183300463) and Joint Fund of the Zhejiang Natural Science Foundation Committee and Zhejiang Society of Mathematical Medicine (nos. LSY19F010001, LGJ18F020001, LGJ19F020002). This research is supported by the project “Development and research of descriptive methods for analyzing dynamic images in automation diagnostic procedures” funded by the Russian Fund of Fundamental Research (no. 20-57-00025) and the Belarusian Fund of Fundamental Research (no. F18R-218).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to S. Ye, O. Nedzvedz, A. Nedzvedz, T. Ren, H. Chen or S. Ablameyko.

Ethics declarations

CONFLICT OF INTEREST

The authors declare that they have no conflict of interest.

COMPLIANCE WITH STANDARDS OF RESEARCH INVOLVING ANIMALS

This article does not contain any studies involving animals performed by any of the authors.

COMPLIANCE WITH STANDARDS OF RESEARCH INVOLVING HUMANS AS SUBJECTS

This article does not contain any studies involving human participants performed by any of the authors.

Additional information

Shiping Ye. Born in 1967. Professor and Vice President of Zhejiang Shuren University. Graduated from Zhejiang University in 1988. He received his master’s degree in Computer Science and Technology from Zhejiang University in 2003. His scientific interests include the application of computer graphics and images, GIS. Author of more than 70 scientific articles. He has taken part in four research projects and was awarded second prize of Zhejiang Provincial Scientific and Technological Achievement. Two of his teaching research programs won the first and second prize of Zhejiang Provincial Teaching Achievement.

Olga Nedzved. Senior Lecturer at the Department of Medical and Biological Physics of Belarusian State Medical University: teaching interdisciplinary subjects and tutoring student research projects. She has also worked with international students in English. Scientific interests: analysis of medical images, mathematical simulation of medical processes, biophysics, and biophysical education. Author of more than 25 papers in the fields of medical informatics, biophysics, and pedagogy. Languages: Russian, Belarusian, and English.

Alexander Nedzved. Graduated from Belarus State University in 1992. He is Dean of the Faculty of Applied Mathematics and Computer Science of Belarusian State University. He also works at the United Institute of Informatics Problems, Belarussian Academy of Sciences, State University, and Belarusian State Medical University. Member of Belarus Association for Image Analysis and Recognition. Scientific interests: image processing, feature extraction, algorithms of 2D–3D image thinning and segmentation and 3D reconstruction, segmentation of color images, pattern recognition, mathematical morphology, knowledge-based systems, and intelligent software. Author of more than 150 publications.

Tiaojuan Ren. Born in 1965. Professor at Zhejiang Shuren University. Graduated from Zhejiang University in 1987. Senior member of China Electronics Association. Her scientific interests include wireless sensor network technology, image processing. Author of more than 50 academic articles.

Huafeng Chen. Born in 1982. Associate Professor of Zhejiang Shuren University. Graduated from Zhejiang University in 2003. He received his PhD in the field of Earth Exploration and Information Technology at the Institute of Space Information & Technique, Zhejiang University in 2009. His scientific interests include remote sensing image processing, GIS application, image and video processing, multiagent systems. Author of more than 10 academic articles.

Sergey Ablameyko. Born in 1956. He received his DipMath in 1978, PhD in 1984, D.Sc. in 1990, and became a professor in 1992. Rector (President) of Belarusian State University from 2008 to 2017 and Professor since 2017. He is on the Editorial Board of Pattern Recognition and Image Analysis, Supercomputers, and many other international and national journals. He is a Fellow of the International Association for Pattern Recognition, Academician of Belarusian Engineering Academy, Academician of National Academy of Sciences of Belarus; and Academician of the European Academy, Russian Academy of Natural Sciences, Russian Space Academy, and many others. He was the First Vice President of the International Association for Pattern Recognition (IAPR) (2006–2008) and President of the Belarusian Association for Image Analysis and Recognition. He is Chairman of the BSU Academic Council that awards PhD and D.Sc. degrees. He was awarded the State Prize of Belarus (the highest national scientific award) in 2002, Skoryna Belarusian Medal, Russian Award of Friendship, and many other awards. Scientific interests: image analysis, pattern recognition, digital geometry, knowledge-based systems, geographical information systems, and medical imaging. Author of more than 600 publications.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ye, S., Nedzvedz, O., Nedzvedz, A. et al. Analysis of the Dynamical Biological Objects of Optical Microscopy. Pattern Recognit. Image Anal. 31, 172–184 (2021). https://doi.org/10.1134/S1054661821010168

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1054661821010168

Keywords:

Navigation