Skip to main content
SpringerLink
Log in

Intelligent System for Planning Group Actions of Unmanned Aircraft in Observing Mobile Objects on the Ground in the Specified Area

  • SYSTEMS ANALYSIS AND OPERATIONS RESEARCH
  • Published:
Journal of Computer and Systems Sciences International Aims and scope

Abstract

The multicriteria task of preflight and operational planning of group actions of unmanned aerial vehicles (UAVs), taking into account the required service schedule, is considered. A minimax criterion for the operational planning of group actions when the dynamic situation changes is proposed. The shape of the expert system for controlling the duration of observation during the search and detection of ground objects is formed. The obtained results of assessing the quality of the solution to the subproblem of neural network recognition of mobile objects based on deep learning confirm the effectiveness of the proposed approach in monitoring the controlled area.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.

Similar content being viewed by others

REFERENCES

  1. A. V. Levitin, Algorithms. Introduction to Development and Analysis (Vil’yams, Moscow, 2006) [in Russian].

    Google Scholar 

  2. M. A. Andreev, A. B. Miller, B. M. Miller, and K. V. Stepanyan, “Path planning for unmanned aerial vehicle under complicated conditions and hazards,” J. Comput. Syst. Sci. Int. 51, 328 (2012).

    Article  MathSciNet  Google Scholar 

  3. F. Kamrani, M. G. Lozano, and R. Ayani, “Path planning for UAVs using symbiotic simulation,” in Proceedings of the 20th Annual European Simulation and Modelling Conference, ESM'2006, Toulouse, France, 2006, pp. 215–238.

  4. G. G. Sebryakov, M. N. Krasil’shchikov, and V. N. Evdokimenkov, “Algorithmic and software-mathematical support of the pre-flight planning of group actions of unmanned aerial vehicles,” in Fundamental Problems of Group Interaction of Robots: Materials of the RFBR Reporting Event “ofi-m” (Theme 604) in the Framework of the International Scientific and Practical Conference, Volgograd, 2018, pp. 30–32.

  5. R. Zhu and D. Sun, “CooperaTion strategy of unmanned air vehicles for MultitaRget interception,” J. Guidance 28, 1068–1076 (2005). https://doi.org/10.2514/1.14412

    Article  Google Scholar 

  6. V. N. Evdokimenkov, M. N. Krasilshchikov, and D. A. Kozorez, “Development of pre-flight planning algorithms for the functional-program prototype of a distributed intellectual control system of unmanned flying vehicle groups,” INCAS Bull. 11, 75–88 (2019). https://doi.org/10.13111/2066-8201.2019.11.S.8

    Article  Google Scholar 

  7. G. N. Lebedev and A. V. Rumakina, “The unmanned flying vehicle route planning of multi-elevational flight using neural networks,” Aviakosm. Priborostr., No. 5, 3–8 (2014).

  8. G. Lebedev, V. Goncharenko, D. Mikhaylin, and A. Rumakina, “Aircraft group coordinated flight route optimization using branch-and-bound procedure in resolving the problem of environmental monitoring,” ITM Web of Conf. 10, 1003 (2017). https://doi.org/10.1051/itmconf/20171001003

  9. V. I. Goncharenko, G. N. Lebedev, D. A. Mikhaylin, and G. F. Khahulin, “Continuous flight safety management information system for a group of converging aircraft,” Russ. Aeronaut. 61, 271–278 (2018).

    Article  Google Scholar 

  10. V. I. Goncharenko, G. N. Lebedev, and D. A. Mikhailin, “Online two-dimensional route planning for a group of unmanned aerial vehicles,” J. Comput. Syst. Sci. Int. 58, 147 (2019).

    Article  Google Scholar 

  11. G. N. Lebedev and L. A. Mirzoyan, “Routing of the flight of the FLA, taking into account its dynamics when observing fixed ground objects,” Mekhatron., Avtomatiz., Upravl., No. 12, 24–28 (2011).

  12. G. N. Lebedev and A. V. Efimov, “Application of dynamic programming for path planning for observation of mobile ground targets in the controlled area,” Tr. SGAU, No. 1, 63–70 (2012).

    Google Scholar 

  13. V. I. Merkulov and A. S. Plyashechnik, “Estimation of threat level of targets by their possibility of interception,” Inform.-Izmerit. Upravl. Sist. 16 (5), 3–9 (2018).

    Google Scholar 

  14. V. I. Merkulov and A. S. Plyashechnik, “Simplified target assignment problem for group engagement of aircraft,” Autom. Remote Control 80, 490 (2017).

    Article  Google Scholar 

  15. G. N. Lebedev and L. A. Mirzoyan, “Neuron net planning of group of vehicles actions at their flying around of ground-based objects,” Aviakosm. Priborostr., No. 12, 34–40 (2005).

  16. G. N. Lebedev, L. A. Mirzoyan, and A. V. Efimov, “Neural network planning of the group action of aerial vehicles at observation of the moving ground targets,” Mekhatron. Avtomatiz. Upravl., No. 11, 60–65 (2009).

  17. D. A. Mikhailin, N. V. Allilueva, and E. M. Rudenko, “Comparative analysis of the effectiveness of genetic algorithms the routing of the flight, taking into account their different computational complexity and multicriteria tasks,” Tr. MAI, No. 98, 22 (2018).

    Google Scholar 

  18. N. D. Ivashova, D. A. Mikhailin, M. E. Chernyakova, and S. V. Shanygin, “Neural network solution of the operational planning task for unmanned aerial vehicles route flight and time setting for ground based objects observation employing the fuzzy logic while displaying these results on the computer screen prior to the start,” Tr. MAI, No. 104, 17 (2019).

    Google Scholar 

  19. R. E. Bellman, Dynamic Programming (Dover, New York, 2003).

    MATH  Google Scholar 

  20. G. N. Lebedev and Le Suan Khu, “Displays priority information on the screen when conducting strength tests,” Aviakosm. Priborostr., No. 5, 14–23 (2005).

  21. G. N. Lebedev and A. V. Efimov, “Application of dynamic programming for path planning for observation of mobile ground targets in the controlled area,” Vestn. SGAU, No. 6 (30), 222–229 (2011).

    Google Scholar 

  22. V. I. Goncharenko, G. N. Lebedev, D. A. Mikhailin, and O. Yu. Tsareva, “Choosing a variety of priority surface observation objects with the help of unmanned aerial vehicles and routing their flight,” Vestn. Komp’yut. Inform. Tekhnol., No. 2, 3–12 (2019).

  23. V. I. Goncharenko, G. N. Lebedev, and D. A. Mikhailin, “Flight planning for unmanned aerial vehicle group to detect separate parts of boosters,” Vestn. TGTU 25, 381–394 (2019).

    Article  Google Scholar 

  24. G. N. Lebedev, V. B. Malygin, and D. A. Mikhailin, “Problem setting and solution of the response correction of arrival and departure air traffic flow in the vicinity of the field by means of the genetic algorithm,” Nauch. Vestn. MGTU GA 20 (4), 8–17 (2017).

    Article  Google Scholar 

  25. V. Knyaz, S. Zheltov, G. Lebedev, D. Mikhailin, and V. Goncharenko, “Intelligent mobile object monitoring by unmanned aerial vehicles,” in Proceedings of the IEEE EUROCON’2019 18th International Conference on Smart Technologies. Novi Sad, Serbia, 2019, pp. 1–6. https://doi.org/10.1109/EUROCON.2019.8861575

  26. V. Knyaz and S. Zheltov, “Deep learning object recognition in multi-spectral UAV imagery,” Proc. SPIE 10679, 1067920 (2018). https://doi.org/10.1117/12.2307661

    Article  Google Scholar 

  27. V. Knyaz, “Multimodal data fusion for object recognition,” Proc. SPIE 11059, 198–209 (2019). https://doi.org/10.1117/12.2526067

    Article  Google Scholar 

  28. V. Knyaz, “Recognition of low-resolution objects in remote sensing images,” Proc. SPIE 11155, 594–603 (2019). https://doi.org/10.1117/12.2533315

    Article  Google Scholar 

  29. V. V. Kniaz and V. A. Mizginov, “Thermal texture generation and 3D model reconstruction using SFM and GAN,” in International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (WA, USA, 2018), Vol. XLII-2, pp. 519–524. https://doi.org/10.5194/isprs-archives-XLII-2-519-2018

  30. V. V. Kniaz and V. A. Knyaz, “ThermalGAN: Multimodal color-to-thermal image translation for person re-identication in multispectral dataset,” in Proceedings of the Computer Vision ECCV 2018 Workshops, Ed. by L. Leal-Taixe and S. Roth (Springer Int., WA, 2019), pp. 606–624.

  31. R. Girshick, J. Donahue, T. Darrell, and J. Malik, “Rich feature hierarchies for accurate object detection and semantic segmentation,” in Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 2014, pp. 580–587.

  32. R. Girshick, “Fast R-CNN,” in Proceedings of the 2015 IEEE International Conference on Computer Vision ICCV’15 (IEEE Computer Society, Washington, DC, 2015), pp. 1440–1448. https://doi.org/10.1109/ICCV.2015

  33. S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards real-time object detection with region proposal networks,” in Proceedings of the 28th International Conference on Neural Information Processing Systems NIPS'15 (MIT Press, Cambridge, MA, 2015), Vol. 1, pp. 91–99. http://dl.acm.org/citation.cfmıd=2969239.2969250.

  34. J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition CVPR, Las Vegas, Nevada, US, 2016, pp. 779–788.

  35. W. Liu, D. Anguelov, and D. Erhan, “SSD: Single shot MultiBox detector,” in Proceedings of the Computer Vision—ECCV 2016, Ed. by B. Leibe, J. Matas, N. Sebe, and M. Welling (Springer Int., Cham, 2016), pp. 21–37.

  36. J. Huang, V. Rathod, and C. Sun, “Speed/accuracy trade-offs for modern convolutional object detectors,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition CVPR, Honolulu, Hawaii, US, 2017, pp. 3296–3297.

Download references

Funding

This study was supported by the Russian Foundation for Basic Research (project nos. 17-29-03185 and 20-08-00652).

Author information

Authors and Affiliations

  1. Moscow Aviation Institute (National Research University), Moscow, Russia

    V. I. Goncharenko, G. N. Lebedev & D. A. Mikhaylin

  2. Institute of Control Sciences, Russian Academy of Sciences, Moscow, Russia

    V. I. Goncharenko

  3. Federal State Unitary Enterprise, State Research Institute of Aviation Systems (GosNIIAS), Moscow, Russia

    S. Yu. Zheltov, V. A. Knyaz & O. Yu. Tsareva

  4. Moscow Institute of Physics and Technology (MIPT), Moscow, Russia

    V. A. Knyaz

Authors
  1. V. I. Goncharenko
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Yu. Zheltov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. V. A. Knyaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. G. N. Lebedev
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. D. A. Mikhaylin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. O. Yu. Tsareva
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to V. I. Goncharenko.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goncharenko, V.I., Zheltov, S.Y., Knyaz, V.A. et al. Intelligent System for Planning Group Actions of Unmanned Aircraft in Observing Mobile Objects on the Ground in the Specified Area. J. Comput. Syst. Sci. Int. 60, 379–395 (2021). https://doi.org/10.1134/S1064230721030047

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1064230721030047

Search

Navigation