Abstract
Due to the increasing shortage of fish in the seas, Vessel Monitoring Systems (VMS) play a very important role in fishing activity monitoring, control and surveillance. In this context, the detection of fishing activities in prohibited zones is a critical task. Although position, speed and other information are provided by the VMS system, detecting fishing activities using only this type of information may be rather ineffective. The purpose of this paper is to propose an intelligent video-surveillance system that is able to automatically detect if (and when) fishing activities occur by automatically visually monitoring the vessel activities. After detection, the Control Center would be informed of relevant events and receive visual data through a low-bandwidth, low-cost satellite link to check if illegal activities are effectively being performed. To achieve this goal, the proposed visual monitoring solution adopts a deep-learning approach twice: First, to detect the fishing activities at the vessel, a well-known convolutional neural network designed for image classification is exploited. Second, to enhance at the Control Center the heavily compressed decoded images, transmitted with a low-bandwidth satellite channel, a convolutional neural network suitable for image restoration is also used. The proposed monitoring system follows a new approach for the problem addressed based on image data and can significantly improve the VMS even detection and validation efficiency by exploiting advanced image processing tools, thus helping to ensure the availability and sustainability of fish stocks for generations to come.
Similar content being viewed by others
References
Amabdiyil S, Thomas D, Pillai VPM (2016) “Marine vessel detection comparing GPRS and satellite images for security applications”, international conference on wireless communications. Signal Processing and Networking, Chennai
Bloisi D, Iocchi L, Fiorini M, Graziano G (2011) Automatic maritime surveillance with visual target detection. International Defense and Homeland Security Simulation Workshop, Rome
"FFmpeg - Post Processing Filters," [Online]. Available: https://trac.ffmpeg.org/wiki/Postprocessing. [Accessed 19 February 2018]
Food and Agricultural Organization of the United Nations, “2018 The State of the World Fisheries and Aquaculture” [Online]. Available at: http://www.fao.org/state-of-fisheries-aquaculture [Accessed 06 November 2018]
He K, Zhang X, Ren S, Sun J (2016) “Deep residual learning for image recognition”, IEEE conference on computer vision and pattern recognition. Las Vegas, NV
Hensman P, Masko D (2015) “The impact of imbalanced training data for convolutional neural networks”, in first level degree project in computer science. KTH Royal Institute of Technology, Stockholm
X. Jiang, D. L. Silver, B. Hu, E. N. de Souza, and S. Matwin “Fishing activity Detection from AIS data using autoencoders”, Canadian conference on artificial intelligence, Victoria, Canada, May 2016.
Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Li F-F (2014) “Large-scale video classification with convolutional neural networks”, in computer vision and pattern recognition. Columbus, OH
Krizhevsky A, Sutskever I, Hinton GE (2012) “ImageNet classification with deep convolutional neural networks”, in neural information processing systems. Lake Tahoe, NV
Lucas A, Iliadis M, Molina R, Katsaggelos A (2018) Using deep neural networks for inverse problems in imaging. IEEE Signal Process Mag 35(1):20–36
Marzuki M, Gaspar P, Garello R, Kerbaol V (July 2018) Fishing gear identification from vessel-monitoring-system-based fishing vessel trajectories. IEEE J Ocean Eng 43(3):689–699
P. Perdigão, “Ultra-narrow band satellite visual monitoring of high-sea fishing vessels”, M.Sc. Thesis, Instituto Superior Técnico, Lisbon, Portugal, June 2018.
Rawat W, Wang Z (2017) Deep convolutional neural networks for image classification: a comprehensive review. in Neural Computation 9(8):1735–1780
Richter T (2016) “JPEG on steroids: common optimization techniques for JPEG image compression”, international conference on image processing. Phoenix, AZ
Russakovsky O et al (April 2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252
C. Szegedy and S. Ioffe “Batch normalization: accelerating deep network training by reducing internal covariate shift”, international conference on machine learning, Lille, France, 2015.
M. Tello, C. López-Martínez, and J. J. Mallorqui “A Novel Algorithm for Ship Detection in SAR Imagery Based on the Wavelet Transform”, IEEE Geoscience and Remote Sensing Letters, vol. 2, no. 2, 2005.
"The Common Fisheries Policy," [Online]. Available: https://ec.europa.eu/fisheries/cfp_en [Accessed 23 March 2017].
Wallace GK (1992) The JPEG still picture compression standard. IEEE Trans Consum Electron 38(1):17–34
Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a Gaussian Denoiser: residual learning of deep CNN for image Denoising. IEEE Trans Image Process 26(7):3142–3155
A. Zisserman, K. Simonyan, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” arXiv preprint arXiv:1409.1556, September 2014.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Perdigão, P., Lousã, P., Ascenso, J. et al. Visual monitoring of High-Sea fishing activities using deep learning-based image processing. Multimed Tools Appl 79, 22131–22156 (2020). https://doi.org/10.1007/s11042-020-08949-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-08949-9