Abstract
Apart from machine learning and knowledge engineering, there is a third way of challenging machine vision – the Gestalt-law school. In an interdisciplinary effort between psychology and cybernetics, compositionality in perception has been studied for at least a century along these lines. Hierarchical compositions of parts and aggregates are possible in this approach. This is particularly required for high-quality high-resolution imagery becoming more and more common, because tiny details may be important as well as large-scale interdependency over several thousand pixels distance. The contribution at hand studies the depth of Gestalt-hierarchies in typical social image genres—portraits and group pictures—exemplarily, and outlines technical means for their automatic extraction. The practical part applies bottom-up hierarchical Gestalt grouping as well as top-down search focusing and constraint enforcement, listing as well success as failure. In doing so, the paper discusses exemplarily the depth and nature of such compositions in imagery relevant to human beings.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk, “SLIC superpixels compared to state-of-the-art superpixel methods,” IEEE Trans. Pattern Anal. Mach. Intell. 34 (11), 2274–2281 (2012).
V. S. Chen, P. Varma, R. Krishna, M. Bernstein, C. Re, and L. Fei-Fei, “Scene graph prediction with limited labels,” in ICCV 2019 (2019). arXiv:1904.11622
A. Desolneux, L. Moisan, and J.-M. Morel, From Gestalt Theory to Image Analysis: A Probabilistic Approach (Springer, Heidelberg, 2008).
C. Funk, S. Lee, M. R. Oswald, S. Tsokas, W. Shen, A. Cohen, S. Dickinson, and Y. Liu, “2017 ICCV Challenge: Detecting symmetry in the wild,” in ICCV 2017, Workshops (Venice, 2017).
J. Liu, G. Slota, G. Zheng, Z. Wu, M. Park, S. Lee, I. Rauschert, and Y. Liu, “Symmetry detection from Real-World Images Competition 2013: Summary and results,” in CVPR 2013, Workshops (Portland, 2013).
G. J. Loy and J. Eklundh, “Detecting symmetry and symmetric constellations of features,” in ECCV 2006: Computer Vision – ECCV 2006 (2006), pp. 508–521.
T. Matsuyama and V. S.-S. Hwang, SIGMA, A Knowledge-Based Aerial Image Understanding System (Springer, Heidelberg, 1990).
E. Michaelsen, “On the depth of gestalt hierarchies in common imagery,” in Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021; Lecture Notes in Computer Science, Ed. by A. Del Bimbo et al. (Springer, Cham, 2021), Vol. 1266. https://doi.org/10.1007/978-3-030-68821-9_3.
E. Michaelsen and J. Meidow, Hierarchical Perceptual Grouping for Object Recognition (Springer, Heidelberg, 2019).
E. Michaelsen and J. Meidow, “Design of orientation assessment functions for gestalt-grouping utilizing labeled sample-data,” in PIA 2019+MRSS 2019, ISPRS, 2019 (ISPRS Archives XLII-2/W16) (2019), pp. 169–173.
E. Michaelsen, D. Muench, and M. Arens, “Recognition of symmetry structure by use of gestalt algebra,” in CVPR-2013 Workshop Symmetry from Real World Images, a Competition (Portland, Oregon, 2013).
E. Michaelsen, D. Muench, and M. Arens, “Searching remotely sensed images for meaningful nested Gestalten,” in XXIII ISPRS Congress 2016, ISPRS, 2016 (ISPRS Archives XLI-B3) (2016), pp. 899–903.
E. Michaelsen and U. Soergel, “Reconstructing lattices from permanent scatterers on facades,” in 10th IAPR Workshop on Pattern Recognition in Remote Sensing, PRRS 2018 (IEEE, Piscataway, NJ, 2018).
E. Michaelsen and S. Vujasinovic, “Estimating efforts and success of symmetry-seeing machines by use of synthetic data,” Symmetry 11 (2) (2019).
D. Mumford and A. Desolneux, Pattern Theory (CRC Press, Natick, MA, 2010).
H. Niemann, Pattern Analysis and Understanding (Springer, Heidelberg, 1990).
V. Patraucean, von R. G. Gioi, and M. Ovsjanikov, “Detection of mirror–symmetric image patches,” in CVPR-2013 Workshop Symmetry from Real World Images, a Competition (Portland, Oregon, 2013).
Z. Pizlo, Y. Li, T. Sawada, and R. M. Steinman, Making a Machine That Sees Like Us (Oxford Univ. Press, Oxford, 2014).
A. Rosenfeld, Picture Languages (Academic Press, New York, 1979).
M. Wertheimer, “Untersuchungen zur Lehre der Gestalt,” Psychol. Forsch. 4, 301–350 (1923).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
COMPLIANCE WITH ETHICAL STANDARDS
This manuscript is a completely original work of its authors; it has not been published before and will not be published in other sources.
CONFLICT OF INTEREST
The content of the article does not give grounds for raising the issue of a conflict of interest.
Additional information
Eckart Michaelsen graduated from the University of Innsbruck (Austria) in 1987 with Diploma on Mathematics. In 1998 he received Dr. Ing. from the University of Erlangen working on syntactic methods of pattern recognition. He works as Researcher for Fraunhofer-IOSB in Ettlingen, Germany. He held the chair of IAPR Technical Committee TC7 (pattern recognition in remote sensing and mapping) between 2014 and 2018. He is Area Editor of Pattern Recognition Letters. He published one monograph and about 100 peer-reviewed papers mostly on Gestalt perception in machine vision and knowledge-based analysis of remotely sensed images. He is member of program committees for conferences such as ICPR, IGARS, ISPRS, etc.
Rights and permissions
About this article
Cite this article
Michaelsen, E. Explorations on the Depth of Gestalt Hierarchies in Social Imagery. Pattern Recognit. Image Anal. 31, 539–550 (2021). https://doi.org/10.1134/S1054661821030160
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1054661821030160