Abstract
Machine learning methods for automatic classification problems using computational geometry are considered. Classes are defined by convex hulls of sets of points in a multidimensional feature space. The classification algorithms based on the evaluation of the proximity of a test point to the convex hulls of classes are examined. A new method for proximity evaluation based on linear programming is proposed. The corresponding nearest convex hull classifier is described. The results of experimental studies on real problems of medical diagnostics are presented. The comparison of the effectiveness of the proposed classifier with the classifiers of other types has shown a sufficiently high efficiency of the proposed method for proximity evaluation based on linear programming.
Similar content being viewed by others
REFERENCES
G. Ostrouchov and N. F. Samatova, “On FastMap and the convex hull of multivariate data: Toward fast and robust dimension reduction,” IEEE Trans. Pattern Anal. Mach. Intell. 27 (8), 1340–1343 (2005). https://doi.org/10.1109/TPAMI.2005.164
A. P. Nemirko, “Multidimensional data visualization based on the minimum distance between convex hulls of classes,” Pattern Recognit. Image Anal. 28 (4), 712–719 (2018). https://doi.org/10.1134/S1054661818040247
G. Nalbantov and E. Smirnov, “Soft nearest convex hull classifier,” in Proc. 19th European Conference on Artificial Intelligence (ECAI-2010), Ed. by H. Coelho et al. (IOS Press, 2010), pp. 841–846. https://doi.org/10.3233/978-1-60750-606-5-841
X. Zhou and Y. Shi, “Nearest neighbor convex hull classification method for face recognition,” in Computational Science – ICCS 2009, Ed. by G. Allen et al. (Springer, 2009), pp. 570–577. https://doi.org/10.1007/978-3-642-01973-9_64.
J. Qing, H. Huo, and T. Fang, “Nearest convex hull classifiers for remote sensing classification,” Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 37, 589–594 (2008).
A. P. Nemirko, “Lightweight nearest convex hull classifier,” Pattern Recognit. Image Anal. 29 (3), 360–365 (2019). https://doi.org/10.1134/S1054661819030167
F. Theljani, K. Laabidi, S. Zidi, and M. Ksouri, “Convex hull based clustering algorithm,” Int. J. of Artif. Intell. 10, 51–70 (2013).
J. H. Dulá and R. V. Helgason, “A new procedure for identifying the frame of the convex hull of a finite collection of points in multidimensional space,” Eur. J. Oper. Res. 92 (2), 352–367 (1996). https://doi.org/10.1016/0377-2217(94)00366-1
R. L. Graham, “An efficient algorithm for determining the convex hull of a finite planar set,” Inf. Proc. Lett. 1, 132–133 (1972).
A. Jarvis, “On the identification of the convex hull of a finite set of points in the plane,” Inf. Proc. Lett. 2, 18–21 (1973).
T. M. Chan, “Output-sensitive construction of convex hulls,” PhD Thesis (Univ. of British Columbia, 1995).
C. B. Barber, D. P. Dobkin, and H. Huhdanpaa, “The quickhull algorithm for convex hulls,” ACM Trans. Math. Software 22 (4), 469–483 (1996). https://doi.org/10.1145/235815.235821
V. N. Vapnik, Statistical Learning Theory (Wiley, New York, 1998).
K. P. Bennett and E. J. Bredensteiner, “Duality and geometry in SVM classifiers,” in Proc. 17th Int. Conf. Mach. Learn. (2000), pp. 57–64.
V. Franc and V. Hlavác, “An iterative algorithm learning the maximal margin classifier,” Pattern Recognit. 36 (9), 1985–1996 (2003).
B. F. Mitchell, V. F. Demyanov, and V. N. Malozemov, “Finding the point of a polyhedron closest to the origin,” SIAM J. Control 12, 19–26 (1974).
R. Weller, New Geometric Data Structures for Collision Detection and Haptics (Springer, 2013). https://doi.org/10.1007/978-3-319-01020-5
M. C. Lin, D. Manocha, and Y. J. Kim, “Collision and proximity queries,” in Handbook of Discrete and Computational Geometry, Ed. by J. E. Goodman, J. O’Rourke, and C. D. Tóth, 3rd ed. (CRC Press, Boca Raton, FL, 2018), pp. 1029–1056.
Breast Cancer Wisconsin (Original) Data Set. UCI Machine Learning Repository. https://archive.ics.uci.edu/ml/datasets/breast+cancer+wisconsin+(original).
R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification (John Wiley & Sons, New York, 2001).
Funding
This study was supported in part by the Russian Foundation for Basic Research, project nos. 19-29-01009 and 18-29-02036.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
The authors declare that they have no conflicts of interest. This article does not contain any studies involving animals or human participants performed by any of the authors.
Additional information
Anatoly Pavlovich Nemirko. Graduated from St. Petersburg Electrotechnical University LETI in 1967. Since 1986, has worked as a professor at the Department of Bioengineering Systems at the same university. Received doctoral degree in 1986 and professor degree in 1988. Scientific interests: pattern recognition, processing and analysis of biomedical signals, intelligent biomedical systems. Author of more than 300 scientific publications including 90 papers and five monographs. Board member of the International Association of Pattern Recognition and member of the editorial board of the journal Pattern Recognition and Image Analysis.
José H. Dulá. B.S.E. and Ph.D. from the University of Michigan in 1980 and 1986 with a M.Sc. from Stanford University in 1981. He is currently Professor of Operations Management at the University of Alabama having been previously at Virginia Commonwealth University until 2018. He works primarily in operations research topics, more specifically in optimization, computational geometry, data envelopment analysis and, more recently, machine learning. He is an author in Operations Research, Mathematical Programming, INFORMS Journal on Computing, European Journal of Operational Research, among others. He is associate editor for the International Transactions of OR and Journal of Productivity Analysis.
Rights and permissions
About this article
Cite this article
Nemirko, A., Dulá, J.H. Nearest Convex Hull Classification Based on Linear Programming. Pattern Recognit. Image Anal. 31, 205–211 (2021). https://doi.org/10.1134/S1054661821020139
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1054661821020139