Skip to main content
SpringerLink
Log in

Exploiting complexity in pen- and touch-based signature biometrics

  • Original Paper
  • Published:
International Journal on Document Analysis and Recognition (IJDAR) Aims and scope Submit manuscript

Abstract

Biometric signature verification has been traditionally performed in pen-based office-like scenarios using devices specifically designed for acquiring handwriting. However, the high deployment of devices such as smartphones and tablets has given rise to new and thriving scenarios for signature biometrics where handwriting can be performed using not only a pen stylus but also the finger via touch interaction. Some preliminary studies have highlighted the challenge of this new scenario and the necessity of further research on the topic. The main contribution of this work is to propose a new on-line signature verification architecture adapted to the signature complexity in order to tackle this new and challenging scenario. Additionally, an exhaustive comparative analysis of both pen- and touch-based scenarios using our proposed methodology is carried out along with a review of the most relevant and recent studies in the field. Significant improvements of biometric verification performance and practical insights are extracted for the application of signature verification in real scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. https://github.com/BiDAlab/DeepSignDB.

References

  1. Diaz, M., Ferrer, M.A., Impedovo, D., Malik, M.I., Pirlo, G., Plamondon, R.: A perspective analysis of handwritten signature technology. ACM Comput. Surv. 51, 1–39 (2019)

    Article  Google Scholar 

  2. Guest, R.: Age dependency in handwritten dynamic signature verification systems. Pattern Recognit. Lett. 27(10), 1098–1104 (2006)

    Article  Google Scholar 

  3. Tolosana, R., Vera-Rodriguez, R., Ortega-Garcia, J., Fierrez, J.: Increasing the robustness of biometric templates for dynamic signature biometric systems. In: Proc. International Carnahan Conference on Security Technology (2015)

  4. Galbally, J., Martinez-Diaz, M., Fierrez, J.: Aging in biometrics: an experimental analysis on on-line signature. PLoS ONE 8(7), e69897 (2013)

    Article  Google Scholar 

  5. Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Ortega-Garcia, J.: Reducing the template aging effect in on-line signature biometrics. IET Biometr. 8(6), 422–430 (2019)

    Article  Google Scholar 

  6. Sae-Bae, N., Memon, N.: Online signature verification on mobile devices. IEEE Trans. Inf. Forensics Secur. 9(6), 933–947 (2014)

    Article  Google Scholar 

  7. Blanco-Gonzalo, R., Sanchez-Reillo, R., Miguel-Hurtado, O., Liu-Jimenez, J.: Performance evaluation of handwritten signature recognition in mobile environments. IET Biometr. 3, 139–146 (2014)

    Article  Google Scholar 

  8. Tolosana, R., Vera-Rodriguez, R., Ortega-Garcia, J., Fierrez, J.: Preprocessing and feature selection for improved sensor interoperability in online biometric signature verification. IEEE Access 3, 478–489 (2015)

    Article  Google Scholar 

  9. Sanchez-Reillo, R.: Signature analysis in the context of mobile devices. Image Vis. Comput. 55, 34–37 (2007)

    Article  Google Scholar 

  10. Nam, S., Seo, C., Choi, D.: Mobile finger signature verification robust to skilled forgery. J. Korea Inst. Inf. Secur. Cryptol. 26(5), 1161–1170 (2016)

    Google Scholar 

  11. Tang, L., Fang, Y., Wu, Q., Kang, W., Zhao, J.: Online finger-writing signature verification on mobile device for local authentication. In: Proc. Chinese Conference on Biometric Recognition, pp. 409–416 (2016)

    Chapter  Google Scholar 

  12. Antal, M., Bandi, A.: Finger or stylus: their impact on the performance of on-line signature verification systems. In: Proc. International Conference on Recent Achievements in Mechatronics, Automation, Computer Sciences and Robotics (2017)

  13. Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., Ortega-Garcia, J.: Benchmarking desktop and mobile handwriting across COTS devices: the e-BioSign biometric database. PLoS ONE 12(5), e0176792 (2017)

    Article  Google Scholar 

  14. Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Ortega-Garcia, J.: Presentation attacks in signature biometrics: types and introduction to attack detection. In: Handbook of Biometric Anti-Spoofing (2019)

    Chapter  Google Scholar 

  15. Vera-Rodriguez, R., Blazquez, M., Morales, A., Gonzalez-Sosa, E., Neves, J., Proenca, H.: FaceGenderID: exploiting gender information in DCNNs face recognition systems. In: Proc. Conference on Computer Vision and Pattern Recognition Workshops (2019)

  16. Tolosana, R., Vera-Rodriguez, R., Guest, R., Fierrez, J., Ortega-Garcia, J.: Complexity-based biometric signature verification. In: Proc. International Conference on Document Analysis and Recognition (2017)

  17. Fierrez, J., Galbally, J., Ortega-Garcia, J., et al.: BiosecurID: a multimodal biometric database. Pattern Anal. Appl. 13(2), 235–246 (2010)

    Article  MathSciNet  Google Scholar 

  18. Alewijnse, L., Heuvel, C.V.D., Stoel, R., Franke, K.: Analysis of signature complexity. In: Proc. Biennial Conference of the International Graphonomics Society: Advances in Graphonomics (2009)

  19. Dewhurst, T., Found, B., Rogers, D.: The relationship between quantitatively modelled signature complexity levels and forensic document examiners qualitative opinions on casework. J. Forensic Doc. Exam. 18, 21–40 (2007)

    Google Scholar 

  20. Fairhurst, M., Kaplani, E.: Strategies for exploiting signature verification based on complexity estimates. In: University of Kent, Canterbury (1998)

  21. Alonso-Fernandez, F., Fairhurst, M., Fierrez, J., Ortega-Garcia, J.: Impact of signature legibility and signature type in off-line signature verification. In: Proc. IEEE Biometrics Symposium (2007)

  22. Brault, J., Plamondon, R.: A complexity measure of handwritten curves: modeling of dynamic signature forgery. IEEE Trans. Syst. Man Cybern. 23(2), 400–413 (1993)

    Article  Google Scholar 

  23. Pepe, A., Rogers, D., Sita, J.: A consideration of signature complexity using simulators. Gaze Behav. J. Forensic Doc. Exam. 22, 5–13 (2012)

    Google Scholar 

  24. Daugman, J.: The importance of being random: statistical principles of iris recognition. Pattern Recogn. 36(2), 279–291 (2003)

    Article  Google Scholar 

  25. Lim, M., Yuen, P.: Entropy measurement for biometric verification systems. IEEE Trans. Cybern. 46(5), 1065–1077 (2015)

    Article  Google Scholar 

  26. Houmani, N., Garcia-Salicetti, S., Dorizzi, B.: A novel personal entropy measure confronted to online signature verification systems performance. In: Proc. International Conference on Biometrics: Theory, Applications and System (2008)

  27. Yager, N., Dunstone, T.: The biometric menagerie. IEEE Trans. Pattern Anal. Mach. Intell. 32(2), 220–230 (2010)

    Article  Google Scholar 

  28. Houmani, N., Garcia-Salicetti, S.: On hunting animals of the biometric menagerie for online signature. PLoS ONE 11(4), e0151691 (2016)

    Article  Google Scholar 

  29. Miguel-Hurtado, O., Guest, R., Chatzisterkotis, T.: A new approach to automatic signature complexity assessment. In: Proc. International Carnahan Conference on Security Technology (2016)

  30. Sae-Bae, N., Memon, N., Sooraksa, P.: Distinctiveness, complexity, and repeatability of online signature templates. Pattern Recogn. 84, 332–344 (2018)

    Article  Google Scholar 

  31. Martinez-Diaz, M., Fierrez, J., Galbally, J.: The DooDB graphical password database: data analysis and benchmark results. IEEE Access 1, 596–605 (2013)

    Article  Google Scholar 

  32. Robertson, J., Guest, R.: A feature based comparison of pen and swipe based signature characteristics. Hum. Mov. Sci. 43, 169–182 (2015)

    Article  Google Scholar 

  33. Impedovo, D., Pirlo, G.: Automatic signature verification in the mobile cloud scenario: survey and way ahead. IEEE Trans. Emerg. Top. Comput. (2018)

  34. Reilly, C., Plamondon, R.: Development of a sigma-lognormal representation for on-line signatures. Pattern Recogn. 42(12), 3324–3337 (2009)

    Article  Google Scholar 

  35. Gomez-Barrero, M., Galbally, J., Fierrez, J., Ortega-Garcia, J., Plamondon, R.: Enhanced on-line signature verification based on skilled forgery detection using sigma-lognormal features. In: Proc. International Conference on Biometrics (2015)

  36. Fischer, A., Plamondon, R.: Signature verification based on the kinematic theory of rapid human movements. IEEE Trans. Hum. Mach. Syst. 47, 169–180 (2017)

    Article  Google Scholar 

  37. Diaz, M., Ferrer, M., Parziale, A., Marcelli, A.: Recovering western on-line signatures from image-based specimens. In: Proc. International Conference on Document Analysis and Recognition (2017)

  38. Impedovo, D., Pirlo, G.: Dynamic handwriting analysis for the assessment of neurodegenerative diseases: a pattern recognition perspective. IEEE Rev. Biomed. Eng. 12, 209–220 (2018)

    Article  Google Scholar 

  39. Ferrer, M., Diaz, M., Carmona, C., Plamondon, R.: iDeLog: iterative dual spatial and kinematic extraction of sigma-lognormal parameters. IEEE Trans. Pattern Anal. Mach. Intell. 42, 114–125 (2020)

    Article  Google Scholar 

  40. Martinez-Diaz, M., Fierrez, J., Hangai, S.: Signature features. In: Li, S.Z., Jain, A. (eds.) Encyclopedia of Biometrics, pp. 1375–1382. Springer, Berlin (2015)

    Chapter  Google Scholar 

  41. Martinez-Diaz, M., Fierrez, J., Hangai, S.: Signature matching. In: Li, S.Z., Jain, A. (eds.) Encyclopedia of Biometrics, pp. 1382–1387. Springer, Berlin (2015)

    Chapter  Google Scholar 

  42. Ferrer, M., Diaz, M., Carmona-Duarte, C., Morales, A.: A behavioral handwriting model for static and dynamic signature synthesis. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1041–1053 (2016)

    Article  Google Scholar 

  43. Galbally, J., Diaz-Cabrera, M., Ferrer, M., Gomez-Barrero, M., Morales, A., Fierrez, J.: On-line signature recognition through the combination of real dynamic data and synthetically generated static data. Pattern Recogn. 48(9), 2921–2934 (2015)

    Article  Google Scholar 

  44. Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Ortega-Garcia, J.: Exploring recurrent neural networks for on-line handwritten signature biometrics. IEEE Access 6, 5128–5138 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

This work has been supported by projects: BIBECA (RTI2018-101248-B-I00 MINECO/FEDER), Bio-Guard (Ayudas Fundación BBVA a Equipos de Investigación Científica 2017), and by UAM-CecaBank.

Author information

Authors and Affiliations

  1. Biometrics and Data Pattern Analytics Lab, Universidad Autonoma de Madrid, 28049, Madrid, Spain

    Ruben Tolosana, Ruben Vera-Rodriguez, Julian Fierrez & Javier Ortega-Garcia

  2. School of Engineering and Digital Arts, University of Kent, Canterbury, UK

    Richard Guest

Authors
  1. Ruben Tolosana
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruben Vera-Rodriguez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Richard Guest
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Julian Fierrez
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Javier Ortega-Garcia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ruben Tolosana.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tolosana, R., Vera-Rodriguez, R., Guest, R. et al. Exploiting complexity in pen- and touch-based signature biometrics. IJDAR 23, 129–141 (2020). https://doi.org/10.1007/s10032-020-00351-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10032-020-00351-3

Search

Navigation