Skip to main content
SpringerLink
Log in

Evaluation of a traceability approach for informal freehand sketches

  • Published:
Automated Software Engineering Aims and scope Submit manuscript

Abstract

Most engineers and designers prefer to use large drawing boards such as whiteboards or flip charts for the initial collaborative sketching of a system’s models. Large interactive displays have recently begun to replace these physical drawing boards, blurring the line between freehand sketching and toolkit-aided modeling. While digital boards offer more flexibility in drawing and navigating models, they must also provide appropriate cognitive support for frequent shifts of focus and navigation between related artifacts. Furthermore, automated assistance in uncovering potential inconsistencies and contradictions between model sketches would be beneficial so that users do not get lost amid their sketches. In this paper, we discuss an approach to create relationships between the elements of informal hand-drawn sketches on large interactive displays by combining fuzzy search with classic information retrieval techniques. The identification and maintenance of relationships is particularly challenging because we are working with hand-drawn and hand-lettered model sketches rather than the syntactically clean models created with digital modeling toolkits. We evaluated our approach by analyzing 89 model sketches from 16 industry projects and found that it identifies relations between sketched model elements with high precision and recall.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Andrews, C., Endert, A., North, C.: Space to think: large high-resolution displays for sensemaking. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’10, pp. 55–64. ACM, New York, NY, USA (2010)

  • Anslow, C., Marshall, S., Noble, J., Biddle, R.: Co-located collaborative software visualization. In: Human Aspects of Software Engineering, HAoSE ’10, pp. 4:1–4:2. ACM, New York, NY, USA. doi:10.1145/1938595.1938603 (2010a)

  • Anslow, C., Marshall, S., Noble, J., Tempero, E., Biddle, R.: User evaluation of polymetric views using a large visualization wall. In: Proceedings of the 5th International Symposium on Software Visualization, SOFTVIS ’10, pp. 25–34. ACM, New York, NY, USA (2010b)

  • Anslow, C., Marshall, S., Noble, J., Biddle, R.: Interactive multi-touch surfaces for software visualization. In: Proceedings of the Workshop on Data Exploration for Interactive Surfaces DEXIS 2011, pp. 20–23 (2011)

  • Antoniol, G., Canfora, G., Casazza, G., De Lucia, A., Merlo, E.: Recovering traceability links between code and documentation. IEEE Trans. Softw. Eng. 28(10), 970–983 (2002)

    Article  Google Scholar 

  • Asuncion, H.U., Taylor, R.N.: Capturing custom link semantics among heterogeneous artifacts and tools. In: Proceedings of the 2009 ICSE Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE ’09, pp. 1–5. IEEE Computer Society, Washington, DC, USA (2009)

  • Asuncion, H.U., Asuncion, A.U., Taylor, R.N.: Software traceability with topic modeling. In: Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering—ICSE ’10, Vol. 1, pp. 95–104. ACM, New York, NY, USA (2010)

  • Bailey, B.P., Konstan, J.A.: Are informal tools better? Comparing demais, pencil and paper, and authorware for early multimedia design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’03, pp. 313–320. ACM, New York, NY, USA. doi:10.1145/642611.642666 (2003)

  • Ball, R., North, C.: The effects of peripheral vision and physical navigation on large scale visualization. In: Proceedings of Graphics Interface 2008, pp. 9–16. Canadian Information Processing Society, Toronto, Ont., Canada, Canada, GI ’08. http://dl.acm.org/citation.cfm?id=1375714.1375717 (2008)

  • Ball, R., North, C., Bowman, D.A.: Move to improve: promoting physical navigation to increase user performance with large displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’07, pp. 191–200. ACM, New York, NY, USA (2007)

  • Bartelt, C., Vogel, M., Warnecke, T.: Collaborative creativity: From hand drawn sketches to formal domain specific models and back again. In: In Proceedings of the Workshop of Models and their Role in Collaboration (MoRoCo) at the European Conference on Computer Supported Cooperative Work (ECSCW) (2013)

  • Bi, X., Balakrishnan, R.: Comparing usage of a large high-resolution display to single or dual desktop displays for daily work. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’09, pp. 1005–1014. ACM, New York, NY, USA (2009)

  • Blagojevic, R., Chang, S.H.H., Plimmer, B.: The power of automatic feature selection: Rubine on steroids. In: Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium, Eurographics Association, SBIM ’10, pp. 79–86 (2010)

  • Book, M., Grapenthin, S., Gruhn, V.: Risk-aware migration of legacy data structures. In: Software Engineering and Advanced Applications (SEAA), 2013 39th EUROMICRO Conference on, pp. 53–56. doi:10.1109/SEAA.2013.25 (2013)

  • Book, M., Grapenthin, S., Gruhn, V.: Value-based migration of legacy data structures. In: Winkler D, Biffl S, Bergsmann J (eds) Software Quality. Model-Based Approaches for Advanced Software and Systems Engineering, Lecture Notes in Business Information Processing, Vol. 166, pp. 115–134 . Springer, New York (2014)

  • Book, M., Gruhn, V., Striemer, R.: Tamed Agility - Pragmatic Contracting and Collaboration in Agile Software Projects. Springer, New York (2016)

    Google Scholar 

  • Caetano, A., Goulart, N., Fonseca, M., Jorge, J.: Javasketchit: Issues in sketching the look of user interfaces. In: AAAI Spring Symposium on Sketch Understanding, pp. 9–14. AAAI Press, Menlo Park (2002)

  • Chen, Q., Grundy, J., Hosking, J.: An e-whiteboard application to support early design-stage sketching of uml diagrams. In: Human Centric Computing Languages and Environments, 2003. Proceedings. 2003 IEEE Symposium on, pp. 219–226, doi:10.1109/HCC.2003.1260232 (2003)

  • Chen, Q., Grundy, J., Hosking, J.: Sumlow: early design-stage sketching of uml diagrams on an e-whiteboard. Softw. Pract. Exp. 38(9), 961–994 (2008). doi:10.1002/spe.v38:9

    Article  Google Scholar 

  • Chen, X., Hosking, J., Grundy, J.: A combination approach for enhancing automated traceability (nier track). In: Proceedings of the 33rd International Conference on Software Engineering, ICSE ’11, pp. 912–915. ACM, New York, NY, USA (2011)

  • Cherubini, M., Venolia, G., DeLine, R., Ko, A.J.: Let’s go to the whiteboard: how and why software developers use drawings. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’07, pp. 557–566. ACM, New York, NY, USA. doi:10.1145/1240624.1240714 (2007)

  • Cleland-Huang, J., Chang, C., Christensen, M.: Event-based traceability for managing evolutionary change. Softw. Eng. IEEE Trans. 29(9), 796–810 (2003)

    Article  Google Scholar 

  • Cleland-Huang, J., Gotel, O., Zisman, A.: Software and Systems Traceability. Springer, New York (2012)

    Book  Google Scholar 

  • Covi, L.M., Olson, J.S., Rocco, E., Miller, W.J., Allie, P. A room of your own: What do we learn about support of teamwork from assessing teams in dedicated project rooms. In: Proceedings of Cooperative Buildings: Integrating Information, Organization and Architecture: First International Workshop, Co’Build ‘98. ACM Press (1998)

  • Coyette, A., Vanderdonckt, J., Limbourg, Q.: Sketchixml: A design tool for informal user interface rapid prototyping. In: Guelfi, N., Buchs, D. (eds.) Rapid Integration of Software Engineering Techniques, Lecture Notes in Computer Science, vol. 4401, pp. 160–176. Springer, Berlin, Heidelberg. doi:10.1007/978-3-540-71876-5_11 (2007)

  • Damm, C.H., Hansen, K.M., Thomsen, M.: Tool support for cooperative object-oriented design: gesture based modelling on an electronic whiteboard. In: Proceedings of the SIGCHI conference on Human Factors in Computing Systems, CHI ’00, pp. 518–525. ACM, New York, NY, USA. doi:10.1145/332040.332488 (2000)

  • Deerwester, S., Dumais, S.T., Furnas, G.W., Landauer, T.K., Harshman, R.: Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41(6), 391–407 (1990)

    Article  Google Scholar 

  • Dekel, U., Herbsleb, J.D.: Notation and representation in collaborative object-oriented design: An observational study. In: Proceedings of the 22nd Annual ACM SIGPLAN Conference on Object-oriented Programming Systems and Applications, OOPSLA ’07, pp. 261–280. ACM, New York, NY, USA. doi:10.1145/1297027.1297047 (2007)

  • de Souza Alcantara, T., Ferreira, J., Maurer, F.: Interactive prototyping of tabletop and surface applications. In: Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 229–238. ACM, New York, NY, USA, EICS ’13. doi:10.1145/2494603.2480313 (2013)

  • DIN: Schreib- und Gestaltungsregeln für die Textverarbeitung: Sonderdruck von DIN 5008:2011. Beuth (2011)

  • Drivalos-Matragkas, N., Kolovos, D.S., Paige, R.F., Fernandes, K.J.: A state-based approach to traceability maintenance. In: Proceedings of the 6th ECMFA Traceability Workshop, ECMFA-TW ’10, pp. 23–30. ACM, New York, NY, USA (2010)

  • Faruqui, M., Tsvetkov, Y., Rastogi, P., Dyer, C.: Problems with evaluation of word embeddings using word similarity tasks. In: Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP (2016)

  • Ferguson, E.S.: Engineering and the Mind’s Eye. MIT Press, Cambridge (1994)

    Google Scholar 

  • Frakes, W.B., Baeza-Yates, R. (eds.) Information Retrieval: Data Structures and Algorithms. Prentice-Hall, Inc., Upper Saddle River (1992)

  • Galvao, I., Goknil, A.: Survey of traceability approaches in model-driven engineering. In: Proceedings of the 11th IEEE International Enterprise Distributed Object Computing Conference, IEEE Computer Society, Washington, DC, USA, EDOC ’07 (2007)

  • Goel, V.: Sketches of Thought. MIT Press, Cambridge (1995)

    Google Scholar 

  • Grapenthin, S., Book, M., Gruhn, V., Schneider, C., Völker, K.: Reducing complexity using an interaction room: An experience report. In: Proceedings of the 31st ACM International Conference on Design of Communication, SIGDOC ’13, pp. 71–76. ACM, New York, NY, USA. doi:10.1145/2507065.2507087 (2013)

  • Grundy, J., Hosking, J.: Supporting generic sketching-based input of diagrams in a domain-specific visual language meta-tool. In: Proceedings of the 29th International Conference on Software Engineering, ICSE ’07, pp. 282–291. IEEE Computer Society, Washington, DC, USA. doi:10.1109/ICSE.2007.81 (2007)

  • Haller, M., Leitner, J., Seifried, T., Wallace, J.R., Scott, S.D., Richter, C., Brandl, P., Gokcezade, A., Hunter, S.: The nice discussion room: Integrating paper and digital media to support co-located group meetings. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’10, pp. 609–618. ACM, New York, NY, USA. doi:10.1145/1753326.1753418 (2010)

  • Hammond, T., Davis, R.: Tahuti: a geometrical sketch recognition system for uml class diagrams. In: ACM SIGGRAPH 2006 Courses, SIGGRAPH ’06. ACM, New York, NY, USA. doi:10.1145/1185657.1185786 (2006)

  • Hardy, J., Bull, C., Kotonya, G., Whittle, J.: Digitally annexing desk space for software development (nier track). In: Proceedings of the 33rd International Conference on Software Engineering, ICSE ’11, pp. 812–815. ACM, New York, NY, USA. doi:10.1145/1985793.1985910 (2011)

  • Hebig, R., Seibel, A., Giese, H.: On the unification of megamodels. In: Amaral, V., Vangheluwe, H., Hardebolle, C., Lengyel, L., Magaria, T., Padberg, J., Taentzer, G. (eds.) Proceedings of the 4th International Workshop on Multi-Paradigm Modeling (MPM 2010), Electronic Communications of the EASST, vol. 42 (2011)

  • Hesenius, M., Kleffmann, M., Gruhn, V.: Sketching gesture-based applications in a collaborative working environment with wall-sized displays. In: 2016 International Conference on Collaboration Technologies and Systems (CTS), pp. 327–336. doi:10.1109/CTS.2016.0066 (2016)

  • Hosseini-Khayat, A., Seyed, T., Burns, C., Maurer, F.: Low-fidelity prototyping of gesture-based applications. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’11, pp. 289–294. ACM, New York, NY, USA. doi:10.1145/1996461.1996538 (2011)

  • Johnson, G., Gross, M.D., Hong, J., Yi-Luen Do, E.: Computational support for sketching in design: a review. Found Trends Hum.-Comput. Interact. 2(1), 1–93 (2009). doi:10.1561/1100000013

    Article  Google Scholar 

  • Kleffmann, M., Book, M., Gruhn, V.: Towards recovering and maintaining trace links for model sketches across interactive displays. In: Traceability in Emerging Forms of Software Engineering (TEFSE), 2013 International Workshop on, pp. 23–29. doi:10.1109/TEFSE.2013.6620150 (2013)

  • Kleffmann, M., Book, M., Gruhn, V.: Navigation among model sketches on large interactive displays. In: Enterprise Distributed Object Computing Conference Workshops and Demonstrations (EDOCW), 2014 IEEE 18th International, pp. 191–200. doi:10.1109/EDOCW.2014.37 (2014a)

  • Kleffmann, M., Book, M., Gruhn, V.: Supporting collaboration of heterogeneous teams in an augmented team room. In: Proceedings of the 6th International Workshop on Social Software Engineering, SSE 2014, pp. 9–16. ACM, New York, NY, USA. doi:10.1145/2661685.2661688 (2014b)

  • Kleffmann, M., Book, M., Hebisch, E., Gruhn, V.: Automated versioning and temporal navigation for model sketches on large interactive displays. In: Proceedings of the 29th Annual ACM Symposium on Applied Computing, SAC ’14, pp. 161–168. ACM, New York, NY, USA. doi:10.1145/2554850.2563668 (2014c)

  • Kleffmann, M., Röhl, S., Gruhn, V., Book, M.: Establishing and navigating trace links between elements of informal diagram sketches. In: Software and Systems Traceability (SST), 2015 IEEE/ACM 8th International Symposium on, pp. 1–7. doi:10.1109/SST.2015.8 (2015)

  • Klock, S., Gethers, M., Dit, B., Poshyvanyk, D.: Traceclipse: an eclipse plug-in for traceability link recovery and management. In: Proceedings of the 6th International Workshop on Traceability in Emerging Forms of Software Engineering, pp. 24–30. ACM, New York, NY, USA, TEFSE ’11. doi:10.1145/1987856.1987862 (2011)

  • Kraut, R.E., Streeter, L.A.: Coordination in software development. Commun. ACM 38(3), 69–81 (1995). doi:10.1145/203330.203345

    Article  Google Scholar 

  • Landay, J.A., Myers, B.A.: Sketching interfaces: toward more human interface design. Computer 34(3), 56–64 (2001). doi:10.1109/2.910894

    Article  Google Scholar 

  • Larkin, J.H., Simon, H.A.: Why a diagram is (sometimes) worth ten thousand words. Cogn. Sci. 11(1):65–100. doi:10.1016/S0364-0213(87)80026-5. http://www.sciencedirect.com/science/article/pii/S0364021387800265 (1987)

  • LaToza, T.D., Venolia, G., DeLine, R.: Maintaining mental models: A study of developer work habits. In: Proceedings of the 28th International Conference on Software Engineering, ICSE ’06, pp. 492–501. ACM, New York, NY, USA. doi:10.1145/1134285.1134355 (2006)

  • Letelier, P.: A framework for requirements traceability in uml-based projects. In: In: Proceedings of of 1st International Workshop on Traceability in Emerging Forms of Software Engineering, pp. 32–41 (2002)

  • Levenshtein, V.I.: Binary codes capable of correcting deletions, insertions, and reversals. Sov. Phys.-Doklady 10, 707–710 (1966)

    MathSciNet  MATH  Google Scholar 

  • Lin, J., Thomsen, M., Landay, J.A.: A visual language for sketching large and complex interactive designs. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’02, pp. 307–314. ACM, New York, NY, USA. doi:10.1145/503376.503431 (2002)

  • Mäder, P., Gotel, O., Philippow, I.: Enabling automated traceability maintenance by recognizing development activities applied to models. In: Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering, ASE ’08, pp. 49–58. IEEE Computer Society, Washington, DC, USA (2008)

  • Mäder, P., Gotel, O., Philippow, I.: Enabling automated traceability maintenance through the upkeep of traceability relations. In: Paige, R.F., Hartman, A., Rensink, A. (eds.) Model Driven Architecture - Foundations and Applications, 5th European Conference, ECMDA-FA 2009, Enschede, The Netherlands, June 23–26, 2009. Proceedings, Springer, Lecture Notes in Computer Science, vol. 5562, pp. 174–189 (2009)

  • Mangano, N., van der Hoek, A.: The design and evaluation of a tool to support software designers at the whiteboard. Autom. Softw. Eng. 19(4), 381–421 (2012). doi:10.1007/s10515-012-0104-9

    Article  Google Scholar 

  • Mangano, N., Baker, A., Dempsey, M., Navarro, E., van der Hoek, A.: Software design sketching with calico. In: Proceedings of the IEEE/ACM international conference on Automated software engineering, ASE ’10, pp. 23–32. ACM, New York, NY, USA. doi:10.1145/1858996.1859003 (2010)

  • Mangano, N., LaToza, T.D., Petre, M., van der Hoek, A.: Supporting informal design with interactive whiteboards. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, pp. 331–340. ACM, New York, NY, USA. doi:10.1145/2556288.2557411 (2014)

  • Mangano, N., LaToza, T.D., Petre, M., van der Hoek, A.: How software designers interact with sketches at the whiteboard. IEEE Trans. Softw. Eng. 41(2), 135–156 (2015). doi:10.1109/TSE.2014.2362924

    Article  Google Scholar 

  • Marcus, A., Maletic, J.I.: Recovering documentation-to-source-code traceability links using latent semantic indexing. In: Proceedings of the 25th International Conference on Software Engineering, pp. 125–135. IEEE Computer Society, Washington, DC, USA, ICSE ’03 (2003)

  • Marcus, A., Maletic, J.I., Sergeyev, A.: Recovery of traceability links between software documentation and source code. Int. J. Softw. Eng. Knowl. Eng. 15, 811–836 (2005a)

    Article  Google Scholar 

  • Marcus, A., Xie, X., Poshyvanyk, D.: When and how to visualize traceability links? In: Proceedings of the 3rd International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE ’05, pp. 56–61. ACM, New York, NY, USA (2005b)

  • Mark, G.: Extreme collaboration. Commun. ACM 45(6), 89–93 (2002). doi:10.1145/508448.508453

    Article  Google Scholar 

  • Memmel, T., Reiterer, H.: Inspector - interactive ui specification tool. In: Proceedings of the 7th International Conference on Computer Aided Design of User Interfaces (CADUI) 2008, pp. 161–174. Springer (2008)

  • Murta, L.G., Hoek, A., Werner, C.M.: Continuous and automated evolution of architecture-to-implementation traceability links. Autom. Softw. Eng. 15(1), 75–107 (2008)

    Article  Google Scholar 

  • Myers, B., Park, S.Y., Nakano, Y., Mueller, G., Ko, A.: How designers design and program interactive behaviors. In: Visual Languages and Human-Centric Computing, 2008. VL/HCC 2008. IEEE Symposium on, pp. 177–184. doi:10.1109/VLHCC.2008.4639081 (2008)

  • Mynatt, E.D., Igarashi, T., Edwards, W.K., LaMarca, A.: Flatland: New dimensions in office whiteboards. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’99, pp. 346–353. ACM, New York, NY, USA. doi:10.1145/302979.303108 (1999)

  • Obrenovic, v, Martens, J.B.: Sketching interactive systems with sketchify. ACM Trans. Comput.-Hum. Interact. 18(1), 4:1–4:38 (2011). doi:10.1145/1959022.1959026

    Article  Google Scholar 

  • Petre, M.: Insights from expert software design practice. In: Proceedings of the the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, ESEC/FSE ’09, pp. 233–242. ACM, New York, NY, USA. doi:10.1145/1595696.1595731 (2009)

  • Petre, M.: Uml in practice. In: Proceedings of the 2013 International Conference on Software Engineering, ICSE ’13, pp. 722–731. IEEE Press, Piscataway, NJ, USA. http://dl.acm.org/citation.cfm?id=2486788.2486883 (2013)

  • Plimmer, B., Apperley, M.: Interacting with sketched interface designs: an evaluation study. In: CHI ’04 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’04, pp. 1337–1340. ACM, New York, NY, USA. doi:10.1145/985921.986058 (2004)

  • Pye, D.: The Nature and Aesthetics of Design. A&C Black (2000)

  • Salton, G., Wong, A., Yang, C.S.: A vector space model for automatic indexing. Commun. ACM 18(11), 613–620 (1975). doi:10.1145/361219.361220

    Article  MATH  Google Scholar 

  • Sapna, P., Mohanty, H.: Ensuring consistency in relational repository of uml models. In: Information Technology, (ICIT 2007). 10th International Conference on, pp. 217 –222 (2007)

  • Schütze, M., Sachse, P., Römer, A.: Support value of sketching in the design process. Res. Eng. Des. 14(2), 89–97 (2003). doi:10.1007/s00163-002-0028-7

    Article  Google Scholar 

  • Sendall, S., Kozaczynski, W.: Model transformation: the heart and soul of model-driven software development. IEEE Softw. 20(5), 42–45 (2003). doi:10.1109/MS.2003.1231150

    Article  Google Scholar 

  • Settimi, R., Cleland-Huang, J., Ben Khadra, O., Mody, J., Lukasik, W., DePalma, C.: Supporting software evolution through dynamically retrieving traces to uml artifacts. In: Software Evolution, 2004. Proceedings. 7th International Workshop on Principles of, pp. 49–54 (2004)

  • Sharif, B., Kagdi, H.: On the use of eye tracking in software traceability. In: Proceedings of the 6th International Workshop on Traceability in Emerging Forms of Software Engineering, pp. 67–70. ACM, New York, NY, USA, TEFSE ’11 (2011)

  • Shipman, F.M., Marshall, C.C.: Formality considered harmful: experiences, emerging themes, and directions on the use of formal representations in interactive systems. Comput. Supported Cooperative Work (CSCW) 8(4), 333–352 (1999)

    Article  Google Scholar 

  • Singhal, A.: Modern Information Retrieval: A Brief Overview. Bull. IEEE Comput. Soc. Tech. Comm. Data Eng. 24(4), 35–42. http://singhal.info/ieee2001.pdf (2001)

  • SMART Technologies: SMART Board. http://smarttech.com/smartboard, [Accessed 2015-06-30] (2015)

  • Soukoreff, R.W., MacKenzie, I.S.: Measuring errors in text entry tasks: An application of the levenshtein string distance statistic. In: CHI ’01 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’01, pp. 319–320. ACM, New York, NY, USA. doi:10.1145/634067.634256 (2001)

  • Spanoudakis, G.: Plausible and adaptive requirement traceability structures. In: Proceedings of the 14th international conference on Software engineering and knowledge engineering, SEKE ’02, pp. 135–142. ACM, New York, NY, USA (2002)

  • Spanoudakis, G., Zisman, A.: Inconsistency management in software engineering: Survey and open research issues. In: Handbook of Software Engineering and Knowledge Engineering, pp. 329–380. World Scientific (2001)

  • Stapleton, G., Plimmer, B., Delaney, A., Rodgers, P.: Combining sketching and traditional diagram editing tools. ACM Trans. Intell. Syst. Technol. 6(1), 10:1–10:29 (2015). doi:10.1145/2631925

    Article  Google Scholar 

  • Stefik, M., Bobrow, D.G., Foster, G., Lanning, S., Tatar, D.: Wysiwis revised: early experiences with multiuser interfaces. ACM Trans. Inf. Syst. 5(2), 147–167 (1987a). doi:10.1145/27636.28056

    Article  Google Scholar 

  • Stefik, M., Foster, G., Bobrow, D.G., Kahn, K., Lanning, S., Suchman, L.: Beyond the chalkboard: computer support for collaboration and problem solving in meetings. Commun. ACM 30(1), 32–47 (1987b). doi:10.1145/7885.7887

    Article  Google Scholar 

  • Streitz, N., Prante, T., Müller-Tomfelde, C., Tandler, P., Magerkurth, C.: Roomware: The second generation. In: CHI ’02 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’02, pp. 506–507. ACM, New York, NY, USA. doi:10.1145/506443.506452 (2002)

  • Teasley, S., Covi, L., Krishnan, M.S., Olson, J.S. How does radical collocation help a team succeed? In: Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, CSCW ’00, pp. 339–346. ACM, New York, NY, USA. doi:10.1145/358916.359005 (2000)

  • Turney, P.D., Pantel, P.: (2010) From frequency to meaning: Vector space models of semantics. J. Artif. Int. Res. 37(1), 141–188. http://dl.acm.org/citation.cfm?id=1861751.1861756

  • Tversky, B., Suwa, M., Agrawala, M., Heiser, J., Stolte, C., Hanrahan, P., Phan, D., Klingner, J., Daniel, M.P., Lee, P., Haymaker, J.: Human Behaviour in Design: Individuals, Teams, Tools, Springer, chap Sketches for Design and Design of Sketches, pp. 79–86 (2003)

  • Wagner, R.A., Fischer, M.J.: The string-to-string correction problem. J. ACM 21(1), 168–173 (1974). doi:10.1145/321796.321811

    Article  MathSciNet  MATH  Google Scholar 

  • Wüest, D., Seyff, N., Glinz, M.: Flexisketch: A mobile sketching tool for software modeling. In: Uhler, D., Mehta, K., Wong, J. (eds.) Mobile Computing, Applications, and Services, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 110, pp. 225–244. Springer, Berlin, Heidelberg (2013)

  • Yatani, K., Chung, E., Jensen, C., Truong, K.N.: Understanding how and why open source contributors use diagrams in the development of ubuntu. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’09, pp. 995–1004. ACM, New York, NY, USA. doi:10.1145/1518701.1518853 (2009)

  • Zannier, C., Maurer, F.: Comparing decision making in agile and non-agile software organizations. In: Proceedings of the 8th International Conference on Agile Processes in Software Engineering and Extreme Programming, XP’07, pp. 1–8. Springer-Verlag, Berlin, Heidelberg. http://dl.acm.org/citation.cfm?id=1768961.1768963 (2007)

Download references

Author information

Authors and Affiliations

  1. paluno - The Ruhr Institute for Software Technology, University of Duisburg-Essen, Essen, Germany

    Markus Kleffmann, Sebastian Röhl & Volker Gruhn

  2. Faculty of Industrial Engineering, Mechanical Engineering and Computer Science, University of Iceland, Reykjavík, Iceland

    Matthias Book

Authors
  1. Markus Kleffmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sebastian Röhl
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matthias Book
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Volker Gruhn
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Markus Kleffmann.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kleffmann, M., Röhl, S., Book, M. et al. Evaluation of a traceability approach for informal freehand sketches. Autom Softw Eng 25, 1–43 (2018). https://doi.org/10.1007/s10515-017-0221-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10515-017-0221-6

Keywords

Search

Navigation