Skip to main content
SpringerLink
Log in

Measuring benefits from big data analytics projects: an action research study

  • Original Article
  • Published:
Information Systems and e-Business Management Aims and scope Submit manuscript

Abstract

Big data analytics (BDA) projects are expected to provide organizations with several benefits once the project closes. Nevertheless, many BDA projects are unsuccessful as benefits did not materialize as expected. Organization can manage the expected benefits by measuring these, yet very few organizations actually measure on benefits post project development, and little has been written about BDA benefits measurements that extends beyond those typically identified in the project business case. This study examines how we should establish measures for BDA benefits in the context of a large wind turbine manufacturer investing in BDA to improve their practices when defining BDA benefits measures. We present lessons learned from our action research, that were found useful in establishing BDA benefit measurements. There are three lessons on (1) change, (2) specification of who, and (3) explicitness in establishing a useful BDA benefit measure. We contribute to BDA benefits realization in proposing the lessons to establish BDA benefits measurements. Finally, we discuss the lessons and contributions related to research on BDA value creation and benefits management.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Akter S, Wamba SF, Gunasekaran A, Dubey R, Childe SJ (2016) How to improve firm performance using big data analytics capability and business strategy alignment? Int J Prod Econ 182:113–131

    Article  Google Scholar 

  • Ali IM, Jusoh YY, Abdullah R, Nor RNH, Affendey ALS (2019) Measuring the performance of big data analytics process. J Theor Appl Inf Technol 97(14):3783–3795

    Google Scholar 

  • Avison DE, Davison RM, Malaurent J (2018) Information systems action research: Debunking myths and overcoming barriers. Inform Manag 55(2):177–187

    Article  Google Scholar 

  • Badewi A, Shehab E (2016) The impact of organizational project benefits management governance on ERP project success: Neo-institutional theory perspective. Int J Project Manage 34(3):412–428

    Article  Google Scholar 

  • Baesens B, Bapna R, Marsden JR, Vanthienen J, Zhao JL (2016) Transformational issues of big data and analytics in networked business. Mis Q 40(4):807–818

    Article  Google Scholar 

  • Baskerville R, Wood-Harper AT (1998) Diversity in information systems action research methods. Eur J Inf Syst 7(2):90–107

    Article  Google Scholar 

  • Baskerville R, Wood-Harper A (2016) A critical perspective on action research as a method for information systems research. Enacting Res Methods in Inform Syst 2(1996):169–190

    Google Scholar 

  • Bennington P, Baccarini D (2004) Project benefits management in IT projects - an australian perspective. Project Manag J 35:20–30

    Article  Google Scholar 

  • Chen H, Chiang RHL, Storey VC (2012) Business intelligence and analytics: from big data to big impact. MIS Q 36:1165–1188

    Article  Google Scholar 

  • Chiang RHL, Grover V, Liang TP, Zhang D (2018) Special issue: strategic value of big data and business analytics. J Manag Inf Syst 35:383–387

  • Chih YY, Zwikael O (2015) Project benefit management: a conceptual framework of target benefit formulation. Int J Project Manage 33(2):352–362

    Article  Google Scholar 

  • Claudia Goldin and Lawrence F. Katz (2007), The Race between Education and Technology, NBER Working Paper No. 12984

  • Côrte-real N, Oliveira T, Ruivo P (2017) Assessing business value of big data analytics in European firms. J Bus Res 70:379–390

    Article  Google Scholar 

  • Côrte-Real N, Ruivo P, Oliveira T, Popovič A (2019) Unlocking the drivers of big data analytics value in firms. J Bus Res 97(April):160–173

    Article  Google Scholar 

  • Daniel E, Peppard J, Ward J (2007) Managing the realization of business benefits from IT investments. MIS Q Exec 6(1):1–12

    Google Scholar 

  • Davison Ou M (2012) The roles of theory in canonical action research. MIS Q 36(3):763–786

    Article  Google Scholar 

  • Doherty NF (2014) The role of socio-technical principles in leveraging meaningful benefits from IT investments. Appl Ergonom 45:181–187

    Article  Google Scholar 

  • Erevelles S, Fukawa N, Swayne L (2016) Big Data consumer analytics and the transformation of marketing. J Bus Res 69(2):897–904

    Article  Google Scholar 

  • Ferris T (2006) Churchman and measurement. In: McIntyre-Mills J, van Gigch JP (eds) Rescuing the enlightenment from itself: critical and systemic implications for democracy (vol 1, pp 213–225). Springer Science+Business Media Inc.

  • Fosso Wamba S, Akter S, Edwards A, Chopin G, Gnanzou D (2015) How “big data” can make big impact: Findings from a systematic review and a longitudinal case study. Int J Prod Econ 165:234–246

    Article  Google Scholar 

  • Frisk JE, Bannister F, Lindgren R (2015) Evaluation of information system investments: a value dials approach to closing the theory-practice gap. J Inf Technol 30(3):276–292

    Article  Google Scholar 

  • Gibson M, Arnott D (2005) The evaluation of business intelligence: a case study in a major financial institution. In: ACIS 2005 Proceedings—16th Australasian Conference on Information Systems, (December)

  • Gibson M, Arnott D, Jagielska I (2004) Evaluating the Intangible Benefits of Business Intelligence: Review & Research Agenda. Decision Support in an Uncertain and Complex World, 295–305

  • Grover V, Chiang RHL, Liang TP, Zhang D (2018) Creating strategic business value from big data analytics: a research framework. J Manag Inf Syst 35(2):388–423

    Article  Google Scholar 

  • Grover V, Lindberg A, Benbasat I, Lyytinen K (2020) The perils and promises of big data research in information systems. J Assoc Inf Syst 21(2):268–291

    Google Scholar 

  • Günther WA, Rezazade Mehrizi MH, Huysman M, Feldberg F (2017) Debating big data: a literature review on realizing value from big data. J Strat Inf Syst 26(3):191–209

    Article  Google Scholar 

  • Hayes GR (2011) The relationship of action research to human-computer interaction. ACM Trans Comput-Human Interaction 18(3):1–20

    Article  Google Scholar 

  • Hu H, Wen Y, Chua TS, Li X (2014) Toward scalable systems for big data analytics: a technology tutorial. IEEE Access 2:652–687

    Article  Google Scholar 

  • Irani Z, Love P (2002) Developing a frame of reference for ex-ante IT/IS investment evaluation. Eur J Inf Syst 11(1):74–82

    Article  Google Scholar 

  • Iversen MN (2004) Managing risk in software process improvement: an action research approach. MIS Q 28(3):395

    Article  Google Scholar 

  • Jensen MH, Nielsen PA, Persson JS (2019) Managing big data analytics projects: The challenges of realizing value. 27th European Conference on Information Systems—Information Systems for a Sharing Society, ECIS 2019, (June)

  • Ji-fan Ren S, Fosso Wamba S, Akter S, Dubey R, Childe SJ (2017) Modelling quality dynamics, business value and firm performance in a big data analytics environment. Int J Prod Res 55(17):5011–5026

    Article  Google Scholar 

  • Kanji GK, Sá PME (2002) Kanji’s Business Scorecard. Total Qual Manag 13(1):13–27

    Article  Google Scholar 

  • Kaplan RS, Norton DP (1996) Translating strategy into action: the balanced scorecard. Harvard Business School Press, Boston, MA

    Google Scholar 

  • Kwon O, Lee N, Shin B (2014) Data quality management, data usage experience and acquisition intention of big data analytics. Int J Inf Manage 34(3):387–394

    Article  Google Scholar 

  • Lai S-T, Leu F-Y (2019) A critical quality measurement model for managing and controlling big data project risks. In: Advances on Broad-Band Wireless Computing, Communication and Applications, Lecture Notes on Data Engineering and Communications Technologies 12 (pp. 777–789)

  • Larson D, Chang V (2016) A review and future direction of agile, business intelligence, analytics and data science. Int J Inf Manage 36(5):700–710

    Article  Google Scholar 

  • Lau RYK, Zhao JL, Chen G, Guo X (2016) Big data commerce. Inform Manag 53(8):929–933

    Article  Google Scholar 

  • Lavalle S, Lesser E, Shockley R, Hopkins MS, Kruschwitz N (2011) Big data, analytics and the path from insights to value. MIT Sloan Manag Rev 52(2):21–32

    Google Scholar 

  • Lin C, Pervan G (2003) The practice of IS/IT benefits management in large Australian organizations. Inform Manag 41(1):13–24

    Article  Google Scholar 

  • Lynch RL, Cross KF (1995) Lynch, R.L., Cross, K.F.: Measure up! Yardsticks for Continuous Improvement. Cambridge, England: Blackwell business

  • Markus ML, Soh C (1995) How IT creates business value: a process theory synthesis. ICIS 1995 Proceedings, pp. 29–41

  • Marshall P, Mckay J, Prananto A (2004) A process model of business value creation from IT investments. ACIS 2004 Proceedings, (December), 12

  • Mathiassen L (2002) Collaborative practice research. Inf Technol People 15(4):321–345

    Article  Google Scholar 

  • McAfee A, Brynjolfsson E (2012) Big data. The management revolution. Harvard Buiness Review 90(10):61–68

    Google Scholar 

  • Mckay J, Marshall P (2001) The dual imperatives of action research. Inf Technol People 14(1):46–59

    Article  Google Scholar 

  • Mikalef P, Augustin Framnes V, Danielsen F, Krogstie J, Håkon Olsen D (2017a). Big data analytics capability: antecedents and business value. Twenty First Pacific Asia Conference on Information Systems, 13

  • Mikalef P, Pappas IO, Krogstie J, Giannakos M (2017b). Big data analytics capabilities: a systematic literature review and research agenda. Information Systems and E-Business Management, 1–32

  • Mikalef P, Pappas IO, Krogstie J, Pavlou PA (2020) Big data and business analytics: a research agenda for realizing business value. Inform Manag 57(1):103237

    Article  Google Scholar 

  • Mirarab A, Mirtaheri SL, Asghari SA (2019) Value creation with big data analytics for enterprises: a survey. Telkomnika (Telecommun Computi Electron Control) 17(6):2790–2802

    Article  Google Scholar 

  • Müller O, Fay M, vom Brocke J (2018) The effect of big data and analytics on firm performance: an econometric analysis considering industry characteristics. J Manag Inf Syst 35(2):488–509

    Article  Google Scholar 

  • Neely A, Gregory M, Platts K (1995) Performance measurement system design: a literaturer review. Int J Oper Prod Manag 15(4):80–116

    Article  Google Scholar 

  • Nielsen PA (2007) IS action research and its criteria. In: Information System Action Research An Applied View of Emerging Concepts and Methods, N. Kock (ed.) (pp. 355–375). Springer

  • Oesterreich TD, Anton E, Teuteberg F, Dwivedi YK (2022a) The role of the social and technical factors in creating business value from big data analytics: a meta-analysis. J Bus Res 153:128–149

    Article  Google Scholar 

  • Oesterreich TD, Anton E, Teuteberg F (2022b) What translates big data into business value? A meta-analysis of the impacts of business analytics on firm performance. Inform Manag 59(6):103685

    Article  Google Scholar 

  • Patton MQ (2002) Qualitative research & evaluation methods, 4th edn. SAGE Publications Inc., Thousands Oaks, California

    Google Scholar 

  • Ranjan J, Foropon C (2021) Big data analytics in building the competitive intelligence of organizations. Int J Inform Manag 56:102231

    Article  Google Scholar 

  • Schryen G (2013) Revisiting IS business value research: What we already know, what we still need to know, and how we can get there. Eur J Inf Syst 22(2):139–169

    Article  Google Scholar 

  • Seddon JJJM, Currie WL (2017) A model for unpacking big data analytics in high-frequency trading. J Bus Res 70:300–307

    Article  Google Scholar 

  • Spall S (1998) Emerging operational models sharon spall. Qual Inq 4(2):280–292

    Article  Google Scholar 

  • Trieu VH (2017) Getting value from business intelligence systems: a review and research agenda. Decis Support Syst 93:111–124

    Article  Google Scholar 

  • Veiga J, Exposito RR, Pardo XC, Taboada GL, Tourifio J (2016) Performance evaluation of big data frameworks for large-scale data analytics. In: Proceedings—2016 IEEE international conference on big data, pp 424–431

  • Veiga J, Expósito RR, Touriño J (2018) Performance evaluation of big data analysis. In: Sakr S, Zomaya A (eds) Encyclopedia of Big Data Technologies, Springer, Cham, pp 1265–1271. https://doi.org/10.1007/978-3-319-63962-8_143-1

  • Vries A, de; C.-M. Chituc and F. Pommeé. (2016) Towards identifying the business value of big data in a digital business ecosystem: a case study from the financial services industry. Lecture Notes in Bus Inform Process 255:28–40

    Article  Google Scholar 

  • Wamba SF, Gunasekaran A, Akter S, fan RenDubeyChilde SJRSJ (2017) Big data analytics and firm performance: effects of dynamic capabilities. J Bus Res 70:356–365

    Article  Google Scholar 

  • Ward J, Daniel E (2012) Benefits management. Wiley

  • Waring T, Casey R, Robson A (2018) Benefits realisation from IT-enabled innovation: a capability challenge for NHS English acute hospital trusts? Inf Technol People 31(3):618–645

    Article  Google Scholar 

Download references

Funding

The authors declare that the data supporting the findings in this study are available within the article in form of quotations. The data are not publicly available due to these containing sensitive information from Vestas Wind Systems A/S.

Author information

Authors and Affiliations

  1. Department of Business Development and Technology, Aarhus University, BTECH, Birk Centerpark 15, Herning, Denmark

    Maria Hoffmann Jensen

  2. Department of Computer Science, Aalborg University, Selma Lagerløfs Vej, 300 9220, Aalborg, Denmark

    John Stouby Persson & Peter Axel Nielsen

Authors
  1. Maria Hoffmann Jensen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. John Stouby Persson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peter Axel Nielsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maria Hoffmann Jensen.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. The authors have no conflict of interest to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jensen, M.H., Persson, J.S. & Nielsen, P.A. Measuring benefits from big data analytics projects: an action research study. Inf Syst E-Bus Manage 21, 323–352 (2023). https://doi.org/10.1007/s10257-022-00620-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10257-022-00620-0

Keywords

Search

Navigation