Eur J Pediatr Surg 2023; 33(05): 395-402
DOI: 10.1055/a-1946-0157
Original Article

The Development and Validation of Artificial Intelligence Pediatric Appendicitis Decision-Tree for Children 0 to 12 Years Old

Anas Shikha*
1   Department of Pediatric Surgery, Raja Isteri Pengiran Anak Saleha (RIPAS) Hospital, Jalan Putera Al-Muhtadee Billah, Bandar Seri Begawan, Brunei
,
Asem Kasem*
2   Computer Information Science, Higher Colleges of Technology, UAE
› Author Affiliations

Abstract

Introduction Diagnosing appendicitis in young children (0–12 years) still poses a special difficulty despite the advent of radiological investigations. Few scoring models have evolved and been applied worldwide, but with significant fluctuations in accuracy upon validation.

Aim To utilize artificial intelligence (AI) techniques to develop and validate a diagnostic model based on clinical and laboratory parameters only (without imaging), in addition to prospective validation to confirm the findings.

Methods In Stage-I, observational data of children (0–12 years), referred for acute appendicitis (March 1, 2016–February 28, 2019, n = 166), was used for model development and evaluation using 10-fold cross-validation (XV) technique to simulate a prospective validation. In Stage-II, prospective validation of the model and the XV estimates were performed (March 1, 2019–November 30, 2021, n = 139).

Results The developed model, AI Pediatric Appendicitis Decision-tree (AiPAD), is both accurate and explainable, with an XV estimation of average accuracy to be 93.5% ± 5.8 (91.4% positive predictive value [PPV] and 94.8% negative predictive value [NPV]). Prospective validation revealed that the model was indeed accurate and close to the XV evaluations, with an overall accuracy of 97.1% (96.7% PPV and 97.4% NPV).

Conclusion The AiPAD is validated, highly accurate, easy to comprehend, and offers an invaluable tool to use in diagnosing appendicitis in children without the need for imaging. Ultimately, this would lead to significant practical benefits, improved outcomes, and reduced costs.

* Both authors have contributed equally to the research works, analysis, and writing of this paper, and retain the first authorship.




Publication History

Received: 13 June 2022

Accepted: 13 September 2022

Accepted Manuscript online:
16 September 2022

Article published online:
16 November 2022

© 2022. Thieme. All rights reserved.

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 
  • References

  • 1 Livingston EH, Woodward WA, Sarosi GA, Haley RW. Disconnect between incidence of nonperforated and perforated appendicitis: implications for pathophysiology and management. Ann Surg 2007; 245 (06) 886-892
  • 2 Samuel M. Pediatric appendicitis score. J Pediatr Surg 2002; 37 (06) 877-881
  • 3 Goldman RD, Carter S, Stephens D, Antoon R, Mounstephen W, Langer JC. Prospective validation of the pediatric appendicitis score. J Pediatr 2008; 153 (02) 278-282
  • 4 Bhatt M, Joseph L, Ducharme FM, Dougherty G, McGillivray D. Prospective validation of the pediatric appendicitis score in a Canadian pediatric emergency department. Acad Emerg Med 2009; 16 (07) 591-596
  • 5 Aydin D, Turan C, Yurtseven A. et al. Integration of radiology and clinical score in pediatric appendicitis. Pediatr Int 2018; 60 (02) 173-178
  • 6 Estey A, Poonai N, Lim R. Appendix not seen: the predictive value of secondary inflammatory sonographic signs. Pediatr Emerg Care 2013; 29 (04) 435-439
  • 7 Schuh S, Man C, Cheng A. et al. Predictors of non-diagnostic ultrasound scanning in children with suspected appendicitis. J Pediatr 2011; 158 (01) 112-118
  • 8 Brenner DJ, Hall EJ. Computed tomography–an increasing source of radiation exposure. N Engl J Med 2007; 357 (22) 2277-2284
  • 9 Brody AS, Frush DP, Huda W, Brent RL. American Academy of Pediatrics Section on Radiology. Radiation risk to children from computed tomography. Pediatrics 2007; 120 (03) 677-682
  • 10 Hendee WR, O'Connor MK. Radiation risks of medical imaging: separating fact from fantasy. Radiology 2012; 264 (02) 312-321
  • 11 Brenner D, Elliston C, Hall E, Berdon W. Estimated risks of radiation-induced fatal cancer from pediatric CT. AJR Am J Roentgenol 2001; 176 (02) 289-296
  • 12 Pearce MS, Salotti JA, Little MP. et al. Radiation exposure from CT scans in childhood and subsequent risk of leukaemia and brain tumours: a retrospective cohort study. Lancet 2012; 380 (9840): 499-505
  • 13 Mittal MK, Dayan PS, Macias CG. et al; Pediatric Emergency Medicine Collaborative Research Committee of the American Academy of Pediatrics. Performance of ultrasound in the diagnosis of appendicitis in children in a multicenter cohort. Acad Emerg Med 2013; 20 (07) 697-702
  • 14 Bellazzi R, Ferrazzi F, Sacchi L. Predictive data mining in clinical medicine: a focus on selected methods and applications. Wiley Interdiscip Rev Data Min Knowl Discov 2011; 1: 416-430
  • 15 Quinlan J. Induction of decision trees. Mach Learn 1986; 1: 81-106 Accessed October 18, 2022, at: https://doi.org/10.1023/A:1022643204877
  • 16 Kasem A, Ghaibeh AA, Moriguchi H. Empirical study of sampling methods for classification in imbalanced clinical datasets. In: Advances in Intelligent Systems and Computing. Vol. 532. Computational Intelligence in Information Systems; 2017; Brunei:152–162
  • 17 Mierswa I, Klinkenberg R. RapidMiner Studio [Data Science, Machine Learning, Predictive Analytics]. 2018. Accessed June 2, 2022, at: https://rapidminer.com
  • 18 Stone M. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society: Series B (Methodological) 1974; 36: 111-133 Accessed October 18, 2022, at: https://doi.org/10.1111/j.2517-6161.1974.tb00994.x
  • 19 Pirracchio R, Petersen ML, Carone M, Rigon MR, Chevret S, van der Laan MJ. Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): a population-based study. Lancet Respir Med 2015; 3 (01) 42-52
  • 20 Miano DI, Silvis RM, Popp JM, Culbertson MC, Campbell B, Smith SR. Abdominal CT does not improve outcome for children with suspected acute appendicitis. West J Emerg Med 2015; 16 (07) 974-982