Skip to main content
Download PDF

Meta-analysis of the clinical efficacy of laparoscopic appendectomy in the treatment of acute appendicitis

World Journal of Emergency Surgery volume 17, Article number: 26 (2022) Cite this article

Abstract

Background

This paper compares the postoperative recovery of patients with acute appendicitis (AA) after laparoscopic appendectomy (LA) and open appendectomy (OA), aiming to determine the optimal diagnosis and treatment plan for appendectomy.

Methods

Related literature was retrieved from PubMed, Web of Science, Embase, CNKI and Wanfang databases. Articles on LA and OA for AA published between 2010 and 2021 were selected to extract data. Besides, Stata16.0 was used for meta-analysis.

Results

A total of 777 articles were retrieved, and 16 of them were finally selected. Totally, 1251 patients underwent LA, while 898 patients received OA. According to the results of meta-analysis, LA was associated with lower incidence of adverse reactions [OR = 0.257, 95% CI (0.162, 0.408), P < 0.001], shorter operation time (SMD = − 1.802, 95% CI − 2.435, − 1.169; P < 0.001) and hospitalization (SMD = − 1.184, 95% CI − 1.512, − 0.856; P < 0.001). In addition, compared with the OA group, LA was found with less intraoperative blood loss (SMD = − 3.650, 95% CI − 5.088, − 2.212; P < 0.001) and shorter recovery time of gastrointestinal function (SMD = − 3.010, 95% CI − 3.816, − 2.203; P < 0.001). Aside from all these, the counts of leukocyte (SMD = − 0.432, 95% CI: − 0.775, − 0.089; P = 0.013), neutrophil (SMD = − 1.346, 95% CI − 2.560, − 0.133; P = 0.030), and C-reactive protein (SMD = − 2.391, 95% CI − 3.901, − 0.882; P = 0.002) all decreased in a significant manner after LA.

Conclusion

Compared with OA, LA boasts the advantages of less adverse reactions, shorter operation time and hospitalization, fewer complications, and lower inflammatory response, evidencing its safety and feasibility of applying in the treatment of AA.

Introduction

Acute appendicitis (AA) constitutes a common cause of acute abdominal pain worldwide. It is expected to attack a person with a risk of 7–8% during his lifetime [1], habitually setting in late childhood or early adulthood [2]. Typical symptoms of AA involve periumbilical pain migrating to the right lower quadrant or right iliac fossa pain, also accompanied by rebound pain, fever, nausea, or vomiting [3]. In laboratory tests, changes in the number of leukocytes and increases of C-reactive protein are common in AA patients. Abdominal ultrasound, computerized tomography scanning or magnetic resonance imaging is usually used for its diagnosis [4]. Appendectomy is the standard treatment for AA and can be classified as open (OA) or laparoscopic (LA). LA was first brought up by Kurt semm in 1983, and since then, numerous studies have focused on the comparison of LA with conventional OA [5]. For adults, LA usually means less postoperative pain, faster recovery and fewer surgical complications. Therefore, LA has replaced OA in many centers, with an advantage in hospitalization duration and surgical wound complications [6]. It is no exaggeration that LA has emerged as the gold standard for the treatment of suspected simple appendicitis. A meta-analysis by Athanasiou et al. found LA achieved a more significant improvement in the incidence of concurrent appendicitis in adults compared with OA [7]. However, no systematic study comparing the clinical effects of LA and OA in the treatment of AA has been reported as of now. Therefore, the purpose of this paper is to comprehensively evaluate associated research on recovery and clinical efficacy, recovery and postoperative laboratory parameters after LA and OA surgery, thus determining the optimal approach of appendectomy.

Methods

Literature retrieval

Electronic databases such as PubMed, Web of Science and Embase, China National Knowledge Infrastructure, and Wanfang were searched for literature published between 2010 and 2021. The keywords were: “laparoscopic/laparoscopy” AND “open appendicectomy/appendicectomy/open approach” AND “appendicitis”.

Screening criteria

Inclusion criteria: (1) Study subjects: AA patients undergoing LA and OA, without age limit; (2) Intervention: LA and OA; (3) Outcome measures: at least any of the followings: incidence of adverse reactions after treatment, postoperative white blood cell count (WBC), postoperative neutrophil count (NEUT), postoperative C-reactive protein (CPR), operation time, intraoperative blood loss; recovery time of gastrointestinal function, hospitalization duration; (4)Study design: randomized controlled trials (RCTs) or case–control studies.

Exclusion Criteria: (1) Studies without traceable results; (2) reviews, duplicate studies, animal experiments.

Data extraction

Research selection was independently performed by two evaluators. Should any disagreement arises, a third evaluator would be introduced for joint consultation or the two discussed with each other to achieve consensus. The following data were extracted from the selected articles: title, country, study design, baseline characteristics of participants and outcome measures.

Statistical analysis

Data analysis was performed using Stata16.0 software. The heterogeneity of all studies was tested by means of Q test and I2 statistic. When P < 0.05 and I2 > 50%, the random-effects model would be used for meta-analysis; otherwise, the fixed-effects model would be adopted. Odds ratios (ORs) or standardized mean differences (SMDs) were calculated with 95% confidence intervals (CIs) for dichotomous and continuous outcomes. Funnel plots were used to detect publication bias, and sensitivity analyses were performed to further confirm the stability of the overall effect. P < 0.05 was considered statistically significant.

Results

Results of literature retrieval

Initially 777 studies were included based on the results of electronic database searching. Finally 16 studies were considered qualified after removing 141 repeated articles, 197 unqualified articles marked by automated tools, 254 articles through examining their titles and abstracts, 76 with unqualified data, 57 duplicate reports, 25 insufficient in data, 11 with unsuitable study subjects[8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23] (Fig. 1).

Fig. 1
figure 1

Flow chart of literature screening

Full size image

All 16 studies were both RCTs and retrospective studies with 10 Chinese articles and 6 English articles. In total, 2149 patients were included, with 1251 patients receiving LA and 898 patients receiving OA. In the included articles, subjects varied in age from 9 to 50 years old and sample sizes ranged from 37 to 531. The characteristics of each included study are summarized in Table 1.

Table1 The basic characteristics of included literature
Full size table

Comparison of clinical efficacy indicators

Sixteen studies compared the incidence of adverse reactions between the two groups. Moderate heterogeneity among studies (I2 = 56.1%, P = 0.003) was observed, enabling the adoption of random-effects model to combine the effect size. In accordance with the results, we could find that the incidence rate of postoperative adverse reactions in the LA group was significantly lower than that in the OA group [OR = 0.257, 95% CI (0.162, 0.408), P < 0.001, Fig. 2A]. No significant bias in the incidence of adverse reactions was identified in the funnel plot for publication bias detection (Fig. 2B). Besides, the sensitivity analysis displayed little change in the combined result after removing the included studies one by one, indicating comparatively strong stability of the result of meta-analysis (Fig. 2C).

Fig. 2
figure 2

Meta-analysis of the incidence of adverse reactions after appendectomy. A Forest plot comparing the incidence of postoperative adverse reactions between LA and OA in patients with acute appendicitis; B Funnel plot assessing the potential publication bias in studies discussing the incidence of adverse reactions; C Sensitivity analysis of the incidence of adverse reactions. OA, open appendectomy; LA, laparoscopic appendectomy.

Full size image

Comparison of postoperative recovery indicators

Thirteen studies reported the operative time, 9 studies mentioned the intraoperative blood loss, 12 studies compared the postoperative gastrointestinal recovery time, and 13 studies involved the length of hospital stay for patients in the LA and OA groups. The studies included demonstrated significant heterogeneity (I2 > 50%, P < 0.001) and were thus analyzed using random-effects model. By analyzing the above indicators, it was found that LA performed better than OA. To be specific, LA was associated with apparently shorter operation time [SMD = − 1.802, 95%CI(− 2.435, − 1.169), P < 0.001, Fig. 3A], significantly less intraoperative blood loss [SMD = -3.650, 95% CI (− 5.088, − 2.212), P < 0.001, Fig. 3B], quicker recovery of gastrointestinal function [SMD = − 3.010, 95% CI (− 3.816, − 2.203), P < 0.001, Fig. 3C], and much shorter period of hospitalization [SMD = − 1.184, 95% CI (− 1.512, − 0.856), P < 0.001, Fig. 3D]. The funnel plot of publication bias detection showed no significant bias in the operation time, intraoperative blood loss, gastrointestinal function recovery time and hospital stay of the included studies (Fig. 4A–D). Sensitivity analysis further proved the new combined results only had little change from the combined results before exclusion, suggesting low sensitivity and credibility of the results of meta-analysis (Fig. 5A–D).

Fig. 3
figure 3

Forest plots comparing the recovery of patients with acute appendicitis after LA and OA. A Operative time; B Intraoperative blood loss; C Gastrointestinal recovery time; D Hospital stay. OA, open appendectomy; LA, laparoscopic appendectomy

Full size image
Fig. 4
figure 4

Funnel plots of operating time (A), intraoperative blood loss (B), gastrointestinal recovery time (C), hospital stay (D)

Full size image
Fig. 5
figure 5

Sensitivity analyses of operating time (A), intraoperative blood loss (B), gastrointestinal recovery time (C), hospital stay (D)

Full size image

Comparison of postoperative laboratory parameters

For postoperative WBC, NEUT and CPR levels, there were 6, 5 and 7 articles reporting them, respectively. The random-effects model was used due to the significant heterogeneity observed in these studies (I2 > 50%, P < 0.001). Meta-analysis results showed that patients in the LA group presented significantly reduced postoperative WBC levels [SMD = − 0.432, 95% CI (− 0.775, − 0.089), P = 0.013, Fig. 6A], NEUT levels [SMD = − 1.346, 95% CI (− 2.560, − 0.133), P = 0.030, Fig. 6B] and CPR levels [SMD = − 2.391, 95% CI (− 3.901, − 0.882), P = 0.002, Fig. 6C] compared with the OA group. Since there was significant heterogeneity in the included studies, we conducted sensitivity analyses. The pooled effect size was re-analyzed after removing the included studies one by one, but the new combined results did not change much from the previous ones, suggesting low sensitivity and stability and credibility of the meta-analysis results (Fig. 7A–C).

Fig. 6
figure 6

Forest plots comparing postoperative white blood cell count A, postoperative neutrophil level B, and postoperative C-reactive protein level C in patients with acute appendicitis after LA and OA. OA, open appendectomy; LA, laparoscopic appendectomy

Full size image
Fig. 7
figure 7

Sensitivity analyses of postoperative white blood cell count A, postoperative neutrophil B and postoperative C-reactive protein C level in patients with acute appendicitis after LA and OA. OA, open appendectomy; LA, laparoscopic appendectomy

Full size image

Discussion

In this study, the clinical efficacy of LA and OA in the treatment of AA was systematically evaluated. Through searching the relevant databases a total of 16 studies could be included for meta-analysis. As was shown by the results, the incidence of adverse reactions was significantly lower in the LA group compared with the OA group. Then, we went on to investigate the postoperative recovery of patients in both groups and found LA achieved better outcomes in terms of operation time, postoperative hospital stay, intraoperative blood loss and gastrointestinal function recovery time. In addition, laboratory parameters also revealed a significant decrease in WBC levels, NEUT levels and CPR levels in patients in the LA group.

In view of the incidence of adverse reactions, OA group involves greater variety of adverse events, which may be related to higher possibility of class II and III incisions and contamination of surgical field and medical devices during OA. Besides, bacteria discharged with sweat glands were also likely to contaminate the incision [24].

Previous studies have shown that after LA treatment, patients can return to normal activities and diet earlier than those undergoing OA [25]. Surgical cost of LA is higher than OA, but due to its shorter hospital stay, the amount eventually spent by both approaches is almost equivalent [26, 27]. Operative time was decreased instead of prolonged in the LA group in the above two studies; this trend is different from many RCTs or meta-analyses [28] but similar to the results of our study. Operation duration is affected mainly by proficiency in surgical procedures, operation preparation time, and condition of the appendix observed by laparoscopy [29].

In addition, LA surgery uses a trocar to avoid abdominal wall bleeding caused by layer-by-layer process to access the abdominal cavity, and can reduce unnecessary trauma and bleeding during surgery. During LA, the bowel did not leave the abdominal environment, avoiding intestinal adhesions arising from excessive exposure and drying of the bowel. Finally, Atraumatic grasping is employed in LA surgery to prevent repeated lifting and pinching, gauze packing, and stimulation of glove talc to the intestinal serosa [30]; this also explains less amount of intraoperative blood loss and shorter recovery time of gastrointestinal function in the LA group.

In this paper, the WBC level, NEUT level and CPR level of patients in the LA group were significantly lower than those in the OA group. The trauma left by surgery can cause changes in systemic inflammation and immune response, mainly manifested through changes in cytokine levels [31]. It has been reported in related literatures that neutrophil/lymphocyte ratio, inflammatory factors and serum bilirubin are closely linked with the occurrence and development of AA [32, 33]. Stress response and tissue injury resulting from the surgery can compromise the patient’s postoperative immunity and inflammatory response and further affect the patient’s recovery [34]. A myriad of studies have pointed out that LA has a relationship with fewer wound infections compared with that of OA [7], which can be explained by the use of a wound-protective plastic bag for the removal of the inflamed appendix [35].

This study still has some limitation, and more comparable results are required in the future, such as postoperative pain, time to return to normal activities and readmission.

Conclusions

LA has the advantages of less adverse reactions, shorter operation time and hospital stay, fewer complications, and lower inflammatory response. Hence, it is safe and feasible surgery for AA. The study serves to fill the research gap in the literature discussing optimization of postoperative recovery by LA, and lays a solid theoretical basis for the development of clinical diagnosis and treatment plan for AA.

Data availability

The data used to support the findings of this study are available from the corresponding author upon request.

References

  1. Stewart B, Khanduri P, McCord C, Ohene-Yeboah M, Uranues S, Vega Rivera F, et al. Global disease burden of conditions requiring emergency surgery. Br J Surg. 2014;101(1):e9-22.

    Article  CAS  Google Scholar 

  2. Jaschinski T, Mosch CG, Eikermann M, Neugebauer EAM, Sauerland S. Laparoscopic versus open surgery for suspected appendicitis. Cochrane Database Syst Rev. 2018. https://doi.org/10.1002/14651858.CD001546.pub4.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Snyder MJ, Guthrie M, Cagle S. Acute appendicitis: efficient diagnosis and management. Am Fam Physician. 2018;98(1):25–33.

    PubMed  Google Scholar 

  4. Bhangu A, Soreide K, Di Saverio S, Assarsson JH, Drake FT. Acute appendicitis: modern understanding of pathogenesis, diagnosis, and management. Lancet. 2015;386(10000):1278–87.

    Article  Google Scholar 

  5. Semm K. Endoscopic appendectomy. Endoscopy. 1983;15(2):59–64.

    Article  CAS  Google Scholar 

  6. Sauerland S, Jaschinski T, Neugebauer EAM. Laparoscopic versus open surgery for suspected appendicitis. Cochrane Database Syst Rev. 2010. https://doi.org/10.1002/14651858.CD001546.pub3.

    Article  PubMed  Google Scholar 

  7. Athanasiou C, Lockwood S, Markides GA. Systematic review and meta-analysis of laparoscopic versus open appendicectomy in adults with complicated appendicitis: an update of the literature. World J Surg. 2017;41(12):3083–99.

    Article  Google Scholar 

  8. Xu HD. Observation on the effect of laparoscopic appendicitis surgery for appendicitis. Chin Commun Doctors. 2021;37(30):42–3.

    Google Scholar 

  9. Yuan B, Zhang L, Tang HL, Ma CA, Wang CM, Mu XX. Effects of traditional open surgery and laparoscopic surgery on clinical efficacy, gastrointestinal function and complications in patients with acute appendicitis. Med Pharm J Chin People’s Liberation Army. 2019;31(12):85–9.

    Google Scholar 

  10. Yi ZG, Xie XF, Chen SH. Clinical efficacy and safety of laparoscopy and laparotomy in the treatment of acute appendicitis. Contemp Med. 2021;27(7):3.

    Google Scholar 

  11. Yang YT, Gu LX, Wang YH. Clinical curative effect of laparoscopic surgery and traditional open surgery for acute appendicitis. Chin J Med Guide. 2014;3:434–5.

    Google Scholar 

  12. Gong W, Yu Q, Cheng JW, Wang Y, Wu XL. The comparison of curative effect between laparoscopic and open surgery in treatment of acute suppurative appendicitis in children. Journal of Laparoscopic Surgery. 2018;23(6):463–6.

    Google Scholar 

  13. Shen ZH, Zhan F, Shen ZW, Jiang C, Zhang K, Zhang Y. Laparoscopic versus open appendectomy in patients with perforated acute appendicitis: a retrospective comparative study. J Laparosc Surg. 2016;21(11):858–60.

    Google Scholar 

  14. Li YC, Wang JT, Cui MF, Sun LB. Comparison of laparoscopic appendectomy and open appendectomy for perforated acute appendicitis. Chin J Minim Invasive Surg. 2014;14(4):327–30.

    Google Scholar 

  15. Liu WB. Study on the clinical efficacy of laparoscopic and open surgery in the treatment of acute appendicitis. China Foreign Med Treat. 2020;39(34):68–70.

    Google Scholar 

  16. Le H. Changes of serum inflammatory factors and cellular immune function before and after laparoscopic surgery for acute appendicitis. China J Endosc. 2020;26(7):25–30.

    Google Scholar 

  17. Wu J, Guo Y, Xu J. Clinical observation of laparotomy and laparoscopy for acute appendicitis. J North Sichuan Med Coll. 2014;29(4):386–8.

    Google Scholar 

  18. Takami T, Yamaguchi T, Yoshitake H, Hatano K, Kataoka N, Tomita M, et al. A clinical comparison of laparoscopic versus open appendectomy for the treatment of complicated appendicitis: historical cohort study. Eur J Trauma Emerg Surg. 2020;46(4):847–51.

    Article  Google Scholar 

  19. Minutolo V, Licciardello A, Di Stefano B, Arena M, Arena G, Antonacci V. Outcomes and cost analysis of laparoscopic versus open appendectomy for treatment of acute appendicitis: 4-years experience in a district hospital. BMC Surg. 2014. https://doi.org/10.1186/1471-2482-14-14.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Kargar S, Mirshamsi MH, Zare M, Arefanian S, Shadman Yazdi E, Aref A. Laparoscopic versus open appendectomy; which method to choose? A prospective randomized comparison. Acta Med Iran. 2011;49(6):352–6.

    PubMed  Google Scholar 

  21. Tsai CC, Lee SY, Huang FC. Laparoscopic versus open appendectomy in the management of all stages of acute appendicitis in children: a retrospective study. Pediatr Neonatol. 2012;53(5):289–94.

    Article  Google Scholar 

  22. Kocatas A, Gonenc M, Bozkurt MA, Karabulut M, Gemici E, Alis H. Comparison of open and laparoscopic appendectomy in uncomplicated appendicitis: a prospective randomized clinical trial. Ulus Travma Acil Cerrahi Derg. 2013;19(3):200–4.

    Article  Google Scholar 

  23. Clarke T, Katkhouda N, Mason RJ, Cheng BC, Olasky J, Sohn HJ, et al. Laparoscopic versus open appendectomy for the obese patient: a subset analysis from a prospective, randomized, double-blind study. Surg Endosc. 2011;25(4):1276–80.

    Article  Google Scholar 

  24. Jiang Y. The Electrophysiological Mechanism of QT Prolongation in Mice with Alcoholic Cardiomyopathy Induced by Chronic Alcohol Intake. Nanjing Medical University. 2016.

  25. Wei B, Qi CL, Chen TF, Zheng ZH, Huang JL, Hu BG, et al. Laparoscopic versus open appendectomy for acute appendicitis: a metaanalysis. Surg Endosc. 2011;25(4):1199–208.

    Article  Google Scholar 

  26. Masoomi H, Nguyen NT, Dolich MO, Mills S, Carmichael JC, Stamos MJ. Laparoscopic appendectomy trends and outcomes in the United States: data from the nationwide inpatient sample (NIS), 2004–2011. Am Surg. 2014;80(10):1074–7.

    Article  Google Scholar 

  27. Yeh CC, Wu SC, Liao CC, Su LT, Hsieh CH, Li TC. Laparoscopic appendectomy for acute appendicitis is more favorable for patients with comorbidities, the elderly, and those with complicated appendicitis: a nationwide population-based study. Surg Endosc. 2011;25(9):2932–42.

    Article  Google Scholar 

  28. Dai L, Shuai J. Laparoscopic versus open appendectomy in adults and children: a meta-analysis of randomized controlled trials. United Eur Gastroenterol J. 2017;5(4):542–53.

    Article  Google Scholar 

  29. Wang D, Dong T, Shao Y, Gu T, Xu Y, Jiang Y. Laparoscopy versus open appendectomy for elderly patients, a meta-analysis and systematic review. BMC Surg. 2019;19(1):54.

    Article  CAS  Google Scholar 

  30. Zhang WY, Zhou X. Contrastive analysis on the complications between laparoscopic appendectomy and open appendectomy. Chin Gen Pract. 2014;3:322–4.

    Google Scholar 

  31. Xiao S, You GP, Ou HW, Huang GC. Study on perioperative situations of patients with laparoscopic or open resection of uterine fibroids. Chinese Journal of Woman and Child Health Research. 2016;27(3):370–2.

    Google Scholar 

  32. Sun YJ, Liu S, Gao YS, Wang B, Xiong H. The value of peripheral blood lymphocyte-neutrophil ratio in the diagnosis of complicated acute appendicitis. Chin J Crit Care Med. 2018;38(7):608–11.

    Google Scholar 

  33. Kim TH, Cho BS, Jung JH, Lee MS, Jang JH, Kim CN. Predictive factors to distinguish between patients with noncomplicated appendicitis and those with complicated appendicitis. Ann Coloproctol. 2015;31(5):192–7.

    Article  Google Scholar 

  34. Xiong SL. Comparison between laparoscopic cholecystectomy and open cholecystectomy on liver function and immune function. J Reg Anat Oper Surg. 2014;23(004):388–90.

    Google Scholar 

  35. Southgate E, Vousden N, Karthikesalingam A, Markar SR, Black S, Zaidi A. Laparoscopic vs open appendectomy in older patients. Arch Surg. 2012;147(6):557–62.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study did not receive any funding in any form.

Author information

Authors and Affiliations

  1. Department of Anorectal Surgery, The First Hospital of China Medical University, Shenyang, 110001, Liaoning, China

    Guangzhe Zhang & Bo Wu

Authors
  1. Guangzhe Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bo Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

GZZ: data curation, formal analysis, methodology, and writing—original draft. BW: conceptualization, resources, investigation, writing—review and editing. All authors contributed to the article and approved the submitted version.

Corresponding author

Correspondence to Bo Wu.

Ethics declarations

Ethics approval and consent to participate

This article does not contain any studies with human participants or animals performed by any of the authors.

Consent for publication

All authors have read and approved the submitted manuscript.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, G., Wu, B. Meta-analysis of the clinical efficacy of laparoscopic appendectomy in the treatment of acute appendicitis. World J Emerg Surg 17, 26 (2022). https://doi.org/10.1186/s13017-022-00431-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13017-022-00431-1

Keywords

World Journal of Emergency Surgery

ISSN: 1749-7922