A Clinical Prediction Model for Complicated Appendicitis in Children Younger than Five Years of Age

Abstract

Background: No reliably specific method for complicated appendicitis has been identified in children younger than five years of age. This study aimed to analyze the independent factors for complicated appendicitis in children younger than five years of age, develop and validate a prediction model for the differentiation of simple and complicated appendicitis.

Methods: A retrospective study of 382 children younger than five years of age with acute appendicitis from January 2007 to December 2016 was conducted with assessments of demographic data, clinical symptoms and signs, and pre-operative laboratory results. According to intraoperative findings and postoperative pathological results, acute appendicitis were divided into simple and complicated appendicitis. Univariate and multivariate analyses were used to screen out the independent factors of complicated appendicitis, and develop a prediction model for complicated appendicitis. Then 156 such patients from January 2017 to December 2019 were collected as validation sample to validate the prediction model. Test performance of the prediction model was compared with the ALVARADO score and Pediatric Appendicitis Score (PAS).

Results: Of the 382 patients, 244 (63.9 %) had complicated appendicitis. Age, white blood cell count, and duration of symptoms were the independent factors for complicated appendicitis in children younger than five years of age. The final predication model for complicated appendicitis included factors above. In validation sample, the prediction model exhibited a high degree of discrimination (area under the curve [AUC]: 0.830; 95% confidence interval [CI]: 0.762 - 0.885) corresponding to a optimal cutoff value of 0.62, and outperformed the PAS (AUC: 0.735; 95% CI: 0.658 - 0.802), Alvarado score (AUC: 0.733; 95% CI: 0.657 - 0.801).

Conclusion: Younger age, higher white blood cell count, and longer duration of symptoms in children younger than five years of age with acute appendicitis are important predictors for complicated appendicitis. The prediction model is a novel but promising method that aids in the differentiation of acute simple and complicated appendicitis.

Trial registration: All procedures performed in studies involving human participants were in accordance with the ethical standards of the Tianjin Children's Hospital institutional research committee (approved number L202001).

Background

Acute appendicitis (AA) is the most common surgical disease in children, and its incidence is reported to be increasing^[1]. The diagnosis of acute appendicitis has classic clinical appearance only in one third of all patients. Clinical appearance in the in the patients younger than five years of age is often atypical, and misdiagnosis in this age group is not rare, which can lead to an increased rate of perforation^[2]. Clinical presentation, ALVARADO score, Pediatric Appendicitis Score (PAS), Computed tomography, ultrasound and blood tests, may be helpful in diagnose of AA, but it is difficult to confirm the type of appendicitis (simple or complicated appendicitis), especially for children younger than five years of age^[3–7]. Been able to diagnose simple vs. complicated appendicitis allows the surgeon to choose the best surgical approach ranging from antibiotics and delayed appendectomy to laparotomy^[8–10]. Perforated appendicitis after surgery requires antibiotic mono or combination therapy^[11]. Determining the optimum algorithm for diagnostic procedure in complicated AA may not only reduce the number of unnecessary operations, but also the frequency of complications, and may contribute significantly to reducing the cost of treating patients with acute abdominal conditions. There are tools to determine the severity of AA (abdominal ultrasound and computed tomography); nevertheless, this tools may be limited in some centers e.g. technicians that can not give a final report or lack of personnel to carry them out^[12]. Consequently, simple and efficient methods to estimate the complicated appendicitis are currently of interest.

At present, several effective methods have been reported for predicting complicated appendicitis in children with AA, but it is malfunctioning in patients younger than five years of age^{[6, 7, 13, 14]}. Therefore, it is important to predict the type of AA accurately in children younger than five years of age, in order to choose the optimal treatment strategy and save medical resources. Thus, the present study investigated the clinical and laboratory data to screen out the independent factors of complicated appendicitis, develop and validate a prediction model to differentiate simple from complicated appendicitis in children younger than five years of age with AA.

Methods

Study design

The characteristics of subjects from derivation sample, including (1) demographic data: age, gender, body mass index (BMI); (2) symptoms and signs: duration of symptoms (DS), body temperature, right lower quadrant (RLQ) tenderness and rebound pain, migration of pain to RLQ, abdominal distention, nausea and (or) vomiting, anorexia, constipation, diarrhea; (3) intraoperative observation and postoperative pathological results, were extracted from inpatient medical records. The white blood cell count (WBC), neutrophil count (NEUT), percentage of neutrophils (PN), lymphocyte count (LYMPH), mononuclear cell count (MC), platelet count (PLT), C-reactive protein (CRP) and procalcitonin (PCT) data tested on admission (within 2 hours) in venous blood samples were collected. After the establishment of prediction model for complicated appendicitis, clinical data such as the age, DS, and WBC of validation sample were collected. Furthermore, we performed the ALVARADO score and PAS for patients in validation sample^[3]. For these symptoms and signs, “unsure,” “don’t know,” and “missing” responses were coded as not having the sign or symptom^[6].

AA were divided into simple appendicitis and complicated appendicitis according to the following diagnostic code. Simple appendicitis is diagnosed on the basis of (1) intraoperative findings: inflamed appendix without signs of gangrene, perforation, purulent fluid, contained phlegmone or intra-abdominal abscess and (2) histopathological examination confirming the diagnosis of appendicitis without necrosis or perforation. Complicated appendicitis is diagnosed on the basis of (1) intraoperative findings: signs of a gangrenous appendix with or without perforation, intra-abdominal abscess, appendicular contained phlegmone, or purulent free fluid and (2) histopathology confirming the diagnosis based on extensive necrotic tissue in the muscular layer of the appendix or signs of perforation^{[7, 9, 15]}. In case of discrepancies between clinical and pathological findings, the final result refers to the pathologist.

Ethics statement

The Institutional Review Board of Tianjin Children's Hospital approved the collection and use of the clinical information of the patients for research purposes before the investigation was started and waived the requirement for informed consent. (IRB number. L202001).

Results

Prediction Model Development

The demographic data, pre-operative laboratory results, and symptoms and signs of different AA types in derivation sample are listed in Tables 1. No significant differences in gender, BMI, PN, MC, PLT, LRQ tenderness, anorexia, or constipation existed between complicated appendicitis and simple appendicitis. Patients with complicated appendicitis were significantly younger, had longer DS, had higher body temperature, and more frequently reported migration of pain to RLQ, abdominal distention, nausea/vomiting, and diarrhea (P < 0.05 for all). Comparison of pre-operative laboratory results, median WBC, NEUT, LYMPH, CRP, and PCT level were significantly higher (WBC: 15.8 versus 12.3 [*10⁹/L]; NEUT: 11.8 versus 9.6 [*10⁹/L]; LYMPH: 3.0 versus 2.6 [*10⁹/L]; CRP: 58.5 versus 35.1 [mg/L]; PCT: 0.26 versus 0.12 [µg/L]; P < 0.05 for all) in patients with complicated appendicitis than that with the simple appendicitis.

Significant influenced factors were included in the backward stepwise regression analysis. Age, WBC, and DS were the independent predictors for complicated appendicitis in children younger than five years of age, and these factors were entered into the prediction model (Table 2). Diagnosis of collinearity for the above three variables was performed, and the variance expansion factors were 1.023, 1.076 and 1.072, respectively, suggesting that there was no multiple collinearity relationship. Based on the multivariate regression analysis results, we referred the Enter method (P = Expi∑BiXi/1 + Exp∑BiXi) to establish the regression equation (prediction model): P = e^x/(1 + e^x), ’e’ is the natural logarithm, X = 2.997–1.559 A1 + 0.190 A2 + 0.010 A3, and A1 to A3 were the age (years), WBC ( *10⁹/L), and DS (hours), respectively. ROC curve (Fig. 2) analysis of prediction model resulted in an AUC of 0.881 (95% CI: 0.845–0.915, P < 0.05). When the value of P was 0.62, the Youden index was the largest (0.65). Patients with the P of 0.62 or greater were considered to be more likely to have complicated appendicitis. The predictive values of prediction model in derivation sample were 82.8% sensitivity, 81.9% specificity, 84.8% positive predictive value (PPV) and 76.8% negative predictive value (NPV).

Prediction Model Validation

Complete data for validation of the prediction model were available for 156 patients, 52.5% of whom had complicated appendicitis. In validation sample, the median age, WBC, and DS were significantly higher (age: 4.2 versus 3.5 [years], WBC, 15.6 versus 13.0 [*10⁹/L]; DS: 34 versus 17 [hours]; P < 0.05 for all) in patients with complicated appendicitis than that with simple appendicitis (Table 3). The optimal cutoff point was 0.62 for prediction model. The AUC for the prediction model in validation sample was 0.830 (95%CI: 0.762–0.885, P < 0.05) (Fig. 2). Our prediction model was shown to have a sensitivity of 77.8%, a specificity of 89.2%, a PPV of 88.7%, and an NPV of 77.6%. The diagnostic accuracy of the prediction model was 82.7%. The positive and negative likelihood ratios (LR) were 7.11 and 0.26, respectively.

Prediction Model Comparison

To compare the of ALVARADO score, PAS and prediction model, the Alvarado score and PAS were calculated in validation sample. The median Alvarado score and PAS significantly higher (Alvarado score: 8 versus 6, PAS: 7 versus 5, both P < 0.05) in patients with complicated appendicitis than that with simple appendicitis (Table 3).

In Fig. 3, The AUC for Alvarado score was 0.733 (95% CI: 0.657–0.801) and that for PAS was 0.735 (95% CI: 0.658–0.802). The prediction model had an AUC greater than that for the ALVARADO score and PAS in validation sample (P < 0.05). No significant differences in AUC existed between the ALVARADO score and PAS (P > 0.05). When the score was 7 (optimal cutoff point), both Alvarado score and PAS had the largest Youden index. In validation sample, patients with the score of 7 or greater were considered to be more likely to have complicated appendicitis. With the optimal cutoff point of 7, the discrimination values of Alvarado score were 57.3% sensitivity, 79.7% specificity, 64.3% PPV and 67.2% NPV; the discrimination values of PAS were 64.6% sensitivity, 70.3% specificity, 70.7% PPV and 64.2% NPV (Table 4).

Discussion

In this retrospective study we found that age, WBC and DS on admission were independently associated with complicated appendicitis, and developed a prediction model based on these three independent predictors, aiming to make the discrimination of simple and complicated appendicitis in children younger than five years of age. Regarding prediction, the prediction model could identify children at high risk for complicated appendicitis, better than that of ALVARADO score and PAS. This model might be used to aid the differentiation of acute simple and complicated appendicitis for the optimal treatment strategy.

AA remains a clinical diagnosis with laboratory and radiological test as an auxiliary diagnostic method. Accurate differentiation between simple and complicated appendicitis is emerging as a potentially key issue as the historical standard of care, that is prompt appendectomy, is increasingly questioned in pediatric patients^{[7, 16]}. Since AA has a rate of been complicated of approximately 40%, different methods for predicting complicated appendicitis have been tested with inconsistent results. Radiological tests and ultrasonography prove to have an approximately 20% of false negative complicated appendicitis. Both clinical and laboratory variables have been reported to be of value in diagnosing complicated appendicitis, but the results are equivocal in children younger than five years of age^{[7, 13, 17–19]}.

This study not only describe the independent risk factors for complicated appendicitis, but establish early identification of risk factors in order to predict complicated appendicitis. Thus, we included only those factors available in clinical database that were simple and easy to obtain. Based on the multivariate regression analysis results, we referred the Enter method to establish the prediction model. Even though DS were discussed in previous studies as well as in ours, we should notice that the factor is of subjective nature and its reproducibility is low^[7]. Objective variables obtained from blood sample usually better reproducible and therefore of higher value. Among the variables included in our prediction model, DS is the only modifiable risk factor. Several studies have shown that longer DS of AA, the more likely it was to develop perforated ^[20–23]. Bickell et al.^[20] reported the link between the duration of the symptoms and the probability of appendiceal perforation. They concluded that the chance of perforation is low in the first 36 hours of the disease and increases by 5% every 12 hours thereafter. We found a notable difference in the DS between the simple appendicitis and complicated appendicitis, which is why concluded that one of the reasons for high rates of complicated appendicitis in this age group could be a delayed visit to the doctor. Similar to our results, Bansal et al. ^[20]revealed notable differences in the DS between the groups of perforated and non-perforated appendicitis. However, we thought that due to the lack of intestinal barrier and underdeveloped omentum in children younger than five years of age, the DS had a more obvious effect on the appearance of gangrene and perforation in AA. This reminded us that shortening the DS may effectively avoid the probability of complicated appendicitis.

According to the requirements of the international transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) list and elaboration documents, the new prediction model needs to be verified by validation samples of the center or other centers in order to truly reflect the prediction performance of the model^[24]. We collected clinical data of 156 cases for external verification, the discrimination was evaluated by calculating the AUC of ROC. When the cutoff point was 0.62, the AUC for the prediction model in validation sample was 0.830 (95% CI: 0.762–0.885). Our prediction model was shown to have a sensitivity of 77.8%, a specificity of 89.2%, a PPV of 88.7%, and an NPV of 77.6%. The diagnostic accuracy of our model in this cohort was high. In the 2 most commonly cited scores (ALVARADO score and PAS), the authors assign point values to patient history, physical examination, and laboratory findings^[6]. In several studies, PAS and ALVARADO score could effectively diagnose complicated appendicitis^{[7, 25–27]}, but no research reported in patients younger than five years of age. We compare the predictive model with PAS and ALVARADO score for the differentiation of simple and complicated appendicitis. The prediction model had an AUC greater than that for the ALVARADO score or PAS in validation sample (P < 0.05). This may suggest that the ALVARADO score and PAS were not accurate enough to differentiate the type of AA in patients younger than five years of age. Therefore, the prediction model we made was a simple and efficient method that aids the differentiation of acute simple and complicated appendicitis.

Perforation in this age group often leads to diffuse peritonitis, and the most important thing in the management is to establish the accurate diagnosis and perform surgical treatment, assisted by broad-spectrum antimicrobial therapy^{[2, 21, 28]}. Recently, several trials have focused on the non-operative treatment for AA^{[10, 29–31]}. Studies suggested that different treatment strategies should be selected according to the type of AA: simple appendicitis should be the preferred antibiotic conservative treatment, while complicated appendicitis requires appendectomy in most cases^{[15, 32]}. Children appendix is not a non-functional organ left in the body. The appendix is not only a “storage pool” for the gut microbiota to balance the steady state of the proinflammatory and anti-inflammatory activities of the intestine; and the high content of lymphoid tissue (mainly lymphocyte CD8 + T cells) in the appendix plays an important role in the immune function of the body^{[33, 34]}. The age of 5 years and younger is an important period for children's immune function to gradually mature and the balance of intestinal flora to establish. Conservative treatment for simple appendicitis can preserve the appendix, which not only helps maintain intestinal flora homeostasis and immune system development, but also reduces medical costs^{[16, 35]}.

Furthermore, discrimination between simple and complicated appendicitis is important as it may guide appropriate intravenous fluid and antibiotic resuscitation prior to surgical intervention. The prediction model could guide preoperative (or postoperative) antibiotic selection and predict prognosis, referred the optimal cutoff point of 0.62. Although appendicitis protocols vary widely among centres, children with simple appendicitis typically receive a single antibiotic preoperatively and may even not receive postoperative treatment and get discharge home relatively soon^[13]. Conversely, children with a complicated appendicitis recognised on admission typically receive a combination of more antibiotics, undergo operative treatment, and continue antibiotic therapy postoperatively. Hence, identification of predictive indicators for the complicated appendicitis is essential.

It should be borne in mind that the present study was limited by its retrospective design and based on experiences within a single unit, further research with a larger prospective cohort study is necessary to validate the usefulness of the prediction model for predicting complicated appendicitis in children younger than five years of age. Furthermore, the definitions of simple and complicated appendicitis are based on the intraoperative findings and postoperative pathological results, and nonoperatively were excluded.

Conclusion

In conclusion, this study is the first to propose a clinical prediction model to predict complicated appendicitis in children younger than five years of age with AA, and the model showed fair predictive accuracy. Younger age, higher WBC, and longer DS are are important predictors of complicated appendicitis in children younger than five years of age. However, further studies are required to improve the performance of the prediction model and increase sensitivity of complicated appendicitis.

Abbreviations

AA: Acute appendicitis; PAS: Pediatric Appendicitis Score; WBC: white blood cell count; DS: duration of symptoms; AUC: area under the curve.

Declarations

Ethics approval and consent to participate 

All procedures performed in studies involving human participants were in accordance with the ethical standards of the Tianjin Children's Hospital institutional research committee (approved number. L202001) and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Consent to publication

Not applicable

Availability of data and material 

The datasets used and analysed during the current study are available from the corresponding author on reasonable request.

Competing interests

The authors declare that they have no competing interests.

Funding

This study was funded by the Tianjin Science and Technology Plan Project (Grant no. 14RCGFSY00150) for data collection and language polishing.

Authors’ contributions 

WF drafted the manuscript, XZ analyzed and collected the data, ML analyzed the data and drafted the manuscript, HC critically reviewed the manuscript. All authors approved the final manuscript as submitted.

Acknowledgments

Not applicable.

References

1. Buckius MT, McGrath B, Monk J, Grim R, Bell T, Ahuja V. Changing epidemiology of acute appendicitis in the United States: study period 1993-2008. J Surg Res. 2012;175(2):185-190. doi:10.1016/j.jss.2011.07.017.
2. Pogorelić Z, Domjanović J, Jukić M, Poklepović Peričić T. Acute Appendicitis in Children Younger than Five Years of Age: Diagnostic Challenge for Pediatric Surgeons. Surg Infect (Larchmt). 2020;21(3):239-245. doi:10.1089/sur.2019.175.
3. PPogorelić Z, Rak S, Mrklić I, Jurić I. Prospective validation of Alvarado score and Pediatric Appendicitis Score for the diagnosis of acute appendicitis in children. Pediatr Emerg Care. 2015;31(3):164-168. doi:10.1097/PEC.0000000000000375.
4. Pogorelic Z, Buljubasic M, Susnjar T, Jukic M, Pericic TP, Juric I. Comparison of Open and Laparoscopic Appendectomy in Children: A 5-year Single Center Experience. Indian Pediatr. 2019;56(4):299-303.
5. Salö M, Roth B, Stenström P, Arnbjörnsson E, Ohlsson B. Urinary biomarkers in pediatric appendicitis. Pediatr Surg Int. 2016;32(8):795-804. doi:10.1007/s00383-016-3918-x.
6. Kharbanda AB, Vazquez-Benitez G, Ballard DW, et al. Development and Validation of a Novel Pediatric Appendicitis Risk Calculator (pARC). Pediatrics. 2018;141(4):e20172699. doi:10.1542/peds.2017-2699.
7. Gorter RR, van den Boom AL, Heij HA, et al. A scoring system to predict the severity of appendicitis in children. J Surg Res. 2016;200(2):452-459. doi:10.1016/j.jss.2015.08.042.
8. Rogers MB, Brower-Sinning R, Firek B, Zhong D, Morowitz MJ. Acute Appendicitis in Children Is Associated With a Local Expansion of Fusobacteria. Clin Infect Dis. 2016;63(1):71-78. doi:10.1093/cid/ciw208.
9. Salminen P, Paajanen H, Rautio T, et al. Antibiotic Therapy vs Appendectomy for Treatment of Uncomplicated Acute Appendicitis: The APPAC Randomized Clinical Trial. JAMA. 2015;313(23):2340-2348. doi:10.1001/jama.2015.6154.
10. Lee SL, Islam S, Cassidy LD, Abdullah F, Arca MJ; 2010 American Pediatric Surgical Association Outcomes and Clinical Trials Committee. Antibiotics and appendicitis in the pediatric population: an American Pediatric Surgical Association Outcomes and Clinical Trials Committee systematic review. J Pediatr Surg. 2010;45(11):2181-2185. doi:10.1016/j.jpedsurg.2010.06.038.
11. Pogorelić Z, Silov N, Jukić M, Elezović Baloević S, Poklepović Peričić T, Jerončić A. Ertapenem Monotherapy versus Gentamicin Plus Metronidazole for Perforated Appendicitis in Pediatric Patients. Surg Infect (Larchmt). 2019;20(8):625-630. doi:10.1089/sur.2019.025.
12. Alvarez-Alvarez FA, Maciel-Gutierrez VM, Rocha-Muñoz AD, Lujan JH, Ploneda-Valencia CF. Diagnostic value of serum fibrinogen as a predictive factor for complicated appendicitis (perforated). A cross-sectional study. Int J Surg. 2016;25:109-113. doi:10.1016/j.ijsu.2015.11.046.
13. Zani A, Teague WJ, Clarke SA, et al. Can common serum biomarkers predict complicated appendicitis in children?. Pediatr Surg Int. 2017;33(7):799-805. doi:10.1007/s00383-017-4088-1.
14. Marzuillo P, Germani C, Krauss BS, Barbi E. Appendicitis in children less than five years old: A challenge for the general practitioner. World J Clin Pediatr. 2015;4(2):19-24. Published 2015 May 8. doi:10.5409/wjcp.v4.i2.19.
15. Gorter RR, Wassenaar ECE, de Boer OJ, et al. Composition of the cellular infiltrate in patients with simple and complex appendicitis. J Surg Res. 2017;214:190-196. doi:10.1016/j.jss.2017.02.062.
16. Wray CJ, Kao LS, Millas SG, Tsao K, Ko TC. Acute appendicitis: controversies in diagnosis and management. Curr Probl Surg. 2013;50(2):54-86. doi:10.1067/j.cpsurg.2012.10.001.
17. Zouari M, Abid I, Sallami S, et al. Predictive factors of complicated appendicitis in children. Am J Emerg Med. 2017;35(12):1982-1983. doi:10.1016/j.ajem.2017.06.049.
18. Cui W, Liu H, Ni H, Qin X, Zhu L. Diagnostic accuracy of procalcitonin for overall and complicated acute appendicitis in children: a meta-analysis. Ital J Pediatr. 2019;45(1):78. Published 2019 Jul 9. doi:10.1186/s13052-019-0673-3.
19. Monsalve S, Ellwanger A, Montedonico S. White blood cell count and C-reactive protein together remain useful for diagnosis and staging of acute appendicitis in children. S Afr Med J. 2017;107(9):773-776. Published 2017 Aug 25. doi:10.7196/SAMJ.2017.v107i9.12206.
20. Bickell NA, Aufses AH Jr, Rojas M, Bodian C. How time affects the risk of rupture in appendicitis. J Am Coll Surg. 2006;202(3):401-406. doi:10.1016/j.jamcollsurg.2005.11.016.
21. Bansal S, Banever GT, Karrer FM, Partrick DA. Appendicitis in children less than 5 years old: influence of age on presentation and outcome. Am J Surg. 2012;204(6):1031-1035. doi:10.1016/j.amjsurg.2012.10.003.
22. Cameron DB, Williams R, Geng Y, et al. Time to appendectomy for acute appendicitis: A systematic review. J Pediatr Surg. 2018;53(3):396-405. doi:10.1016/j.jpedsurg.2017.11.042.
23. Bonadio W. Time to Appendectomy and Risk of Complicated Appendicitis and Adverse Outcomes in Children. JAMA Pediatr. 2018;172(1):94. doi:10.1001/jamapediatrics.2017.4095.
24. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015;350:g7594. Published 2015 Jan 7. doi:10.1136/bmj.g7594.
25. Chen C, Botelho C, Cooper A, Hibberd P, Parsons SK. Current practice patterns in the treatment of perforated appendicitis in children. J Am Coll Surg. 2003;196(2):212-221. doi:10.1016/S1072-7515(02)01666-6.
26. Caruso AM, Pane A, Garau R, et al. Acute appendicitis in children: not only surgical treatment. J Pediatr Surg. 2017;52(3):444-448. doi:10.1016/j.jpedsurg.2016.08.007.
27. Svensson JF, Patkova B, Almström M, et al. Nonoperative treatment with antibiotics versus surgery for acute nonperforated appendicitis in children: a pilot randomized controlled trial. Ann Surg. 2015;261(1):67-71. doi:10.1097/SLA.0000000000000835.
28. Vons C, Barry C, Maitre S, et al. Amoxicillin plus clavulanic acid versus appendicectomy for treatment of acute uncomplicated appendicitis: an open-label, non-inferiority, randomised controlled trial. Lancet. 2011;377(9777):1573-1579. doi:10.1016/S0140-6736(11)60410-8.
29. Zhong D, Brower-Sinning R, Firek B, Morowitz MJ. Acute appendicitis in children is associated with an abundance of bacteria from the phylum Fusobacteria. J Pediatr Surg. 2014;49(3):441-446. doi:10.1016/j.jpedsurg.2013.06.026.
30. Girard-Madoux MJH, Gomez de Agüero M, Ganal-Vonarburg SC, et al. The immunological functions of the Appendix: An example of redundancy?. Semin Immunol. 2018;36:31-44. doi:10.1016/j.smim.2018.02.005.
31. Kooij IA, Sahami S, Meijer SL, Buskens CJ, Te Velde AA. The immunology of the vermiform appendix: a review of the literature. Clin Exp Immunol. 2016;186(1):1-9. doi:10.1111/cei.12821.
32. Glass CC, Rangel SJ. Overview and diagnosis of acute appendicitis in children. Semin Pediatr Surg. 2016;25(4):198-203. doi:10.1053/j.sempedsurg.2016.05.001.