Abstract
Classification schemes for reporting thyroid cytology of fine needle aspiration (FNA) of thyroid nodules are largely used in clinical practice, but the level of inter-observer agreement among cytopathologists is poorly acknowledged. The present study aimed to explore the inter-observer agreement among the experienced authors of the 2014 Italian Consensus for Classification and Reporting of Thyroid Cytology (ICCRTC). A stratified randomization was performed in order to obtain a sample homogeneously distributed and representative of all ICCRTC classes. Four high-experience raters were randomly selected among the extensors of the Italian consensus. They independently reviewed 60 FNA samples blindly of the initial cytological report and clinical features. Their overall agreement was evaluated according to Fleiss’ kappa. The overall inter-observer agreement was moderate (κ 0.46). Specifically, a good agreement was found when the samples were consistent for malignancy (TIR5) or were not adequate for diagnosis (TIR1) (κ 0.67 and κ 0.73, respectively). A moderate agreement was present for suspicious-for-malignant category (TIR4), and a fair agreement was recorded in the two intermediate ones (TIR3A and TIR3B) (κ 0.36 and κ 0.35, respectively). For clinical purposes, the agreement was good (κ 0.74) in differentiating cases with surgical indication (TIR4/TIR5) from those in which surgery is not essential or requires limited extension (TIR3B/TIR3A/TIR2). In conclusion, the present study confirms the reliability of ICCRTC. These data represent a reference for cytopathologists using this system and are useful for the practice of clinicians and surgeons.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Cibas ES, Ali SZ. The 2017 Bethesda System for Reporting Thyroid Cytopathology. Thyroid. 2017;27(11):1341–1346. https://doi.org/10.1089/thy.2017.0500.
Satoh S, Yamashita H, Kakudo K. Thyroid cytology: the Japanese System and Experience at Yamashita Thyroid Hospital. J Pathol Transl Med. 2017;51(6):548–554. https://doi.org/10.4132/jptm.2017.09.29.
Lobo C, McQueen A, Beale T, Kocjan G. The UK Royal College of Pathologists thyroid fine-needle aspiration diagnostic classification is a robust tool for the clinical management of abnormal thyroid nodules. Acta Cytol. 2011;55(6):499–506. https://doi.org/10.1159/000333234.
Fadda G, Basolo F, Bondi A, Bussolati G, Crescenzi A, Nappi O, Nardi F, Papotti M, Taddei G, Palombini L; SIAPEC-IAP Italian Consensus Working Group. Cytological classification of thyroid nodules. Proposal of the SIAPEC-IAP Italian Consensus Working Group. Pathologica. 2010;102(5):405–408.
Kocjan, G., Cochand-Priollet, B., De Agustin, P.P., Bourgain, C., Chandra, A., Daneshbod, Y., Deery, A., Duskova, J., Ersoz, C., Fadda, G., Fassina, A., Firat, P., Jimenez-Ayala, B., Karakitsos, P., Koperek, O., Matesa, N., Poller, D., Thienpont, L., Ryska, A., Schenck, U., Sauer, T., Schmitt, F., Tani, E., Toivonen, T., Tötsch, M., Troncone, G., Vass, L., Vielh, P. Diagnostic terminology for reporting thyroid fine needle aspiration cytology: European Federation of Cytology Societies thyroid working party symposium, Lisbon 2009 Cytopathology. 2010; 21 (2): 86-92.
Nardi F, Basolo F, Crescenzi A, Fadda G, Frasoldati A, Orlandi F, Palombini L, Papini E, Zini M, Pontecorvi A, Vitti P. Italian consensus for the classification and reporting of thyroid cytology. J Endocrinol Invest. 2014;37(6):593–599. https://doi.org/10.1007/s40618-014-0062-0.
Poller DN, Bongiovanni M, Trimboli P. Risk of malignancy in the various categories of the UK Royal College of Pathologists Thy terminology for thyroid FNA cytology: a systematic review and meta-analysis. Cancer Cytopathol. 2020 Jan;128(1):36-42. https://doi.org/10.1002/cncy.22201.
Trimboli P, Crescenzi A, Giovanella L. Performance of Italian Consensus for the Classification and Reporting of Thyroid Cytology (ICCRTC) in discriminating indeterminate lesions at low and high risk of malignancy. A systematic review and meta-analysis. Endocrine. 2018;60(1):31–35. https://doi.org/10.1007/s12020-017-1382-6.
Straccia P, Rossi ED, Bizzarro T, Brunelli C, Cianfrini F, Damiani D, Fadda G. A meta-analytic review of the Bethesda System for Reporting Thyroid Cytopathology: has the rate of malignancy in indeterminate lesions been underestimated? Cancer Cytopathol. 2015;123(12):713–722.
Rullo E, Minelli G, Bosco D, Nardi F, Ascoli V. Evaluation of the Italian cytological subclassification of thyroid indeterminate nodules into TIR-3A and TIR-3B: a retrospective study of 290 cases with histological correlation from a single institution. J Endocrinol Invest. 2018;41(5):531–538. https://doi.org/10.1007/s40618-017-0763-2.
Baloch ZW, Fleisher S, LiVolsi VA, Gupta PK. Diagnosis of “follicular neoplasm”: a gray zone in thyroid fine-needle aspiration cytology. Diagn Cytopathol. 2002;26(1):41-44. https://doi.org/10.1002/dc.10043.
Mathur A, Najafian A, Schneider EB, Zeiger MA, Olson MT. Malignancy risk and reproducibility associated with atypia of undetermined significance on thyroid cytology. Surgery. 2014;156(6):1471–discussion1476. https://doi.org/10.1016/j.surg.2014.08.026.
Kocjan G, Chandra A, Cross PA, Giles T, Johnson SJ, Stephenson TJ, Roughton M, Poller DN. The interobserver reproducibility of thyroid fine-needle aspiration using the UK Royal College of Pathologists' classification system. Am J Clin Pathol. 2011;135(6):852–859. https://doi.org/10.1309/AJCPZ33MVMGZKEWU.
Trimboli P, Fulciniti F, Paone G, Barizzi J, Piccardo A, Merlo E, Mazzucchelli L, Giovanella L. Risk of malignancy (ROM) of thyroid FNA diagnosed as suspicious for malignancy or malignant: an institutional experience with systematic review and meta-analysis of literature. Endocrine Pathology 2020 Mar;31(1):52-56. https://doi.org/10.1007/s12022-019-09602-4.
Padmanabhan V, Marshall CB, Akdas Barkan G, Ghofrani M, Laser A, Tolgay Ocal I, David Sturgis C, Souers R, Kurtycz DF. Reproducibility of atypia of undetermined significance/follicular lesion of undetermined significance category using the bethesda system for reporting thyroid cytology when reviewing slides from different institutions: a study of interobserver variability among cytopathologists. Diagn Cytopathol. 2017;45(5):399-405. https://doi.org/10.1002/dc.23681.
Farahani N, Pantanowitz L. Overview of telepathology. Clin Lab Med. 2016;36(1):101–112. https://doi.org/10.1016/j.cll.2015.09.010.
Acknowledgments
The authors of the present study thank Giacomo Siri, MSc, from University of Genoa and Galliera Hospital of Genoa, who revised the statistics as external reviewer.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
For the present retrospective study formal consent was not required.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Crescenzi, A., Trimboli, P., Basolo, F. et al. Exploring the Inter-observer Agreement Among the Members of the Italian Consensus for the Classification and Reporting of Thyroid Cytology. Endocr Pathol 31, 301–306 (2020). https://doi.org/10.1007/s12022-020-09636-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12022-020-09636-z