Abstract
Objectives
To identify the optimal method for evaluation of coronary artery calcium (CAC) severity on non-electrocardiogram-gated low-dose chest computed tomography (LDCT) in a nationwide lung cancer screening registry.
Methods
A total of 256 subjects were retrospectively enrolled from participants of the Korean Lung Cancer Screening (K-LUCAS) project (an LDCT lung cancer screening registry for high-risk individuals). Four board-certified cardiothoracic radiologists independently assessed CAC severity using four different scoring methods (visual assessment, artery-based grading, segment-involvement grading, and segment-based grading) and classified severity for each case using all four methods as none, mild, moderate, or severe. Agreements between the four observers for CAC category classification and between the four different scoring methods for the same observer were assessed by Fleiss kappa statistics. Evaluation time for CAC grading was compared between observers and between grading methods.
Results
Interobserver agreement was moderate for visual assessment (Fleiss kappa 0.451) and substantial for the other three methods (Fleiss kappa 0.673–0.704). Agreement between the four grading methods for the same observer was substantial for three observers (Fleiss kappa 0.610–0.705) and moderate for one (Fleiss kappa 0.578). Mean evaluation time differed significantly between methods (visual assessment, 14.3 ± 11.8 s; artery-based grading, 17.6 ± 22.3 s, segment-involvement grading, 19.2 ± 6.8 s; segment-based grading, 34.2 ± 37.4 s; p < 0.01).
Conclusion
Artery-based grading could be appropriate with substantial interobserver agreement and an acceptable mean evaluation time.
Key Points
• CAC severity grading methods on LDCT show moderate to substantial agreements between grading methods and observers.
• Artery-based grading could be appropriate with substantial interobserver agreement and a mean evaluation time of 17.6 s.
• Visual assessment is disadvantaged by high interobserver variability despite having the shortest evaluation time.
Similar content being viewed by others
Abbreviations
- ACR:
-
American College of Radiology
- CAC:
-
Coronary artery calcium
- CAD:
-
Coronary artery disease
- CI:
-
Confidence interval
- ECG:
-
Electrocardiogram
- K-LUCAS:
-
Korean Lung Cancer Screening
- LAD:
-
Left anterior descending
- LCx:
-
Left circumflex
- LDCT:
-
Low-dose computed tomography
- LM:
-
Left main
- Lung-RADS:
-
Lung CT Screening Reporting and Data System
- NLST:
-
National Lung Screening Trial
- RCA:
-
Right coronary artery
- SCCT:
-
Society of Cardiovascular Computed Tomography
- STR:
-
Society of Thoracic Radiology
References
Lortet-Tieulent J, Soerjomataram I, Ferlay J, Rutherford M, Weiderpass E, Bray F (2014) International trends in lung cancer incidence by histological subtype: adenocarcinoma stabilizing in men but still increasing in women. Lung Cancer 84:13–22
National Lung Screening Trial Research T, Aberle DR, Adams AM et al (2011) Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med 365:395–409
Koene RJ, Prizment AE, Blaes A, Konety SH (2016) Shared risk factors in cardiovascular disease and cancer. Circulation 133:1104–1114
Lu MT, Onuma OK, Massaro JM, D’Agostino RB Sr, O’Donnell CJ, Hoffmann U (2016) Lung cancer screening eligibility in the community: cardiovascular risk factors, coronary artery calcification, and cardiovascular events. Circulation 134:897–899
Arjmand Shabestari A (2013) Coronary artery calcium score: a review. Iran Red Crescent Med J 15:e16616
Xie X, Zhao Y, de Bock GH et al (2013) Validation and prognosis of coronary artery calcium scoring in nontriggered thoracic computed tomography: systematic review and meta-analysis. Circ Cardiovasc Imaging 6:514–521
Christensen JL, Sharma E, Gorvitovskaia AY et al (2019) Impact of slice thickness on the predictive value of lung cancer screening computed tomography in the evaluation of coronary artery calcification. J Am Heart Assoc 8:e010110
Jacobs PC, Gondrie MJ, van der Graaf Y et al (2012) Coronary artery calcium can predict all-cause mortality and cardiovascular events on low-dose CT screening for lung cancer. AJR Am J Roentgenol 198:505–511
Mets OM, Vliegenthart R, Gondrie MJ et al (2013) Lung cancer screening CT-based prediction of cardiovascular events. JACC Cardiovasc Imaging 6:899–907
Chiles C, Duan F, Gladish GW et al (2015) Association of coronary artery calcification and mortality in the National Lung Screening Trial: a comparison of three scoring methods. Radiology 276:82–90
Reiter MJ, Nemesure A, Madu E, Reagan L, Plank A (2018) Frequency and distribution of incidental findings deemed appropriate for S modifier designation on low-dose CT in a lung cancer screening program. Lung Cancer 120:1–6
Hecht HS, Cronin P, Blaha MJ et al (2017) 2016 SCCT/STR guidelines for coronary artery calcium scoring of noncontrast noncardiac chest CT scans: a report of the Society of Cardiovascular Computed Tomography and Society of Thoracic Radiology. J Cardiovasc Comput Tomogr 11:74–84
Shemesh J, Henschke CI, Shaham D et al (2010) Ordinal scoring of coronary artery calcifications on low-dose CT scans of the chest is predictive of death from cardiovascular disease. Radiology 257:541–548
Htwe Y, Cham MD, Henschke CI et al (2015) Coronary artery calcification on low-dose computed tomography: comparison of Agatston and ordinal scores. Clin Imaging 39:799–802
Lee J, Lim J, Kim Y et al (2019) Development of protocol for Korean Lung Cancer Screening Project (K-LUCAS) to evaluate effectiveness and feasibility to implement National Cancer Screening Program. Cancer Res Treat 51:1285–1294
Lee JW, Kim HY, Goo JM et al (2018) Radiological report of pilot study for the Korean Lung Cancer Screening (K-LUCAS) project: feasibility of implementing lung imaging reporting and data system. Korean J Radiol 19:803–808
Kim EY, Kim TJ, Goo JM et al (2018) Size-specific dose estimation in the Korean Lung Cancer Screening project: does a 32-cm diameter phantom represent a standard-sized patient in Korean population? Korean J Radiol 19:1179–1186
Min JK, Shaw LJ, Devereux RB et al (2007) Prognostic value of multidetector coronary computed tomographic angiography for prediction of all-cause mortality. J Am Coll Cardiol 50:1161–1170
ACR NRDR – LCSR Exam Form. Available via https://nrdrsupport.acr.org/support/solutions/articles/11000041249?_ga=2.141997808.373020462.1559750799-1976387718.1559750799. Accessed June 15 2019
Grundy SM, Stone NJ, Bailey AL et al (2019) 2018 AHA/ACC/AACVPR/AAPA/ABC/ACPM/ADA/AGS/APhA/ASPC/NLA/PCNA guideline on the management of blood cholesterol: a report of the American College of Cardiology/American Heart Association task force on clinical practice guidelines. J Am Coll Cardiol 73:e285–e350
Kim SM, Chung MJ, Lee KS, Choe YH, Yi CA, Choe BK (2008) Coronary calcium screening using low-dose lung cancer screening: effectiveness of MDCT with retrospective reconstruction. AJR Am J Roentgenol 190:917–922
Wu MT, Yang P, Huang YL et al (2008) Coronary arterial calcification on low-dose ungated MDCT for lung cancer screening: concordance study with dedicated cardiac CT. AJR Am J Roentgenol 190:923–928
Budoff MJ, Nasir K, Kinney GL et al (2011) Coronary artery and thoracic calcium on noncontrast thoracic CT scans: comparison of ungated and gated examinations in patients from the COPD Gene cohort. J Cardiovasc Comput Tomogr 5:113–118
Itani Y, Sone S, Nakayama T et al (2004) Coronary artery calcification detected by a mobile helical computed tomography unit and future cardiovascular death: 4-year follow-up of 6120 asymptomatic Japanese. Heart Vessels 19:161–163
Jacobs PC, Gondrie MJ, Mali WP et al (2011) Unrequested information from routine diagnostic chest CT predicts future cardiovascular events. Eur Radiol 21:1577–1585
Sverzellati N, Cademartiri F, Bravi F et al (2012) Relationship and prognostic value of modified coronary artery calcium score, FEV1, and emphysema in lung cancer screening population: the MILD trial. Radiology 262:460–467
Carter BW, Lichtenberger JP 3rd, Wu CC, Munden RF (2018) Screening for lung cancer: lexicon for communicating with health care providers. AJR Am J Roentgenol 210:473–479
Kim YK, Sung YM, Cho SH, Park YN, Choi HY (2014) Reliability analysis of visual ranking of coronary artery calcification on low-dose CT of the thorax for lung cancer screening: comparison with ECG-gated calcium scoring CT. Int J Cardiovasc Imaging 30(Suppl 2):81–87
Chen Y, Hu Z, Li M et al (2019) Comparison of nongated chest CT and dedicated calcium scoring CT for coronary calcium quantification using a 256-dector row CT scanner. Acad Radiol 26:e267–e274
Lessmann N, van Ginneken B, Zreik M et al (2018) Automatic calcium scoring in low-dose chest CT using deep neural networks with dilated convolutions. IEEE Trans Med Imaging 37:615–625
de Vos BD, Wolterink JM, Leiner T, de Jong PA, Lessmann N, Isgum I (2019) Direct automatic coronary calcium scoring in cardiac and chest CT. IEEE Trans Med Imaging 38:2127–2138
Zhang Y, van der Werf NR, Jiang B, van Hamersvelt R, Greuter MJW, Xie X (2020) Motion-corrected coronary calcium scores by a convolutional neural network: a robotic simulating study. Eur Radiol 30:1285–1294
Funding
This study was supported by a grant from the National R&D Program for Cancer Control, Ministry for Health and Welfare (1720310, 1520230), and National Cancer Center (1760810-1), Republic of Korea.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Guarantor
The scientific guarantor of this publication is Hwan Seok Yong.
Conflict of interest
The authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.
Statistics and biometry
No complex statistical methods were necessary for this paper.
Informed consent
Written informed consent was obtained from all subjects (patients) in this study.
Ethical approval
Institutional Review Board approval was obtained.
Methodology
• Retrospective
• Observational study
• Multicenter study
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
ESM 1
(DOCX 968 kb)
Rights and permissions
About this article
Cite this article
Suh, Y.J., Lee, J.W., Shin, S.Y. et al. Coronary artery calcium severity grading on non-ECG-gated low-dose chest computed tomography: a multiple-observer study in a nationwide lung cancer screening registry. Eur Radiol 30, 3684–3691 (2020). https://doi.org/10.1007/s00330-020-06707-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00330-020-06707-x