Skip to main content

Advertisement

Log in

Comparison of an administrative algorithm for SLE disease severity to clinical SLE Disease Activity Index scores

  • Observational Research
  • Published:
Rheumatology International Aims and scope Submit manuscript

Abstract

Systemic lupus erythematosus (SLE) severity, reflecting both disease intensity and duration, is heterogeneous making it challenging to study in administrative databases where severity may confound or mediate associations with outcomes. Garris et al. developed an administrative claims-based algorithm employing claims over a 1-year period to classify SLE severity as mild, moderate or severe. We sought to compare this administrative algorithm to a measure of SLE activity, the SLE Disease Activity Index-2000 (SLEDAI-2K) score at clinical visits. We identified 100 SLE patients followed in the Brigham and Women’s Hospital (BWH) Lupus Center (in 2008–2010) with SLEDAI-2K scores at each visit over a 1-year period per person. We obtained data for the Garris algorithm for the same year per subject. We compared Garris SLE severity to the highest SLEDAI-2K in that year, with SLEDAI-2K categories of mild < 3, moderate 3–6, and severe > 6. We compared classification using weighted kappa statistics, and positive and negative predictive values (PPV, NPV). We also assessed the binary comparison of mild vs. moderate/severe. We calculated sensitivity, specificity, and McNemar’s test. We analyzed 377 SLEDAI-2K assessments (mean 3.8 [SD 2.6] per subject/year). For classifying moderate/severe vs. mild SLE severity, the sensitivity was 85.7%, specificity 67.6%, PPV 81.8% and NPV 73.5%. The Garris algorithm for classifying SLE severity in administrative datasets had moderate agreement for classification of mild vs. moderate/severe SLE activity assessed by SLEDAI-2K assessments in an academic lupus center. It may be a useful tool for classifying SLE severity in administrative database studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

References

  1. Petri M, Hellmann D, Hochberg M (1992) Validity and reliability of lupus activity measures in the routine clinic setting. J Rheumatol 19:53–59

    CAS  PubMed  Google Scholar 

  2. Garris C, Jhingran P, Bass D, Engel-Nitz NM, Riedel A, Dennis G (2013) Healthcare utilization and cost of systemic lupus erythematosus in a US managed care health plan. J Med Econ 16:667–677

    Article  Google Scholar 

  3. Gladman DD, Ibanez D, Urowitz MB (2002) Systemic lupus erythematosus disease activity index 2000. J Rheumatol 29:288–291

    PubMed  Google Scholar 

  4. Liang MH, Socher SA, Larson MG, Schur PH (1989) Reliability and validity of six systems for the clinical assessment of disease activity in systemic lupus erythematosus. Arthritis Rheum 32:1107–1118

    Article  CAS  Google Scholar 

  5. Isenberg DA, Rahman A, Allen E, Farewell V, Akil M, Bruce IN et al (2005) BILAG 2004. Development and initial validation of an updated version of the British Isles Lupus Assessment Group's disease activity index for patients with systemic lupus erythematosus. Rheumatology (Oxford) 44:902–906

    Article  CAS  Google Scholar 

  6. Polachek A, Gladman DD, Su J, Urowitz MB (2017) Defining low disease activity in systemic lupus erythematosus. Arthritis Care Res (Hoboken) 69:997–1003

    Article  CAS  Google Scholar 

  7. Nalichowski R, Keogh D, Chueh HC, Murphy SN (2006) Calculating the benefits of a Research Patient Data Repository. In: AMIA Annual Symposium Proceedings, p 1044

  8. Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220

    Article  CAS  Google Scholar 

  9. McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 22:276–282

    Article  Google Scholar 

  10. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N et al (2010) Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 21:128–138

    Article  Google Scholar 

Download references

Acknowledgements

We thank Christopher Bell (GlaxoSmithKline) for his assistance in supplying the algorithm and associated list of codes, and Emma Stevens for her help with technical review of the manuscript.

Funding

This research was supported by NIH R01 AR057327 and K24 AR066109 (Dr. Costenbader). Dr. Feldman is supported by NIH K23 AR071500.

Author information

Authors and Affiliations

Authors

Contributions

CBS, DL, HG, KY, ES, AMJ, BME, CHF, KHC: conception of study or data acquisition, analysis and interpretation. CBS, DL, HG, KY, ES, AMJ, BME, CHF, KHC: drafting the work or revising it critically. CBS, DL, HG, KY, ES, AMJ, BME, CHF, KHC: final approval of the version to be published. CBS, DL, HG, KY, ES, AMJ, BME, CHF, KHC: agreement to be accountable for all aspects of the work.

Corresponding author

Correspondence to Karen H. Costenbader.

Ethics declarations

Conflict of interest

All authors declare that they have no conflicts of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. Approval for this study was under Partners’ Healthcare Institution IRB 2018P000448 approved March 14, 2018.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Speyer, C.B., Li, D., Guan, H. et al. Comparison of an administrative algorithm for SLE disease severity to clinical SLE Disease Activity Index scores. Rheumatol Int 40, 257–261 (2020). https://doi.org/10.1007/s00296-019-04477-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00296-019-04477-4

Keywords

Navigation