Skip to main content

Advertisement

Log in

Assessing the value of a censored surrogate outcome

  • Published:
Lifetime Data Analysis Aims and scope Submit manuscript

Abstract

Assessing the potential of surrogate markers and surrogate outcomes for replacing a long term outcome is an active area of research. The interest in this topic is partly motivated by increasing pressure from stakeholders to shorten the time required to evaluate the safety and/or efficacy of a treatment or intervention such that treatments deemed safe and effective can be made available to those in need more quickly. Most existing methods in surrogacy evaluation either require strict model assumptions or that primary outcome and surrogate outcome information is available for all study participants. In this paper, we focus on a setting where the primary outcome is subject to censoring and the aim is to quantify the surrogacy of an intermediate outcome, which is also subject to censoring. We define the surrogacy as the proportion of treatment effect on the primary outcome that is explained by the intermediate surrogate outcome information and propose two robust methods to estimate this quantity. We propose both a nonparametric approach that uses a kernel smoothed Nelson–Aalen estimator of conditional survival, and a semiparametric method that derives conditional survival estimates from a landmark Cox proportional hazards model. Simulation studies demonstrate that both approaches perform well in finite samples. Our methodological development is motivated by our interest in investigating the use of a composite cardiovascular endpoint as a surrogate outcome in a randomized study of the effectiveness of angiotensin-converting enzyme inhibitors on survival. We apply the proposed methods to quantify the surrogacy of this potential surrogate outcome for the primary outcome, time to death.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Alberti KGMM, Zimmet P, Shaw J (2006) Metabolic syndrome? A new world-wide definition. A consensus statement from the international diabetes federation. Diabet Med 23(5):469–480

    Article  Google Scholar 

  • ALLHAT (2000) Major cardiovascular events in hypertensive patients randomized to doxazosin vs chlorthalidone: the antihypertensive and lipid-lowering treatment to prevent heart attack trial (allhat). Jama 283:1967–1975

    Article  Google Scholar 

  • Broglio KR, Berry DA (2009) Detecting an overall survival benefit that is derived from progression-free survival. J Natl Cancer Inst 101:1642–1649

    Article  Google Scholar 

  • Burzykowski T, Molenberghs G, Buyse M, Geys H, Renard D (2001) Validation of surrogate end points in multiple randomized clinical trials with failure time end points. J R Stat Soc Ser C (Appl Stat) 50(4):405–422

    Article  MathSciNet  MATH  Google Scholar 

  • Buyse M, Molenberghs G (1998) Criteria for the validation of surrogate endpoints in randomized experiments. Biometrics 54(3):1014–1029

    Article  MATH  Google Scholar 

  • Buyse M, Burzykowski T, Carroll K, Michiels S, Sargent DJ, Miller LL, Elfring GL, Pignon JP, Piedbois P (2007) Progression-free survival is a surrogate for survival in advanced colorectal cancer. J Clin Oncol 25(33):5218–5224

    Article  Google Scholar 

  • Cameron DW, Heath-Chiozzi M, Danner S, Cohen C, Kravcik S, Maurath C, Sun E, Henry D, Rode R, Potthoff A et al (1998) Randomised placebo-controlled trial of ritonavir in advanced HIV-1 disease. The Lancet 351(9102):543–549

    Article  Google Scholar 

  • Choi S, Lagakos SW, Schooley RT, Volberding PA (1993) Cd4+ lymphocytes are an incomplete surrogate marker for clinical progression in persons with asymptomatic HIV infection taking zidovudine. Ann Intern Med 118(9):674–680

    Article  Google Scholar 

  • Conlon AS, Taylor JM, Elliott MR (2014) Surrogacy assessment using principal stratification when surrogate and outcome measures are multivariate normal. Biostatistics 15(2):266–283

    Article  Google Scholar 

  • Eastwood JA, Doering LV (2005) Gender differences in coronary artery disease. J Cardiovasc Nurs 20(5):340–351

    Article  Google Scholar 

  • Egger M, Hirschel B, Francioli P, Sudre P, Wirz M, Flepp M, Rickenbach M, Malinverni R, Vernazza P, Battegay M (1997) Impact of new antiretroviral combination therapies in HIV infected patients in switzerland: prospective multicentre study. Bmj 315(7117):1194–1199

    Article  Google Scholar 

  • Elliott MR, Conlon AS, Li Y, Kaciroti N, Taylor JM (2015) Surrogacy marker paradox measures in meta-analytic settings. Biostatistics 16(2):400–412

    Article  MathSciNet  Google Scholar 

  • FDA (2008) Guidance for industry diabetes mellitus: developing drugs and therapeutic biologics for treatment and prevention. https://www.fda.gov/downloads/Drugs/.../Guidances/ucm071624.pdf. Accessed 9 Apr 2019

  • Fleming TR, Prentice RL, Pepe MS, Glidden D (1994) Surrogate and auxiliary endpoints in clinical trials, with potential applications in cancer and aids research. Stat Med 13(9):955–968

    Article  Google Scholar 

  • Frangakis CE, Rubin DB (2002) Principal stratification in causal inference. Biometrics 58(1):21–29

    Article  MathSciNet  MATH  Google Scholar 

  • Freedman LS, Graubard BI, Schatzkin A (1992) Statistical validation of intermediate endpoints for chronic diseases. Stat Med 11(2):167–178

    Article  Google Scholar 

  • Frontoni S, Di Bartolo P, Avogaro A, Bosi E, Paolisso G, Ceriello A (2013) Glucose variability: an emerging target for the treatment of diabetes mellitus. Diabetes Res Clin Pract 102(2):86–95

    Article  Google Scholar 

  • Gabriel EE, Sachs MC, Gilbert PB (2015) Comparing and combining biomarkers as principle surrogates for time-to-event clinical endpoints. Stat Med 34(3):381–395

    Article  MathSciNet  Google Scholar 

  • Ghosh D (2008) Semiparametric inference for surrogate endpoints with bivariate censored data. Biometrics 64(1):149–156

    Article  MathSciNet  MATH  Google Scholar 

  • Ghosh D (2009) On assessing surrogacy in a single trial setting using a semicompeting risks paradigm. Biometrics 65(2):521–529

    Article  MathSciNet  MATH  Google Scholar 

  • Gilbert PB, Hudgens MG (2008) Evaluating candidate principal surrogate endpoints. Biometrics 64(4):1146–1154

    Article  MathSciNet  MATH  Google Scholar 

  • Hammer S, Katzenstein D, Hughes M, Gundacker H, Schooley R, Haubrich R, Henry W, Lederman M, Phair J, Niu M et al (1996) A trial comparing nucleoside monotherapy with combination therapy in HIV-infected adults with CD4 cell counts from 200 to 500 per cubic millimeter. N Engl J Med 335(15):1081–1090

    Article  Google Scholar 

  • Huang Y, Gilbert PB (2011) Comparing biomarkers as principal surrogate endpoints. Biometrics 67(4):1442–1451

    Article  MathSciNet  MATH  Google Scholar 

  • Hughes MD, Daniels MJ, Fischl MA, Kim S, Schooley RT (1998) Cd4 cell count as a surrogate endpoint in HIV clinical trials: a meta-analysis of studies of the aids clinical trials group. Aids 12(14):1823–1832

    Article  Google Scholar 

  • Inker LA, Levey AS, Pandya K, Stoycheff N, Okparavero A, Greene T, Collaboration CKDE et al (2014) Early change in proteinuria as a surrogate end point for kidney disease progression: an individual patient meta-analysis. Am J Kidney Dis 64(1):74–85

    Article  Google Scholar 

  • Jordan R, Gold L, Cummins C, Hyde C (2002) Systematic review and meta-analysis of evidence for increasing numbers of drugs in antiretroviral combination therapy. Bmj 324(7340):757

    Article  Google Scholar 

  • Ledergerber B, Egger M, Opravil M, Telenti A, Hirschel B, Battegay M, Vernazza P, Sudre P, Flepp M, Furrer H et al (1999) Clinical progression and virological failure on highly active antiretroviral therapy in HIV-1 patients: a prospective cohort study. The Lancet 353(9156):863–868

    Article  Google Scholar 

  • Lin D, Fischl MA, Schoenfeld D (1993) Evaluating the role of cd4-lymphocyte counts as surrogate endpoints in human immunodeficiency virus clinical trials. Stat Med 12(9):835–842

    Article  Google Scholar 

  • Lin D, Fleming T, De Gruttola V et al (1997) Estimating the proportion of treatment effect explained by a surrogate marker. Stat Med 16(13):1515–1527

    Article  Google Scholar 

  • Lorenzo C, Williams K, Stern MP, Haffner SM (2003) The metabolic syndrome as predictor of type 2 diabetes. Diabetes Care 26(11):3153–3159

    Article  Google Scholar 

  • Maas A, Appelman Y (2010) Gender differences in coronary heart disease. Neth Heart J 18(12):598–603

    Article  Google Scholar 

  • NHLBI (2008) NHLBI data repository: prevention of events with angiotensin-converting enzyme inhibitor therapy (peace). https://biolincc.nhlbi.nih.gov/studies/peace/. Accessed 9 Apr 2019

  • Parast L, Cai T (2013) Landmark risk prediction of residual life for breast cancer survival. Stat Med 32(20):3459–3471. https://doi.org/10.1002/sim.5776

    Article  MathSciNet  Google Scholar 

  • Parast L, McDermott MM, Tian L (2016) Robust estimation of the proportion of treatment effect explained by surrogate marker information. Stat Med 35(10):1637–1653

    Article  MathSciNet  Google Scholar 

  • Parast L, Cai T, Tian L (2017) Evaluating surrogate marker information using censored data. Stat Med 36(11):1767–1782

    Article  MathSciNet  Google Scholar 

  • PEACE (2004) Angiotensin-converting-enzyme inhibition in stable coronary artery disease. N Engl J Med 2004(351):2058–2068

    Google Scholar 

  • Ridker PM, Cook NR, Lee IM, Gordon D, Gaziano JM, Manson JE, Hennekens CH, Buring JE (2005) A randomized trial of low-dose aspirin in the primary prevention of cardiovascular disease in women. N Engl J Med 352(13):1293–1304

    Article  Google Scholar 

  • Robins JM, Greenland S (1992) Identifiability and exchangeability for direct and indirect effects. Epidemiology 3(2):143–155

    Article  Google Scholar 

  • Royston P, Parmar MK (2011) The use of restricted mean survival time to estimate the treatment effect in randomized clinical trials when the proportional hazards assumption is in doubt. Stat Med 30(19):2409–2421

    Article  MathSciNet  Google Scholar 

  • Royston P, Parmar MK (2013) Restricted mean survival time: an alternative to the hazard ratio for the design and analysis of randomized trials with a time-to-event outcome. BMC Med Res Methodol 13(1):152

    Article  Google Scholar 

  • Stevens LA, Greene T, Levey AS (2006) Surrogate end points for clinical trials of kidney disease progression. Clin J Am Soc Nephrol 1(4):874–884

    Article  Google Scholar 

  • Tian L, Zhao L, Wei L (2013) Predicting the restricted mean event time with the subject’s baseline covariates in survival analysis. Biostatistics 15(2):222–233

    Article  Google Scholar 

  • Van der Weele TJ (2013) Surrogate measures and consistent surrogates. Biometrics 69(3):561–565

    Article  MathSciNet  MATH  Google Scholar 

  • Verweij J, Casali PG, Zalcberg J, LeCesne A, Reichardt P, Blay JY, Issels R, van Oosterom A, Hogendoorn PC, Van Glabbeke M et al (2004) Progression-free survival in gastrointestinal stromal tumours with high-dose imatinib: randomised trial. The Lancet 364(9440):1127–1134

    Article  Google Scholar 

  • Wang Y, Taylor JM (2002) A measure of the proportion of treatment effect explained by a surrogate marker. Biometrics 58(4):803–812

    Article  MathSciNet  MATH  Google Scholar 

  • Wittes J, Lakatos E, Probstfield J (1989) Surrogate endpoints in clinical trials: cardiovascular diseases. Stat Med 8(4):415–425

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Layla Parast.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix: Theoretical properties

Appendix: Theoretical properties

The derivations below show that \({\widehat{\varDelta }}_Q(\tau ,t_0)\) is a consistent estimator of \(\varDelta _Q(t,t_0)\) and that

$$\begin{aligned} \sqrt{n}\left( \begin{array}{c}{\widehat{\varDelta }}_Q(\tau ,t_0) -\varDelta _Q(\tau ,t_0) \\ {\widehat{\varDelta }}(\tau )-\varDelta (\tau )\end{array}\right) \rightarrow N(0, \varSigma _\varDelta ) \ \text{ in } \text{ distribution }, \quad \text{ as } \,\,\,n_A, n_B \rightarrow \infty . \end{aligned}$$

We first note that

$$\begin{aligned}&\sqrt{n_A}\left\{ {\widehat{\psi }}_A(\tau |t_0)-\psi _A(\tau |t_0)\right\} \\&\quad = \frac{1}{\sqrt{n_A}}\sum _{i=1}^{n_A} \left[ \frac{(T_{Ai}\wedge \tau ) I(S_{Ai}\wedge X_{Ai}>t_0)\delta _{Ai}^{\tau }}{\text{ pr }(S_{Ai}\wedge T_{Ai}>t_0)W_{A}^{C}(T_{Ai}\wedge \tau )}-\psi _A(\tau |t_0)\right] \\&\quad \quad -\frac{1}{\sqrt{n_A}}\sum _{i=1}^{n_A}E\left\{ \frac{(T_{Ai}\wedge \tau ) I(S_{Ai}\wedge X_{Ai}>t_0)\delta _{Ai}^{\tau }}{\text{ pr }(S_{Ai}\wedge T_{Ai}>t_0)W_{A}^{C}(T_{Ai}\wedge \tau )}\right\} \int _0^{t_0}\frac{dM_{Ai}^{C}(t)}{\text{ pr }(X_{Ai}\ge t)} \\&\quad \quad +\frac{1}{\sqrt{n_A}}\sum _{i=1}^{n_A} \frac{(T_{Ai}\wedge \tau ) I(S_{Ai}\wedge X_{Ai}>t_0)\delta _{Ai}^{\tau } }{\text{ pr }(S_{Ai}\wedge T_{Ai}>t_0)W_{A}^{C}(T_{Ai}\wedge \tau )} \int _0^\tau \frac{I( T_{Ai}>t)dM_{Ai}^{C}(t)}{\text{ pr }(X_{Ai}\ge t)}\\&\quad \quad -\frac{1}{\sqrt{n_A}} \sum _{i=1}^{n_A}E\left\{ \frac{W_A^{C}(t_0)(T_{Ai}\wedge \tau ) I(S_{Ai}\wedge X_{Ai}>t_0)\delta _{Ai}^{\tau } }{\text{ pr }(S_{Ai}\wedge X_{Ai}>t_0)^2W_{A}^{C}(T_{Ai}\wedge \tau )}\right\} \left\{ I(S_{Ai}\wedge X_{Ai}>t_0)\right. \\&\quad \quad \left. -\text{ pr }(S_{Ai}\wedge X_{Ai}>t_0)\right\} +o_p(1)\\&\quad =\frac{1}{\sqrt{n_A}}\sum _{i=1}^{n_A} \xi _{Ai}+o_p(1), \end{aligned}$$

and

$$\begin{aligned}&\sqrt{n_B}\left\{ {\widehat{v}}_B(\tau |t_0)-v_B(\tau |t_0)\right\} \\&\quad = \frac{1}{\sqrt{n_B}}\sum _{i=1}^{n_B} \left[ \frac{(T_{Bi}\wedge \tau ) I(X_{Bi}>t_0)\delta _{Bi}^{\tau } }{\text{ pr }( T_{Bi}>t_0)W_{B}^{C}(T_{Bi}\wedge \tau )}-\psi _B(\tau |t_0)\right] \\&\quad \quad -\frac{1}{\sqrt{n_B}}\sum _{i=1}^{n_B}E\left\{ \frac{(T_{Bi}\wedge \tau ) I( X_{Bi}>t_0)\delta _{Bi}^{\tau }}{\text{ pr }( T_{Bi}>t_0)W_{B}^{C}(T_{Bi}\wedge \tau )}\right\} \int _0^{t_0}\frac{dM_{Bi}^{C}(t)}{\text{ pr }(X_{Bi}\ge t)} \\&\quad \quad +\frac{1}{\sqrt{n_B}}\sum _{i=1}^{n_B} \frac{(T_{Bi}\wedge \tau ) I( X_{Bi}>t_0)\delta _{Bi}^{\tau } }{\text{ pr }( T_{Bi}>t_0)W_{B}^{C}(T_{Bi}\wedge \tau )} \int _0^\tau \frac{I( T_{Bi}>t)dM_{Bi}^{C}(t)}{\text{ pr }(X_{Bi}\ge t)}\\&\quad \quad -\frac{1}{\sqrt{n_B}}\sum _{i=1}^{n_B} E\left\{ \frac{(T_{Bi}\wedge \tau ) I( X_{Bi}>t_0)\delta _{Bi}^{\tau } W_B^{C}(t_0)}{\text{ pr }( X_{Bi}>t_0)^2W_{B}^{C}(T_{Bi}\wedge \tau )}\right\} \\&\qquad \times \left\{ I( X_{Bi}>t_0) -\text{ pr }( X_{Bi}>t_0)\right\} +o_p(1)\\&=\frac{1}{\sqrt{n_B}}\sum _{i=1}^{n_B} \xi _{Bi}+o_p(1), \end{aligned}$$

where \(E(\xi _{Ai})=E(\xi _{Bi})=0,\)\(\delta _{gi}^{\tau }=I(C_{gi}>T_{gi}\wedge \tau ),\)\(M_{gi}^{C}(t)=I(T_{gi}<t)(1-\delta _{gi})-\int _0^t I(X_{gi}>s)d\varLambda _{g}^{C}(s)\) and \(\varLambda _{g}^{C}(\cdot )\) is the cumulative hazard function of the censoring distribution in group g. It then follows, using the same arguments as in Parast et al. (2017), that

$$\begin{aligned} \frac{1}{\sqrt{n_B}}\sum _{i=1}^{n_B}\left\{ \frac{I(X_{Bi}>t_0, S_{Bi}<t_0)}{{\widehat{W}}_B^{C}(t_0)}{\widehat{\phi }}_A(\tau |t_0, S_{Bi})-P_{t_0,2}^{(B)}\int _0^{t_0}\phi _A(\tau |t_0, s)dF_B(s)\right\} \end{aligned}$$

is asymptotically equivalent to the expansion

$$\begin{aligned} \frac{1}{\sqrt{n_B}}\sum _{i=1}^{n_B} \eta _{Bi}(\tau , t_0)+\frac{1}{\sqrt{n_A}}\sum _{j=1}^{n_A} \eta _{Aj}(\tau , t_0), \end{aligned}$$

where \(\{\eta _{Bi}, i=1, \cdots , n_B\}\) and \(\{\eta _{Aj}, j=1, \cdots , n_A\}\) are two sets of mean zero i.i.d random variables. Coupled with the fact that

$$\begin{aligned}&\sqrt{n_B}\left\{ \left( \begin{array}{c} \frac{1}{n_B} \sum _{i=1}^{n_B} I(S_{Bi}\wedge X_{Bi}>t_0)\\ \frac{1}{n_B} \sum _{i=1}^{n_B} I(X_{Bi}>t_0)\\ {\widehat{W}}_B^C(t_0) \end{array} \right) - \left( \begin{array}{c} \text{ pr }(S_{Bi}\wedge X_{Bi}>t_0)\\ \text{ pr }(X_{Bi}>t_0)\\ W_B^C(t_0) \end{array} \right) \right\} \\&\quad =\frac{1}{\sqrt{n_B}} \sum _{i=1}^{n_B} \left( \begin{array}{c} I(S_{Bi}\wedge X_{Bi}>t_0)-\text{ pr }(S_{Bi}\wedge X_{Bi}>t_0)\\ I(X_{Bi}>t_0)-\text{ pr }(X_{Bi}>t_0)\\ -W_B^C(t_0)\int _0^{t_0} \frac{dM_B^C(t)}{\text{ pr }(X_{Bi}>t)}\end{array}\right) +o_p(1), \end{aligned}$$

these results imply that

$$\begin{aligned} \sqrt{n}\left\{ {\widehat{\varDelta }}_Q(\tau , t_0)-\varDelta _Q(\tau , t_0)\right\} =\frac{1}{\sqrt{n_B}}\sum _{i=1}^{n_B} \zeta _{Bi}(\tau , t_0)+\frac{1}{\sqrt{n_A}}\sum _{j=1}^{n_A} \zeta _{Aj}(\tau , t_0)+o_p(1) \end{aligned}$$

using the delta method, where \(\zeta _{gi}\) are i.i.d mean zero random variables, assuming that \(n_g/n=\pi _g, g=A, B\) are constant as \(n \rightarrow \infty .\) The asymptotical normality of \( \sqrt{n}\left\{ {\widehat{\varDelta }}_Q(\tau , t_0)-\varDelta _Q(\tau , t_0)\right\} \) then follows from the central limit theorem.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Parast, L., Tian, L. & Cai, T. Assessing the value of a censored surrogate outcome. Lifetime Data Anal 26, 245–265 (2020). https://doi.org/10.1007/s10985-019-09473-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10985-019-09473-1

Keywords

Navigation