|
|||||
|
|
||||||
Journal of Clinical Oncology, Vol 25, No 33 (November 20), 2007: pp. 5218-5224 © 2007 American Society of Clinical Oncology. DOI: 10.1200/JCO.2007.11.8836 Progression-Free Survival Is a Surrogate for Survival in Advanced Colorectal Cancer
From the International Drug Development Institute, Louvain-la-Neuve; Center for Statistics, Hasselt University, Diepenbeek, Belgium; Oncology Therapy Area, AstraZeneca Research and Development, Macclesfield, United Kingdom; Biostatistics and Epidemiology Unit, Institut Gustave Roussy, Villejuif; Oncology Therapy Area, AstraZeneca, Rueil Malmaison, France; Division of Biostatistics, Mayo Clinic, Rochester, MN; and PTC Therapeutics, South Plainfield, NJ Address reprint requests to Marc Buyse, ScD, IDDI, 30 avenue Provinciale, 1340 Louvain-la-Neuve, Belgium; e-mail: marc.buyse{at}iddi.com
Purpose The traditional end point for assessing efficacy of first-line chemotherapies for advanced cancer is overall survival (OS), but this end point requires prolonged follow-up and is potentially confounded by the effects of second-line therapies. We investigated whether progression-free survival (PFS) could be considered a valid surrogate for OS in advanced colorectal cancer. Patients and Methods Individual patient data were available from 10 historical trials comparing fluouracil (FU) + leucovorin with either FU alone (1,744 patients) or with raltitrexed (1,345 patients) and from three validation trials comparing FU + leucovorin with or without irinotecan or oxaliplatin (1,263 patients). Correlation coefficients were estimated in historical trials between the end points of PFS and OS, and between the treatment effects on these end points. Treatment effects on OS were predicted in validation trials, and compared with the observed effects. Results In historical trials, 1,760 patients (57%) had progressed or died at 6 months, and 1,622 (52%) had died at 12 months. The rank correlation coefficient between PFS and OS was equal to 0.82 (95% CI, 0.82 to 0.83). The correlation coefficient between treatment effects on PFS and on OS ranged from 0.99 (95% CI, 0.94 to 1.04) when all trials were considered to 0.74 (95% CI, 0.44 to 1.04) after exclusion of one highly influential trial. In the validation trials, the observed OS hazard ratios were within the 95% prediction intervals. A hazard ratio of 0.77 or lower in terms of PFS would predict a benefit in terms of OS. Conclusion PFS is an acceptable surrogate for OS in advanced colorectal cancer.
Approximately 50% of patients diagnosed with colorectal carcinoma have metastatic or nonresectable disease at time of diagnosis or will develop metastases or a locoregional recurrence after their initial diagnosis. Substantial progress has been made during the last 20 years in the use of fluorouracil (FU) to treat advanced colorectal cancer, with a doubling of tumor response through modulation of FU by leucovorin or methotrexate, or through continuous intravenous infusion of FU instead of a bolus injection.1 These therapeutic approaches were shown to yield a modest but statistically significant impact on overall survival (OS).2 More recently, the chemotherapeutic agents irinotecan and oxaliplatin have become available after randomized trials showed they increased response rates, progression-free survival (PFS), and OS.3-6 Most patients with metastatic colorectal cancer still die as a result of their disease. The ultimate goal of chemotherapy is to cure the disease, or failing that, to improve patient symptoms, quality of life, and OS. It seems justified, therefore, to use OS to assess the efficacy of chemotherapies for advanced colorectal cancer. However, patient death can be observed only after prolonged follow-up, and with the increasing number of active compounds available in this disease, any effect of first-line therapies on OS may be confounded or diminished by the effects of subsequent therapies. It is therefore of interest to investigate whether PFS could replace OS as the primary end point in randomized trials for the treatment of patients with advanced colorectal cancer. In this article, we quantify the relationship between PFS and OS in a set of historical trials, and we investigate whether the results observed in these trials could have been used to predict the effects of irinotecan and oxaliplatin in a set of more recently conducted validation trials that played a pivotal role in the development of these newer drugs.
Trials Individual patient data were available on 10 historical trials2,7-9 and three validation trials3-5 that all had a FU + leucovorin treatment group (Table 1). Historical trials consisted of all trials comparing FU + leucovorin with FU alone (seven trials, 1,744 patients), and all trials comparing FU + leucovorin with raltitrexed (three trials, 1,345 patients). They accrued patients between 1981 and 1990 (median follow-up, 30.4 months). Validation trials (1,263 patients in total) consisted of all trials comparing FU + leucovorin with the same plus irinotecan (two trials, 843 patients) or with the same plus oxaliplatin (one trial, 420 patients). They accrued patients between 1995 and 1998 (median follow-up, 22.0 months). A meta-analysis of trials comparing FU + leucovorin with FU was previously reported.2 The other trials were those carried out for the registration of the new drugs raltitrexed,7-9 irinotecan,3,4 and oxaliplatin.5
Data The following data were requested for individual patients in all trials: patient identifier, center identifier, randomization date, treatment assigned by randomization, tumor measurability (ie, measurable or nonmeasurable tumors), age, sex, performance status, primary tumor site (colon or rectum), site of metastases, overall response status with the first assigned treatment, date of response, date of progression with the first allocated treatment, date of death or last visit, survival status, and cause of death if applicable.
Survival Analyses
Surrogacy Criteria
Correlation Coefficients
Validation Strategy
Correlation Between End Points In historical trials, similar numbers of events were observed for PFS at 6 months (1,760 events) as for OS at 12 months (1,622 events). The degree of association between Kaplan-Meier estimates of 6-month PFS and 12-month OS was weak, with a rank correlation coefficient equal to only 0.32 (95% CI, –0.14 to 0.67; Fig 1). There was no evidence that the correlation between PFS and OS differed between treatments (Fig 1). In contrast, PFS and OS over the entire time range were reasonably well correlated, with a rank correlation coefficient equal to 0.82 (95% CI, 0.82 to 0.83).
Treatment Effects Figure 2 shows the PFS and OS curves by treatment group: FU + leucovorin (solid lines) versus FU or raltitrexed (dotted lines) versus irinotecan or oxaliplatin (dashed lines).
Figure 3 shows good overall agreement between the HRs for PFS and for OS in both the historical trials and the validation trials; trials tended to show large treatment benefits for both end points or small benefits for both end points. The FU + leucovorin group tended to fare better than FU alone or raltitrexed (HRs < 1) but worse than FU + leucovorin with either irinotecan or oxaliplatin.
Correlation Between Treatment Effects The correlation coefficient between log HRPFS and log HROS over the entire time range, R, was equal to 0.99 (95% CI, 0.94 to 1.04). Figure 4 shows the linear regression line used to predict treatment effects on OS from the observed treatment effects on PFS. The regression equation was log HROS = 0.003 + 0.81 x log HRPFS, indicating that the risk reductions were approximately 19% (= 1 – 0.81) lower on OS than on PFS. The correlation coefficient between log HRPFS up until 6 months and log HROS up until 12 months was equal to 0.94 (95% CI, 0.87 to 1.01).
Sensitivity Analyses The Swiss Group for Clinical Cancer Research (SAKK) trial (310 patients)14 had a very long follow-up but surprisingly few events, whereas the Crema trial (150 patients)15 exhibited extreme treatment benefits in terms of both PFS and OS. Exclusion of the SAKK trial, and of other trials than the Crema trial, had little impact on the results (data not shown). Exclusion of the Crema trial resulted in a much weaker association between the treatment effects, with a correlation coefficient between log HRPFS and log HROS equal to 0.74 (95% CI, 0.44 to 1.04). Both of these trials were further scrutinized, but no obvious defect or methodological problem could be found to explain their atypical behavior.
Surrogate Threshold Effect
Predicted Effects on OS
Fast progress has been made in the treatment of advanced colorectal cancer during the last decade, and a number of promising new drugs are now entering clinical development for this condition. In just a few years since the approval of irinotecan and oxaliplatin, monoclonal antibodies targeting the vascular endothelial growth factor (bevacizumab) and epidermal growth factor receptor (cetuximab) have been approved as additional therapies, respectively, for the first- and second-line treatment of metastatic colorectal cancer.16-17 It is clearly in the best interest of future patients that new drugs be made available as soon as their efficacy is established beyond doubt on the most clinically meaningful end point, or on some earlier end point that can be considered a surrogate for it. Our analyses indicate that in advanced colorectal cancer, an analysis of PFS at 6 months would include approximately the same number of events as an analysis of OS at 12 months and would, therefore, have approximately the same statistical power to detect any given risk reduction.
Reviews of the literature suggest a tight correlation between PFS and OS in advanced colorectal cancer,18 but this observation alone does not make PFS a good surrogate for survival.19 Although there is no consensus regarding the theoretical conditions required for a surrogate end point to be valid, recent work suggests that surrogacy can be assessed through the correlation between the end points and the treatment effects on these end points in a series of trials.11-12 In resectable colorectal cancer, this approach was used successfully to show that 3-year DFS was an excellent surrogate for 5-year OS.20 In metastatic colorectal cancer, this approach was also used to investigate the relationship between tumor response and OS. Although patients who achieved a response had a significantly prolonged OS, treatment effects on response were poorly correlated with treatment effects on OS, making tumor response an unacceptable surrogate in this disease.1,21 The analyses presented here show that, in historical trials comparing FU + leucovorin with single-agent FU or with raltitrexed, PFS was an acceptable surrogate for OS. Indeed, the two end points were well correlated (
When our analyses were censored at 6 months for PFS and at 12 months for OS, the effects of treatment on the two end points remained highly correlated (R = 0.94), but the correlation between the Kaplan-Meier estimates of 6-month PFS and 12-month OS was much lower ( In the present article, we extended the validation methodology to investigate the predictive value of PFS as a surrogate end point for OS. We calculated the surrogate threshold effect and showed that if a treatment achieved an HR for PFS of 0.86 or less, it would be expected to ultimately achieve a benefit in terms of OS (Fig 4). After exclusion of the Crema trial, the surrogate threshold effect corresponded to HRs of 0.77, suggesting the need for much larger but still achievable treatment effects on PFS. HRs in the range of 0.7 to 0.8 for PFS are realistic and have, in fact, been achieved by several treatments recently approved for the treatment of advanced colorectal cancer.3-6,16-17 Similar conclusions were reached independently in a meta-analysis of a large number of published trials.23 In practice, the threshold effect depends on the size of the future trial, because the estimation error of the PFS HR must be accounted for in the construction of the prediction limits for the OS HR. The trials used in our analyses were conducted over a long period of time. The correlation between PFS and OS could largely be explained by a trend for both PFS and OS to improve over time, the former as a result of more effective first-line treatments, and the latter as a result of more effective second-line treatments. However, our claim of surrogacy is also based on a high correlation between the effects of treatment on PFS and OS, and there is no plausible way in which the correlation between treatment effects could simply be a result of time trends. To validate results from historical trials in independent, more recent trials, we also investigated whether treatment effects on OS were reliably predicted by the treatment effects on PFS in three validation trials testing the new drugs irinotecan and oxaliplatin. In these trials, the prediction intervals of the predicted effect were narrower than the CI of the observed effect (Table 2), which underscores the potential gain arising from the use of surrogate end points for which more events are available than for the true end point. Such a gain would be even more pronounced for trials with less mature OS data, although those trials would also have less mature PFS data, and therefore more uncertainty in the estimated treatment effect on PFS. The predicted effects agreed extremely well with the observed effects in trials testing irinotecan, but less well in the trial testing oxaliplatin, in which the predicted effect overestimated the observed effect (Table 2). However, all of the observed effects fell within the prediction limits (Fig 4), and these differences could be a chance finding. They could also be a result of the effect of second-line treatments. In a recently reported US Intergroup trial testing oxaliplatin added to FU + leucovorin versus irinotecan added to FU + leucovorin (not included in our analyses), a much higher proportion of patients were crossed over to the other drug on disease progression in the first-line oxaliplatin arm (60%) than in the first-line irinotecan arm (24%). The observed OS benefit of first-line oxaliplatin compared with first-line irinotecan was larger (HR = 0.57) than would have been predicted from the benefit on PFS (predicted HR = 0.79), possibly because of the larger number of crossovers.6 Second-line use of new agents is likely to produce lesser antitumor effect than first-line use,24 but recent observations strongly suggest that use of effective second-line therapies may extend the time between first-line disease progression and death.25,26 Thus, the ultimate OS benefits of improvements in first-line PFS may be reduced as greater numbers of effective second-line therapies are introduced. Our analyses indicate that PFS would have been an acceptable surrogate for OS in developing the drugs considered here. Similar analyses should be repeated with data from randomized trials testing newer drugs in patients receiving effective second- or even third-line therapies. PFS offers a direct measure of new drug activity that is not obscured by subsequent therapies. Unlike response rate, PFS also has the intrinsic advantage of assessing the time of tumor control. As more active drugs enter the clinic, PFS will become an even more desirable end point than OS as the primary efficacy end point for trials in colorectal cancer.27,28 Its use can reduce sample size, shorten accrual time, and speed time until first analysis, besides serving as an appropriate indicator of clinical benefit. Of course, increasing reliance on assessment of PFS raises the challenge of ensuring that ascertainment of tumor progression in clinical trials is reliable and unbiased.29
Although all authors completed the disclosure declaration, the following author(s) indicated a financial or other interest that is relevant to the subject matter under consideration in this article. Certain relationships marked with a "U" are those for which no compensation was received; those relationships marked with a "C" were compensated. For a detailed description of the disclosure categories, or for more information about ASCO's conflict of interest policy, please refer to the Author Disclosure Declaration and the Disclosures of Potential Conflicts of Interest section in Information for Contributors. Employment or Leadership Position: Kevin Carroll, AstraZeneca (C); Pascal Piedbois, AstraZeneca (C) Consultant or Advisory Role: None Stock Ownership: None Honoraria: None Research Funding: None Expert Testimony: None Other Remuneration: None
Conception and design: Marc Buyse, Tomasz Burzykowski, Pascal Piedbois Financial support: Marc Buyse, Tomasz Burzykowski Administrative support: Marc Buyse, Tomasz Burzykowski Collection and assembly of data: Marc Buyse, Tomasz Burzykowski, Kevin Carroll, Stefan Michiels, Jean-Pierre Pignon, Pascal Piedbois Data analysis and interpretation: Marc Buyse, Tomasz Burzykowski, Kevin Carroll, Stefan Michiels, Daniel J. Sargent, Langdon L. Miller, Gary L. Elfring, Jean-Pierre Pignon, Pascal Piedbois Manuscript writing: Marc Buyse, Tomasz Burzykowski, Kevin Carroll, Stefan Michiels, Daniel J. Sargent, Langdon L. Miller, Gary L. Elfring, Jean-Pierre Pignon, Pascal Piedbois Final approval of manuscript: Marc Buyse, Tomasz Burzykowski, Kevin Carroll, Stefan Michiels, Daniel J. Sargent, Langdon L. Miller, Gary L. Elfring, Jean-Pierre Pignon, Pascal Piedbois
The authors are grateful to the Meta-Analysis Group in Cancer and to the principal investigators of the validation trials for permission to reanalyze individual patient data: D. Cunningham, G. Cocconi, R. Pazdur, L. Saltz, J.Y. Douillard, and A. de Gramont. The datasets analyzed were provided by the Biostatistics and Epidemiology Unit of Institut Gustave-Roussy, Villejuif, France; AstraZeneca, Macclesfield, United Kingdom; Sanofi-aventis, Swiftwater, PA (Dr R. Bigelow); and Pfizer, New York, NY (Dr L. Cisar). All statistical analyses were performed at the Center for Statistics, Hasselt University, and the International Drug Development Institute (IDDI, Brussels, Belgium, with statistical support from E. Quinaux). T. Burzykowski gratefully acknowledges financial support from the IAP research Network P6/03 of the Belgian Government (Belgian Science Policy).
Supported by the IAP Research Network P6/03 of the Belgian Government (Belgian Science Policy; T.B.). Authors disclosures of potential conflicts of interest and author contributions are found at the end of this article.
1. Buyse M, Thirion P, Carlson RW, et al: Tumour response to first line chemotherapy improves the survival of patients with advanced colorectal cancer. Lancet 356:373-378, 2000[CrossRef][Medline] 2. Thirion P, Michiels S, Pignon JP, et al: Modulation of fluorouracil by leucovorin in patients with advanced colorectal cancer: An updated meta-analysis. J Clin Oncol 22:3766-3775, 2004 3. Saltz LB, Cox JV, Blanke C, et al: Irinotecan plus fluorouracil and leucovorin for metastatic colorectal cancer. N Engl J Med 343:905-914, 2000 4. Douillard JY, Cunningham D, Roth AD, et al: Irinotecan combined with fluorouracil compared with fluorouracil alone as first-line treatment for metastatic colorectal cancer: A multicentre randomised trial. Lancet 355:1041-1047, 2000[CrossRef][Medline] 5. de Gramont A, Figer A, Seymour M, et al: Leucovorin and fluorouracil with or without oxaliplatin as first-line treatment in advanced colorectal cancer. J Clin Oncol 18:2938-2947, 2000 6. Goldberg RM, Sargent DJ, Morton RF, et al: A randomized controlled trial of fluorouracil plus leucovorin, irinotecan, and oxaliplatin combinations in patients with previously untreated metastatic colorectal cancer. J Clin Oncol 22:23-30, 2004 7. Cunningham D, Zalcberg JR, Rath U, et al: Final results of a randomised trial comparing Tomudex (raltitrexed) with 5-fluorouracil plus leucovorin in advanced colorectal cancer. Ann Oncol 7:961-965, 1996 8. Pazdur R, Vincent M: Raltitrexed (Tomudex) versus 5-fluorouracil and leucovorin (5-FU + LV) in patients with advanced colorectal cancer (ACC): Results of a randomized, multicenter, North American trial. Proc Am Soc Clin Oncol 16:228a, 1997 (abstr 801) 9. Cocconi G, Cunningham D, Van Cutsem E, et al: Open, randomized, multicenter trial of raltitrexed versus fluorouracil plus high-dose leucovorin in patients with advanced colorectal cancer. J Clin Oncol 16:2943-2952, 1998 10. Cox DR: Regression models and life tables (with discussion). JR Stat Soc B 34:187-220, 1972 11. Buyse M, Molenberghs G, Burzykowski T, et al: The validation of surrogate endpoints in meta-analyses of randomised experiments. Biostatistics 1:49-67, 2000[Medline] 12. Burzykowski T, Molenberghs G, Buyse M Evaluation of Surrogate Endpoints. Heidelberg, Germany, Springer Verlag, 2005 13. Burzykowski T, Molenberghs G, Buyse M, et al: Validation of surrogate endpoints in multiple randomised clinical trials with failure-time endpoints. J Royal Stat Soc C (Applied Statist) 50:405-422, 2001[CrossRef] 14. Borner MM, Castiglione M, Bacchi M, et al: The impact of adding low-dose leucovorin to monthly 5-fluorouracil in advanced colorectal carcinoma: Results of a phase III trial. Ann Oncol 9:535-541, 1998 15. Bobbio-Pallavicini E, Porta C, Moroni M, et al: Folinic acid does improve 5-fluorouracil activity in vivo: Results of a phase III study comparing 5-fluorouracil to 5-fluorouracil and folinic acid in advanced colon cancer patients. J Chemother 5:52-55, 1993[Medline] 16. Hurwitz H, Fehrenbacher L, Novotny W, et al: Bevacizumab plus irinotecan, fluorouracil, and leucovorin for metastatic colorectal cancer. N Engl J Med 350:2335-2342, 2004 17. Cunningham D, Humblet Y, Siena S, et al: A randomised comparison of cetuximab monotherapy and cetuximab plus irinotecan in irinotecan-refractory metastatic colorectal cancer. N Engl J Med 351:337-345, 2004 18. Louvet C, de Gramont A, Tournigand C, et al: Correlation between progression free survival and response rate in patients with metastatic colorectal carcinoma. Cancer 91:2033-2038, 2001[CrossRef][Medline] 19. Fleming TR, DeMets DL: Surrogate endpoints in clinical trials: Are we being misled? Ann Intern Med 125:605-613, 1996 20. Sargent D, Wieand S, Haller DG, et al: Disease-free survival (DFS) vs overall survival (OS) as a primary endpoint for adjuvant colon cancer studies: Individual patient data from 20,898 patients on 18 randomized trials. J Clin Oncol 23:8664-8670, 2005 21. Burzykowski T, Molenberghs G, Buyse M, et al: The validation of surrogate endpoints using data from randomised clinical trials: A case-study in advanced colorectal cancer. J Royal Statist Soc A 167:103-124, 2004[CrossRef] 22. Michiels S, Piedbois P, Burdett S, et al: Meta-analysis when only the median survival times are known: A comparison with individual patient data results. Intl J Technol Assess Health Care 21:119-125, 2005 23. Johnson KR, Ringland C, Stokes BJ, et al: Response rate or time to progression as predictors of survival in trials of metastatic colorectal cancer or non-small-cell lung cancer: A meta-analysis. Lancet Oncol 7:741-746, 2006[CrossRef][Medline] 24. Tournigand C, Andre T, Achille E, et al: FOLFIRI followed by FOLFOX6 or the reverse sequence in advanced colorectal cancer: A randomized GERCOR study. J Clin Oncol 22:229-237, 2004 25. Grothey A, Sargent D, Goldberg RM, et al: Survival of patients with advanced colorectal cancer improves with the availability of fluorouracil-leucovorin, irinotecan, and oxaliplatin in the course of treatment. J Clin Oncol 22:1209-1214, 2004 26. Grothey A, Sargent D: Overall survival of patients with advanced colorectal cancer correlates with availability of fluorouracil, irinotecan, and oxaliplatin regardless of whether doublet or single-agent therapy is used first line. J Clin Oncol 23:9441-9442, 2005 27. Di Leo A, Bleiberg H, Buyse M: Is overall survival a realistic primary endpoint in advanced colorectal cancer? A critical assessment based on four clinical trials comparing fluorouracil plus leucovorin with the same treatment combined either with oxaliplatin or with irinotecan. Ann Oncol 14:545-549, 2004 28. Di Leo A, Bleiberg H, Buyse M: Overall survival is not a realistic endpoint for clinical trials in advanced solid tumors: A critical assessment based on recently reported phase III trials in colorectal and breast cancer. J Clin Oncol 21:2045-2047, 2003 29. US Food & Drug Administration: Guidance for Industry: Clinical Trial Endpoints for the Approval of Cancer Drugs and Biologics. www.fda.gov/cder/guidance/6592dft.htm Submitted March 24, 2007; accepted July 30, 2007.
Related Editorial
This article has been cited by other articles:
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||
|
Copyright © 2007 by the American Society of Clinical Oncology, Online ISSN: 1527-7755. Print ISSN: 0732-183X
|