|
|||||
|
|
||||||
Journal of Clinical Oncology, Vol 25, No 15 (May 20), 2007: pp. 2070-2077 © 2007 American Society of Clinical Oncology. DOI: 10.1200/JCO.2006.09.1983 Criteria for Optimizing Prognostic Risk Groups in Pediatric Cancer: Analysis of Data From the Children's Oncology Group
From the Children's Center for Cancer and Blood Diseases, Children's Hospital Los Angeles; Department of Preventive Medicine, Keck School of Medicine, University of Southern California, Los Angeles, CA; Department of Epidemiology and Health Policy Research, University of Florida, Gainesville, FL; and the Children's Oncology Group, Bethesda, MD Address reprint requests to Richard Sposto, PhD, Children's Center for Cancer and Blood Diseases, Children's Hospital Los Angeles, 4650 Sunset Blvd, Mail Stop #54, Los Angeles, CA 90027-6016; e-mail: rsposto{at}chla.usc.edu
Purpose: Physicians who treat cancer often attempt to identify patient subgroups that are homogeneous in their chance of recurrence or death as a way to target the more toxic and presumably more effective treatments to patients with the worst prognosis. However, to date, prognosis-based treatment assignment in pediatric cancer has not been based on a quantitative assessment of the risks and benefits of different treatment strategies or on morbidity and efficacy outcome measures that are relevant to children. Methods: We performed a quantitative analysis of the risks and benefits of prognosis-based treatment assignment in two examples from the Children's Oncology Group using a mathematical model of cancer cure and permanent treatment morbidity and defined an optimality criterion for assigning treatments to specific risk groups. Results: In stage 4 MYCN-unamplified neuroblastoma, age-based risk grouping distinguishes clearly between patients with high and low risk of recurrence. However, our analysis suggests that the optimal age cut point depends profoundly on the morbidity of the treatments being considered and agrees with current published recommendations only for treatments that add significant morbidity. In Hodgkin's lymphoma, under our model, no clearly optimal risk groupings exist, and a compelling quantitative rationale for defining risks group at all may not exist. Conclusion: Our analysis illustrates the inadequacy of naïve application of statistical criteria for defining prognostic risk groups in pediatric cancer and highlights the importance of quantifying treatment morbidity when defining risk groups or when deciding whether risk grouping is warranted.
Cure rates of children's cancer have improved dramatically in the last several decades.1-6 High cure rates heighten awareness of the risk of severe long-lasting treatment morbidity and reduced life expectancy7-11 in cured patients. When the majority of patients are cured, aggressively augmenting treatment for all patients unnecessarily exposes all patients to added morbidity to increase the cure rate in a minority of patients. Physicians try to minimize population morbidity by defining prognostic risk groups and reserving the most toxic and presumably more active treatments for patients with the worst prognosis and the least toxic and possibly less effective treatments for patients with the best prognosis.12-14 Advances in the ability to characterize cancers molecularly15-18 and to assess minimal residual disease19,20 may improve the accuracy of prognostic prediction by replacing or supplementing traditional clinical prognostic factors with this biologically based information. To date, risk groups have not been optimized to maximize treatment success while minimizing morbidity. Usually, risk groups are defined by minimizing the P value in a log-rank or Cox regression analysis.21-24 P valuebased criteria have undesirable properties.25-27 For example, one should be more willing to give a promising treatment that minimally increases permanent morbidity to a prognostically more heterogeneous high-risk group than one would a similarly promising treatment that adds significant morbidity, which should be reserved for the highest risk patients in whom the therapeutic benefit would justify added morbidity. The minimum P valuebased risk group definitions are insensitive to these considerations. Features of pediatric cancer also make common survival methods undesirable. Risk groups are not usefully different if cure rates are similar among them because the objective is to cure and not simply to postpone death, but log-rank or Cox analyses are more sensitive to differences in time to treatment failure among patients who experience treatment failure than to differences in cure rate.28 Finally, the permanent morbidity of treatment in cured patients should receive greater weight than manageable, albeit possibly severe, toxicities that impart no permanent morbidity. It is permanent morbidity that will have a profound effect on the life of a cured child. We describe a method for defining prognostic risk groups that balances treatment effectiveness and morbidity. We demonstrate the method in a hypothetical example and apply it to outcome data from Children's Oncology Group studies in Hodgkin's disease and neuroblastoma, which represent two extremes in the usefulness of prognostic risk groups in pediatric cancer. The analyses are not considered definitive, but rather, they illustrate important features of the problem of defining risk groups in childhood cancer. We will demonstrate that the existence of highly significant prognostic factors does not guarantee that useful prognostic risk groups can be defined and that the definition of risk groups and their utility depends on the morbidity of treatments being considered.
Consider a prognostic score the values of which identify patients with different probabilities of cure (ie, prognosis). The score can be a single prognostic variable or a combination of variables as derived from multivariate analysis29-31 or microarray analysis.16,18 The score is not necessarily related to specific biologic targets of treatment. Prognostic scores have been used to define risk groups in childhood14,21,31,32 and adult cancer29,30,33-42 by picking appropriate cut points. (The terms risk and cure will refer to failure to eliminate the cancer and the elimination of the cancer, respectively, without regard to long-lasting morbidity from the cancer or its treatment.) The prognostic score is treatment context specific; it applies to patients who are receiving the current standard of care, which may already include treatment/risk group specificity.
Risk GroupDirected Treatment
Measure of Treatment Morbidity
Gain and Loss From Reduced or Augmented Treatments
Average Gain From Targeted Strategy The average gain (or loss = gain) from augmenting treatment in the HR group and reducing treatment in the LR group is as follows:
We concentrate on the two-risk group situation where only HR patients receive augmented treatment and LR and intermediate-risk patients receive the current standard. The earlier equation simplifies to the following equation:
Example 1: A Nearly Ideal Prognostic Score Figure 1 shows Kaplan-Meier curves from 1,000 hypothetical patients with survival times simulated from a population with 60% cure rate and with a prognostic score that is an excellent discriminator of patients who survive or not. (Simulation details are provided in the Appendix, online only). Patients can be separated clearly into LR and HR groups by any of four different cut points that correspond to dramatically different percentages of patients in the two risk groups
The strong influence of the prognostic score is evident in a parametric cure model regression analysis of cure rate28 (Fig 2A, lower curve). The distributions of scores in cured and not cured patients are distinct, albeit with some overlap (Fig 2B). Receiver operating characteristic (ROC) analysis43 (Fig 2C) confirms that the prognostic score is highly sensitive and specific as a predictor of patients who will not be cured; the area under the curve (AUC) is 0.98.
Assume that augmented treatment cures 30% of patients with a particular prognostic score who are not cured by standard treatment (Fig 2A, upper curve). Figure 2D shows the average (expected) gain as a function of score cut point and morbidity quotient QAug when treatment is augmented in HR patients. QAug ranges from QAug = 0.99 for augmented treatment that has only slightly more morbidity compared with standard treatment to QAug = 0.50 for treatment that adds substantially to permanent morbidity. The percentage of patients in the LR group for each cut point is also shown. As would be expected, the optimum cut point classifies fewer patients as HR as the morbidity of augmented treatment increases (Table 2). For augmented treatments that add the least morbidity (QAug = 0.99), 58% of patients are classified as HR at the optimum cut point, with a gain of 0.11, whereas only 33% of patients are classified as HR for an extremely morbid treatment (QAug = 0.50), with a much lower gain (0.04). For less morbid treatments, there is a wider range of acceptable cut points that give at least 95% of the maximum possible gain (Table 2). For reference, the minimum log-rank P value cut point is P = .56, which is appropriate for extremely morbid treatments.
Although cured and not cured patients can be distinguished reliably using the prognostic score, the morbidity of augmented treatment drastically affects the percentage of patients who optimally should receive augmented treatment and the potential gain from this treatment strategy.
Example 2: Hodgkin's Disease Nearly 100% of patients with the lowest prognostic scores are cured compared with approximately 70% of patients with the highest scores (Fig 3A, lower curve). The overall cure rate is 92%. At the median score of 0.40, 94% of patients are cured. There is greater overlap of prognostic score here compared with Example 1 (Fig 3B). The ROC analysis (Fig 3C) suggests that this prognostic score may be a good discriminator of cured or not cured patients (AUC = 0.80)
Assuming again that augmented treatment cures 30% of patients not cured by standard treatment (Fig 3A, upper curve), there is only a small gain in augmenting treatment in HR patients and only if the additional morbidity is small (Fig 3D, Table 2). When QAug = 0.99, the optimal cut point classifies more than 60% of patients as HR, but all patients could receive augmented treatment with little reduction in gain. When augmented treatment adds non-negligible morbidity, the gain is negligibly positive and only if the HR group is small. The minimum log-rank P value cut point is P = .65, which is optimal for QAug 0.95. Using this prognostic score, there is little apparent advantage to segregating Hodgkin's disease patients in this manner. This does not rule out the possibility that a different prognostic score (eg, a molecular classifier) could reliably identify an HR group comprising mainly the 5% to 10% of patients not currently cured who would be candidates for augmented treatment.
Example 3: Stage 4 MYCN Nonamplified Neuroblastoma Age is a strong predictor of cure rate in these patients (Fig 4A). There also is a distinctively different distribution of age in cured and not cured patients (Fig 4B). Again, ROC analysis suggests that age alone may be a good discriminator of cured and not cured patients (AUC = 0.80; Fig 4C).
In contrast to the Hodgkin's disease example and similar to Example 1, except for the most morbid of treatments, there is a positive gain to augmenting treatment in HR patients (Fig 4D, Table 2). The minimum log-rank P value occurs at 1.4 years, but similar values occur from 1.3 to 1.6 years, which is consistent with the revised age cut point range of 1.25 to 1.58 years.21 The optimum cut point is 1.8 years for treatment augmentation with significant additional morbidity (eg, QAug = 0.50), but it is much less than 1 year (in fact, close to 0 years) if the augmented treatment adds minimal morbidity to current standard treatment; nearly all stage 4 MYCN-unamplified patients could receive such augmented treatment.
Simon,17 in an excellent review of issues surrounding developing and using a prognostic molecular signature, emphasized the need to ensure that "treatment options and costs of mis-classification are such that a classifier is likely to be used." Our method is an attempt to quantify the costs and benefits, in terms of morbidity and treatment efficacy, of classifying (or misclassifying) patients into risk groups and assigning specific treatment to these risk groups. There are numerous examples of prognostic risk grouping in adult29,30,33-42 and pediatric14,21,31,32 cancer, but generally absent is the notion of optimality based on the benefit to the patients for risk-adapted therapy. Grosfeld12 stated that "risk-based management allows [one] to weigh the risks and benefits of treatment for each patient to maximize survival, minimize long-term morbidity, and improve quality of life." The method we propose is possibly the first attempt in pediatric cancer to create a quantitative framework within which to make these judgments. Our method uses simplifying assumptions that should be highlighted. Because current standard treatment in many cancers is already risk adapted, the morbidity of treatment will depend on the prognostic factors that determine risk. Our derivation of AverageGain assumes that the morbidity indices (Vs) are constant. If treatment and, therefore, treatment morbidity already depend on prognostic factors, the cut points selected from the proposed method may not be optimal. Preliminary investigation of this issue suggests that our method may be relatively insensitive to such dependence (see online-only Appendix). Our analysis assumes that augmented treatment has an additive effect; it cures a fixed proportion of patients who are not cured with standard treatment. This is appropriate for augmented treatments that have the largest absolute effect in the worst prognosis patients but differs from a common (but not well justified) proportional hazards assumption where a treatment would be comparatively more effective in lower risk patients and less effective in higher risk patients. The proportional hazards assumption would result in lower gains and different cut points. We assume that treatment morbidity is identical for each patient receiving a specific treatment. A more realistic statistical model would account for individual variability in morbidity, which can be a result of differences in susceptibility to morbidity, additional morbidity from required retrieval therapy before cure is achieved, or other factors. Our method also focuses on maximizing population gain to decide on global treatment strategies rather than on determining optimal treatment for an individual patient. It should also be noted that the method requires the availability of large, mature datasets that allow the modeling of outcome and prognosis. The least well-defined part of this method is determining appropriate values for morbidity indices and ratios. These quantities must exist in concept and must be assignable in practice, given sufficient data, because, otherwise, there would be little basis for considering risk-based treatment assignment. Data on long-term treatment morbidity in children is now becoming available for the treatments that have been used in the past.46-49 The challenge will be to relate these data to treatments that are now being considered. There are also the human factors of perception and utility and whether a physician, parent, or patient would make the same judgments about the trade-off between cure and morbidity or about the relative importance of the different types of treatment morbidity.50,51 We investigated a range of morbidity ratios that likely bracket all realistic levels of morbidity. Despite these limitations, we have shown that the problem of defining risk groups and assigning treatments to them is not one that can be solved using purely statistical criteria, as is the common practice, but must consider the prognosis of patients with current standard treatment, the morbidity of current treatment, the strength of the prognostic predictor, and the changes in effectiveness and morbidity that result from modifying treatment within some risk groups.
The authors indicated no potential conflicts of interest.
Conception and design: Richard Sposto Collection and assembly of data: Richard Sposto, Wendy B. London Data analysis and interpretation: Richard Sposto, Wendy B. London, Todd A. Alonzo Manuscript writing: Richard Sposto, Wendy B. London, Todd A. Alonzo Final approval of manuscript: Richard Sposto, Wendy B. London, Todd A. Alonzo
Simulation of Survival Times for Example 1 Example 1 in the article is an analysis of 1,000 simulated survival times from a theoretical population with 60% cure rate. The basis for this simulation is the mixture of the two subdensity functions for the prognostic score s in cured and not cured subpopulations shown in Figure A1. The function on the left is 0.60 x fC(s), where , and that on the right is 0.40 x fNC(s), where is the standard normal density function, and fC(s) and fNC(s) are the densities of s conditional on cured status. Hence, the density function of s in the population is g(s) = 0.60 x fC(s) + 0.40 x fNC(s).
For each patient, a random score value was generated from the density g(s). Then, a random uncensored survival time was generated from a nonmixture parametric cure model (PCM) (Sposto R. Stat Med 21:293-312, 2002) using a Weibull kernel with scale = 0.75 and shape = 1.3. Censoring was overlaid from a uniform distribution, which mimics Poisson patient entry over a 5-year period with 2 years of additional follow-up after the end of the accrual period.
PCM Regression of Cure Probability on Prognostic Score
Example 1 (n = 1,000 simulated patients).
These data were analyzed using a nonmixture PCM with Weibull kernel. The cure probability was modeled as the logistic function
Example 2 (n = 780 Hodgkin's disease patients from Children's Cancer Group study 5942). The primary end point for survival analysis was time to death. Patients who were alive at last contact were censored at that time. Patients in each of three treatment groups received a different duration or type of therapy depending on the treatment group. See Nachman et al (Nachman JB, Sposto R, Herzog P, et al. J Clin Oncol 20:3765-3771, 2002) for details. Data available as of April 2006 were used. Indicators of the presence at diagnosis of B symptoms, large anterior mediastinal mass, large mediastinal mass plus an additional large nodal aggregate, membership in treatment group 1, membership in treatment group 3, and log10(erythrocyte sedimentation rate + 0.5) were used as prognostic variables. These were first summarized in a principle components analysis, and the first principal component was scaled to range between 0 and 1 and was used as the prognostic score. The cure probability, scale, and shape of the PCM were parameterized identically to Example 1, except in the context of a logistic kernel function rather than a Weibull kernel. Parameter estimates are listed in Table A2. The adequacy of the fit of this model for predicting the probability of cure is illustrated in Figure 3A of the article.
Example 3 (n = 317 patients with International Neuroblastoma Staging System stage 4 MYCN-unamplified neuroblastoma). The primary end point for survival analysis was the minimum time to disease relapse, disease progression, or death from any cause. This is an appropriate end point for cure analyses because a minority of patients who experience relapse or progression are successfully re-treated. Patients who were failure free at last contact were censored at that time. See London et al (London WB, Castleberry RP, Matthay KK, et al. J Clin Oncol 23:6459-6465, 2005) for further details.
Age at diagnosis alone was used as a prognostic score in a PCM with a logistic kernel. The scale and shape parameters were parameterized identically to Example 2. However, a special model for the cure probability was required to correctly estimate the relationship between cure probability and age.
Effect of Sample Variability on Estimates of the Optimum Cut Point and the Maximum Gain A simulation was performed to study the sampling variability of the estimates of the optimum cut points and maximum gain. Specifically, 500 bootstrap samples were drawn from each of the example data sets discussed in the article. A PCM of the relevant type was fit to these data, and the optimum cut point and maximum gain were determined. This was repeated for the values of QAug = 0.5, 0.75, 0.85, 0.95, and 0.99. The bootstrap sample size was the same as the sample size for the original data set. For the Hodgkin's disease and neuroblastoma simulations, 1% to 2% of repetitions that clearly represented failure of the cure model fit algorithm to converge were excluded.
The box plots in Figures A2 through
Effect of Nonconstant QAug on Optimum Cut Points and Maximum Gain In our analyses, we assumed that the morbidity quotient QAug was a constant unrelated to prognostic score. However, in some circumstances, it would be more realistic to assume that QAug differs for patients with different prognoses; for example, patients with more extensive disseminated disease who are treated with radiation therapy have radiation exposure to more sites than patients with localized disease. We performed a preliminary investigation of the sensitivity of our results to nonconstant QAug. Specifically, we considered the situation where QAug can vary with the score by different amounts but where the average QAug value was equal to 0.85, which was in the middle of the range that we considered in each example. The value of QAug for the lowest score (intercept) was set to 0.99, 0.95, 0.90, 0.85, and 0.80, and a log-linear change from this baseline was chosen so that the average was QAug = 0.85. The intercept of 0.85 corresponded to a zero slope and, therefore, a constant QAug. Figure A8 summarizes these results. With the exception of the situations in Example 2 where QAug increases with prognostic score and the two situations in Example 3 where the values of QAug change by more than 40% over the age range, the cut point corresponding to the maximum does not differ importantly from the constant QAug situations that are considered in this example.
Maximum Log-Rank 2 PlotsFigure A9 shows the 1 degree of freedom log-rank 2 values for difference prognostic score cut points. The maximum 2 (minimum P value) cut points that are reported in the article were read from these figures.
Supported by Children's Cancer Group (CCG) Grant No. CA 13539 and Children's Oncology Group (COG) Grant No. CA 98543. A complete listing of grant support for research conducted by the CCG and Pediatric Oncology Group before initiation of the COG grant in 2003 is available online at http://www.childrensoncologygroup.org/admin/grantinfo.htm. Authors' disclosures of potential conflicts of interest and author contributions are found at the end of this article.
1. Ravindranath Y: Recent advances in pediatric acute lymphoblastic and myeloid leukemia. Curr Opin Oncol 15: 23-35, 2003[CrossRef][Medline] 2. Khatua S, Jalali R: Recent advances in the treatment of childhood brain tumors. Pediatr Hematol Oncol 22: 361-371, 2005[CrossRef][Medline] 3. Pui CH, Campana D, Evans WE: Childhood acute lymphoblastic leukaemia: Current status and future perspectives. Lancet Oncol 2: 597-607, 2001[CrossRef][Medline] 4. Pearson HA: History of pediatric hematology oncology. Pediatr Res 52: 979-992, 2002[CrossRef][Medline] 5. Woods WG: Curing childhood acute myeloid leukemia (AML) at the half-way point: Promises to keep and miles to go before we sleep. Pediatr Blood Cancer 46: 565-569, 2006[CrossRef][Medline] 6. Gatta G, Capocaccia R, Stiller C, et al: Childhood cancer survival trends in Europe: A EUROCARE Working Group study. J Clin Oncol 23: 3742-3751, 2005 7. Robison LL, Green DM, Hudson M, et al: Long-term outcomes of adult survivors of childhood cancer: Results from the childhood cancer survivor study. Cancer 104: 2557-2564, 2005[CrossRef][Medline] 8. Zebrack BJ, Zeltzer LK, Whitton J, et al: Psychological outcomes in long-term survivors of childhood leukemia, Hodgkin's disease, and non-Hodgkin's lymphoma: A report from the childhood cancer survivor study. Pediatrics 110: 42-52, 2002 9. Mertens AC, Yasui Y, Liu Y, et al: Pulmonary complications in survivors of childhood and adolescent cancer: A report from the childhood cancer survivor study. Cancer 95: 2431-2441, 2002[CrossRef][Medline] 10. Mertens AC, Yasui Y, Neglia JP, et al: Late mortality experience in five-year survivors of childhood and adolescent cancer: The Childhood Cancer Survivor Study. J Clin Oncol 19: 3163-3172, 2001 11. Kurkure P, Achrekar S, Dalvi N, et al: Childhood cancer survivors: Living beyond cure. Indian J Pediatr 70: 825-828, 2003[Medline] 12. Grosfeld JL: Risk-based management: Current concepts of treating malignant solid tumors of childhood. J Am Coll Surg 189: 407-425, 1999[CrossRef][Medline] 13. Matthay KK: Intensification of therapy using hematopoietic stem-cell support for high-risk neuroblastoma. Pediatr Transplant 3: 72-77, 1999[CrossRef][Medline] 14. Smith M, Arthur D, Camitta B, et al: Uniform approach to risk classification and treatment assignment for children with acute lymphoblastic leukemia. J Clin Oncol 14: 18-24, 1996[Abstract] 15. Michiels S, Koscielny S, Hill C: Prediction of cancer outcome with microarrays: A multiple random validation strategy. Lancet 365: 488-492, 2005[CrossRef][Medline] 16. Nutt CL, Mani DR, Betensky RA, et al: Gene expression-based classification of malignant gliomas correlates better with survival than histological classification. Cancer Res 63: 1602-1607, 2003 17. Simon R: Roadmap for developing and validating therapeutically relevant genomic classifiers. J Clin Oncol 23: 7332-7341, 2005 18. Asgharzadeh S, Pique-Regi R, Wang H, et al: Gene expression signatures identify prognostic subgroups of metastatic neuroblastomas lacking MYCN amplification. J Natl Cancer Inst 98: 1193-1203, 2006 19. Brisco MJ, Sykes PJ, Hughes E, et al: Comparison of methods for assessment of minimal residual disease in childhood B-lineage acute lymphoblastic leukemia. Leukemia 15: 385-390, 2001[CrossRef][Medline] 20. Cave H, van der Werff ten Bosch J, Suciu S, et al: Clinical significance of minimal residual disease in childhood acute lymphoblastic leukemia: European Organization for Research and Treatment of CancerChildhood Leukemia Cooperative Group. N Engl J Med 339: 591-598, 1998 21. London WB, Castleberry RP, Matthay KK, et al: Evidence for an age cutoff greater than 365 days for neuroblastoma risk group stratification in the Children's Oncology Group. J Clin Oncol 23: 6459-6465, 2005 22. Motzer RJ, Mazumdar M, Bacik J, et al: Survival and prognostic stratification of 670 patients with advanced renal cell carcinoma. J Clin Oncol 17: 2530-2540, 1999 23. Sturm I, Petrowsky H, Volz R, et al: Analysis of p53/BAX/p16ink4a/CDKN2 in esophageal squamous cell carcinoma: High BAX and p16ink4a/CDKN2 identifies patients with good prognosis. J Clin Oncol 19: 2272-2281, 2001 24. Hasford J, Pfirrmann M, Hehlmann R, et al: A new prognostic score for survival of patients with chronic myeloid leukemia treated with interferon alfa: Writing Committee for the Collaborative CML Prognostic Factors Project Group. J Natl Cancer Inst 90: 850-858, 1998 25. Altman DG: Suboptimal analysis using optimal cutpoints. Br J Cancer 78: 556-557, 1998[Medline] 26. Altman DG, Lausen B, Sauerbrei W, et al: Dangers of using "optimal" cutpoints in the evaluation of prognostic factors. J Natl Cancer Inst 86: 829-835, 1994 27. Hill C: Valeur pronostique d'une variable continue et point de cesure optimal. Bull Cancer 80: 649-652, 1993[Medline] 28. Sposto R: Cure model analysis in cancer: An application to data from the Children's Cancer Group. Stat Med 21: 293-312, 2002[CrossRef][Medline] 29. Cheng SH, Horng CF, Clarke JL, et al: Prognostic index score and clinical prediction model of local regional recurrence after mastectomy in breast cancer patients. Int J Radiat Oncol Biol Phys 64: 1401-1409, 2006[CrossRef][Medline] 30. Breems DA, Van Putten WL, Huijgens PC, et al: Prognostic index for adult patients with acute myeloid leukemia in first relapse. J Clin Oncol 23: 1969-1978, 2005 31. Smith RS, Chen Q, Hudson MM, et al: Prognostic factors for children with Hodgkin's disease treated with combined-modality therapy. J Clin Oncol 21: 2026-2033, 2003 32. Creutzig U, Zimmermann M, Ritter J, et al: Definition of a standard-risk group in children with AML. Br J Haematol 104: 630-639, 1999[CrossRef][Medline] 33. De Laurentiis M, De Placido S, Bianco AR, et al: A prognostic model that makes quantitative estimates of probability of relapse for breast cancer patients. Clin Cancer Res 5: 4133-4139, 1999 34. Fennell DA, Parmar A, Shamash J, et al: Statistical validation of the EORTC prognostic model for malignant pleural mesothelioma based on three consecutive phase II trials. J Clin Oncol 23: 184-189, 2005 35. Foekens JA, Atkins D, Zhang Y, et al: Multicenter validation of a gene expression-based prognostic signature in lymph node-negative primary breast cancer. J Clin Oncol 24: 1665-1671, 2006 36. Halabi S, Small EJ, Kantoff PW, et al: Prognostic model for predicting survival in men with hormone-refractory metastatic prostate cancer. J Clin Oncol 21: 1232-1237, 2003 37. Nieto Y, Nawaz S, Jones RB, et al: Prognostic model for relapse after high-dose chemotherapy with autologous stem-cell transplantation for stage IV oligometastatic breast cancer. J Clin Oncol 20: 707-718, 2002 38. Wang Y, Klijn JG, Zhang Y, et al: Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet 365: 671-679, 2005[Medline] 39. Ghoneim MA, El-Mekresh MM, Mokhtar AA, et al: A predictive model of survival after radical cystectomy for carcinoma of the bladder. BJU Int 85: 811-816, 2000[Medline] 40. Baak JP, van Diest PJ, Voorhorst FJ, et al: Prospective multicenter validation of the independent prognostic value of the mitotic activity index in lymph node-negative breast cancer patients younger than 55 years. J Clin Oncol 23: 5993-6001, 2005 41. Sloan JA, Loprinzi CL, Laurine JA, et al: A simple stratification factor prognostic for survival in advanced cancer: The good/bad/uncertain index. J Clin Oncol 19: 3539-3546, 2001 42. Yamamoto N, Watanabe T, Katsumata N, et al: Construction and validation of a practical prognostic index for patients with metastatic breast cancer. J Clin Oncol 16: 2401-2408, 1998[Abstract] 43. Zweig M, Campbell G: Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clin Chem 39: 561-577, 1993 44. Nachman JB, Sposto R, Herzog P, et al: Randomized comparison of low-dose involved-field radiotherapy and no radiotherapy for children with Hodgkin's disease who achieve a complete response to chemotherapy. J Clin Oncol 20: 3765-3771, 2002 45. Jolliffe I: Principal Component Analysis. New York NY, Springer, 2002 46. Ness KK, Mertens AC, Hudson MM, et al: Limitations on physical performance and daily activities among long-term survivors of childhood cancer. Ann Intern Med 143: 639-647, 2005 47. Landier W, Bhatia S, Eshelman DA, et al: Development of risk-based guidelines for pediatric cancer survivors: The Children's Oncology Group Long-Term Follow-Up Guidelines from the Children's Oncology Group Late Effects Committee and Nursing Discipline. J Clin Oncol 22: 4979-4990, 2004 48. Hudson MM, Mertens AC, Yasui Y, et al: Health status of adult long-term survivors of childhood cancer: A report from the Childhood Cancer Survivor Study. JAMA 290: 1583-1592, 2003 49. Oeffinger KC, Buchanan GR, Eshelman DA, et al: Cardiovascular risk factors in young adult survivors of childhood acute lymphoblastic leukemia. J Pediatr Hematol Oncol 23: 424-430, 2001[CrossRef][Medline] 50. Hembroff LA, Holmes-Rovner M, Wills CE: Treatment decision-making and the form of risk communication: Results of a factorial survey. BMC Med Inform Decis Mak 4: 20, 2004[CrossRef][Medline] 51. Stiggelbout AM, de Haes JC, Kiebert GM, et al: Tradeoffs between quality and quantity of life: Development of the Questionnaire for Cancer Patient Attitudes. Med Decis Making 16: 184-192, 1996 Submitted September 14, 2006; accepted February 21, 2007.
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||