|
|||||
|
|
||||||
Originally published as JCO Early Release 10.1200/JCO.2004.03.091 on September 20 2004 © 2004 American Society of Clinical Oncology. Preoperative Sensitivity and Specificity for Early-Stage Ovarian Cancer When Combining Cancer Antigen CA-125II, CA 15-3, CA 72-4, and Macrophage Colony-Stimulating Factor Using Mixtures of Multivariate Normal DistributionsFrom the Massachusetts General Hospital and Harvard Medical School, Boston, MA; The University of Texas M.D. Anderson Cancer Center, Houston, TX; Duke University Medical Center, Durham, NC; Johns Hopkins Medical Institutions, Baltimore, MD; Groningen University Hospital, Groningen, the Netherlands; and St Bartholomews Hospital, London, United Kingdom Address reprint requests to Steven J. Skates, PhD, Massachusetts General Hospital, 50 Stanford St, Suite 560, Boston, MA 02114, e-mail: sskates{at}partners.org
PURPOSE: In CA-125based ovarian cancer screening trials, overall specificity and screening sensitivity of ultrasound after an elevated CA-125 exceeded 99.6% and 70%, respectively, thereby yielding a positive predictive value (PPV) exceeding 10%. However, sensitivity for early-stage disease was only 40%. This study aims to increase preoperative sensitivity for early-stage ovarian cancer while maintaining the annual referral rate to ultrasound at 2% by combining information across CA-125II, CA 15-3, CA 72-4, and macrophage colony-stimulating factor (M-CSF). For direct comparisons between marker panels, all sensitivity results correspond to a 98% fixed first-line specificity (referral rate 2%). PATIENTS AND METHODS: Logistic regression, classification tree, and mixture discriminant analysis (MDA) models were fit to a training data set of preoperative serum measurements (63 patients, 126 healthy controls) from one center. Estimates from the training set applied to an independent validation set (60 stage I to II patients, 98 healthy controls) from two other centers provided unbiased estimates of sensitivity. RESULTS: Preoperative sensitivities for early-stage disease of the optimal panels were 45% for CA-125II; 67% for CA-125II and CA 72-4; 70% for CA-125II, CA 72-4, and M-CSF; and 68% for all four markers (latter two results using MDA). CONCLUSION: Efficiently combining information on CA-125II, CA 72-4, and M-CSF significantly increased preoperative early-stage sensitivity from 45% with CA-125II alone to 70%, while maintaining 98% first-line specificity. Screening trials with these markers using MDA followed by referral to ultrasound may maintain previously high levels of specificity and PPV, while significantly increasing early-stage screening sensitivity. MDA is a useful, biologically justified method for combining biomarkers.
Screening for ovarian cancer is an appealing approach to reducing mortalitythere is a substantial contrast in survival rates between early- and late-stage ovarian cancer cases, with most ovarian cancers (> 75%) clinically detected in late stages.1 Ovarian cancer mortality has been relatively constant for more than 30 years,2 so investigating alternatives such as early detection is warranted. The low annual incidence of ovarian cancer (40 to 50 per 100,000) for women older than 50 years, creates a significant hurdle for early detection.3 Because of the morbidity of surgical exploration for possible ovarian cancer, an ovarian cancer screening program should refer to surgery at most 10 women for each woman with screen-detected ovarian cancer (a positive predictive value [PPV] > 10%),4 which requires a highly sensitive test (> 75%) and an extremely high overall screening specificity (> 99.6%).5 Screening trials based on serum cancer antigen (CA) -125 followed by transvaginal ultrasound for an elevated CA-125 have demonstrated a PPV in excess of 20%.6-8 Approximately 2% of patients per year are referred to ultrasound, so that first-line CA-125 specificity is 98%. In the larger trial, the screening sensitivity of this approach is 71%, with a early-stage screening sensitivity of 40%.7 Longitudinal CA-125 evaluation may improve screening sensitivity5,9,10 and prospective trials are underway to test such an approach. Another approach to increasing sensitivity is to measure additional biomarkers. Many studies have reported putative biomarkers,11 with some reporting increased sensitivity at the cost of decreased specificity,12,13 or vice versa.14 Specificity decreases because a result is naively positive if any individual marker exceeds its cut point. Similarly, sensitivity decreases because a result is naively positive if multiple markers need to be positive. Such methods of combining multiple markers are inefficient. Other studies have used artificial neural networks to combine information across multiple markers,15 or genetic algorithms for unknown markers,16 to improve specificity while sensitivity was kept constant. The addition of information, whether from new markers or longitudinal values, when efficiently used, should always yield a test better able to distinguish between patients and controls; that is, increase sensitivity while maintaining specificity, or vice versa, or simultaneously increase both operating characteristics. This article evaluates the performance of several more efficient approaches to combining information in known multiple markers: logistic regression, classification trees, and mixture discriminant analysis (MDA) based on a biologic motivation.17 The multiple markers are CA-125, CA 15-3, CA 72-4, and macrophage colony-stimulating factor (M-CSF), and the information is measured as the sensitivity at a fixed specificity. CA 15-3 is a marker developed for breast cancer, CA 72-4 was developed for pancreatic cancer, and M-CSF is a cytokine that stimulates proliferation and differentiation of monocytes, but that can also act as an autocrine or paracrine growth factor for some epithelial cancers. These markers are measured in preoperative serum and serum from healthy controls in a training set from early- and late-stage patients from St Bartholomews Hospital (London, United Kingdom) and a validation set from only early-stage patients from Duke University Medical Center (Durham, NC) and Groningen University Hospital (Groningen, the Netherlands). Developing methods for combining information across markers in the training set with patients from all stages, and applying methods in an independent validation set where patients are only in early stage and samples are from institutions distinct from the training set, yields unbiased estimates of preoperative sensitivity and specificity, with greater robustness to institutional source and stage distribution than when training and validation data sets are created by randomly selecting data from one source data set. The resulting homogeneity will likely yield an overly optimistic estimate when applied to samples from new institutions, whereas the results given by our approach are likely more generalizable.
Subjects The training set consisted of 63 patient cases and 126 healthy controls from St Bartholomews Hospital, and the validation set consisted of 30 patient cases and 50 controls from Duke University Medical Center, combined with 30 patient cases and 48 controls from Groningen University Hospital, for a total of 347 samples. The local institutional review boards approved the protocol for the study. The distributions of stage and histology in the training and validation data sets are given in Table 1. In the training set, 27 were early-stage invasive epithelial ovarian cancers and 36 were late-stage invasive epithelial ovarian cancers. In the validation set, which were all early stage, 45 were invasive (38 stage I, four stage II, and three stage IIIA), 12 were borderline (10 stage I, two stage II), and three were nonepithelial (stage I granulosa cell, stage I malignant mixed Müllerian, one stage I endodermal sinus). Mucinous tumors were more common in the validation set (40%) than in the training set (15%); however, the training and validation sets were chosen without regard to histology. Reports of early-stage ovarian cancer trials indicate a higher proportion of mucinous tumors (25%)18 compared with trials of late-stage ovarian cancer (5%),19,20 and in screening trials (10%).6 Results for the validation data may reflect more favorably on markers sensitive to mucinous ovarian tumors21 than may be expected in a screening trial. The approach to obtaining unbiased estimates of preoperative sensitivity is to estimate the parameters of the statistical models in the training set, and independently determine the models performance for early-stage patients in the validation set. Data from control subjects determine the marker combinations corresponding to a fixed specificity of 98%.
Biomarkers The markers CA-125, CA 15-3, CA 72-4 were measured using kits supplied by Fujirebio (Malvern PA). M-CSF was assayed by methods previously described.22 The natural logarithm transformation was applied to the marker concentrations to reduce the skewness, given that most statistical methods are better suited to data with a symmetric bell-shaped distribution (analogous to pH for the logarithm of the H+ ion concentration). Histograms of the transformed markers in the training data are displayed in Figure 1.
Logistic Regression The first approach to predicting ovarian cancer from multiple markers is logistic regression,23 which estimates the probability of having ovarian cancer. This probability is the optimal quantity for screening and other decisions.24 The receiver operator characteristic curve has a central role in diagnostic test evaluation for this reason.25 Each marker is included as a linear term; a quadratic term is included if it is statistically significant (P < .05). Evaluation of the predicted probability for all of the control subjects in the validation set and suitable choice of the predicted probability cut point ensure a target specificity of 98%. A positive screening test is defined as a predicted probability exceeding this cut point. The proportion of predicted probabilities from all patient cases in the validation set exceeding the cut point provides an unbiased estimate of preoperative early-stage sensitivity.
Classification Trees
MDA The motivation for MDA17 in this application arises from the biologic observation of ovarian cancer heterogeneity.24 Ovarian cancers are a mixture of histologic subtypes (serous, endometrioid, mucinous, clear-cell, and others), and biomarkers may behave differently for each component of the mixture (subtype). MDA emulates this mixture by estimating the proportion of cancers in each component, and estimates a separate multivariate normal biomarker distribution for each component. Histology may not be the defining factor for biomarker distribution, and additional refinement may derive from microarray analysis. Given that the best division into components is unknown, MDA estimates which patients belong to each component directly based on the distribution of the biomarkers. The estimated density is then the mixture of the component densities. This procedure is performed for both the patient cases and for the control subjects, and aims to capture the biologic heterogeneity of disease and the heterogeneity of biomarkers among patient cases and control subjects. Theoretically, this approach provides the optimal result, similar to methods based on other motivations.29 Such approaches efficiently use the information in the joint distribution of the multiple markers. In practice, the difficulty with MDA is estimating the large number of parameters from a limited number of subjects. Exploratory analyses indicated that three-mixture components for patient cases and one component for controls provide a reasonable trade-off between accuracy and flexibility as indicated by the number of parameters. For one to four markers, the number of parameters required for linear logistic regression is two, three, four, and five, whereas for MDA, the number of parameters is much larger: seven, 13, 20, and 28. The MDA approach is available in the R language environment freely available at www.r-project.org, and in this implementation, readily provides the best two-dimensional representation of multiple markers for distinguishing between the patients and controls, graphically displaying the increased separation provided by additional markers.
Panels of Markers
Table 2 summarizes the operating characteristics of each of the three modeling approaches based on all four markers when the model is developed on the training set and reapplied to the training set at two fixed specificities: 98% and 95%. The first choice of specificity corresponds to a first-line specificity of 98%,6,8 resulting in an overall specificity of 99.9% and screening sensitivity of 71%. Maintaining a first-line specificity of 98% with multiple markers is likely to maintain the high level of overall screening specificity and simultaneously increase screening sensitivity. The second choice is a fixed specificity of 95%. This choice will allow greater improvements in sensitivity at the cost of an increase from 2% to 5% of patients referred to ultrasound per year, and a decrease in overall specificity. However, given that the overall specificity currently is at 99.9%, and a specificity of 99.6% is required to achieve a 10% PPV, there is some leeway to decrease the first-line specificity, so results for both specificities are provided.
Applying these models to the validation data gives unbiased estimates of the sensitivity in early-stage ovarian cancer at a fixed specificity for the three approaches (Table 3). Given the poor performance from the classification tree approach, the remaining results focus on the MDA and logistic regression approaches. A comprehensive listing of unbiased sensitivities is summarized in Table 4 by applying the same methods based on the MDA model to all possible subpanels of the markers; similarly, Table 5 lists the unbiased results for logistic regression approach. As an example, Figure 2 provides a continuous assessment of sensitivity for MDA and logistic regression for two biomarkers (CA 15-3 and M-CSF) for specificities ranging from 100% to 90%. The sensitivities at false-positive rates of 2% and 5% for MDA are 48% and 53%, and for logistic regression are 40% and 52%, respectively, and correspond to the estimates in Tables 4 and 5. In this example, MDA has superior sensitivity compared with logistic regression, but in other examples, the reverse is the case. As is readily apparent by comparing Tables 2 and 3: the sensitivities from the validation data decrease substantially from those estimated on the training data.
The best subpanel of markers of each size is listed in Table 6. The best two-marker panel uses CA-125 and CA 72-4 to distinguish patients with early ovarian cancer from controls, and demonstrates 67% sensitivity at 98% specificity in the logistic model and 60% sensitivity at 98% specificity in the mixture model. The best three-marker panel includes M-CSF, CA 72-4, and CA-125. This combination achieves 68% sensitivity at 98% specificity when modeled using logistic regression; in the mixture model the sensitivity is 70% (95% CI, 58% to 82%) at 98% specificity. Interestingly, in both modeling approaches, the three-marker panel attains slightly higher sensitivity at 98% specificity than when information in all four markers is considered68% compared with 66% sensitivity in the logistic model, and 70% compared with 68% in MDA.
Figure 3 displays the best two-dimensional summary of the information in multiple panels of markers. The horizontal and vertical axes measure linear combinations of the logarithmically transformed marker values. For a given number of markers, the panels selected had the greatest sensitivity for a fixed specificity of 98%. When M-CSF is added to CA-125 and CA 72-4, there is an increase in the separation between the patient cases and the controls (by comparison of Figs 3A and B), although as an absolute change in sensitivity from 67% to 70% at 98% specificity, it is minimal. However, the addition of CA 15-3 to the panel as displayed in Figure 3C does not noticeably increase the separation, and in fact, when objectively measured, adds no information to the patient-control status to the three markers in Figure 3B.
The addition of CA 72-4 and M-CSF to CA-125, and the systematic combination of the information using biologically motivated mixtures of multivariate normal distributions, significantly (P < .05) increases the preoperative sensitivity for early-stage disease from 45% to 70% at a fixed specificity of 98%. By preserving first-line specificity at 98%, it is tentatively expected that the addition of ultrasound as a second-line test to a first-line test with multiple markers would yield a combined specificity exceeding 99.6% while simultaneously increasing early-stage sensitivity. This result would require a prospective screening study for confirmation. Although adjustments should be made to the P value for selection from multiple panels, the exact adjustment in this context is still a matter for statistical research. Nevertheless, the difference between the lower CI limit (58%) and the standard estimate of 45% for CA-125 sensitivity for early-stage disease is substantial, and unlikely to disappear. Although the 25% increase in sensitivity moves closer to the goal for an ovarian cancer screening test, there is clearly room for additional improvement, and the search for complementary markers to CA-125 needs to continue. Having independent training and validation data sets from separate institutions to estimate model parameters and then independently evaluate the models performance ensures the sensitivity estimates are unbiased and more applicable to other sets of subjects outside this study. On a similar conservative note, the inclusion of 12 borderline tumors among 60 patient cases in the validation set may, in fact, lower the sensitivity estimates compared with a set with only invasive tumors, given that borderline tumors generally have lower marker levels than invasive tumors. Conversely, the over-representation of mucinous tumors in the validation data likely provides a greater contribution for CA 72-4 than would be expected in a screening trial. For the patient cases, markers are measured in preoperative serum. The sensitivity based on serum from clinically diagnosed patients, who are often symptomatic by time of diagnosis, is likely to be an upwardly biased estimate of the ultimate goal of maximizing early-stage sensitivity in a screening program. Nevertheless, it provides a useful surrogate measure of which additional markers are likely to contribute to increased screening sensitivity. Preoperative serum specimens are more easily obtained than are sera from patients identified in a screening trial, given that even in the postmenopausal group (which has the highest incidence), at least 2,500 women need to be screened to obtain preclinical serum from the one patient case expected. Given that preoperative serum is more readily obtained, it is usually available from many more patients than is screening serum from patients in screening programs before detection. The substantially increased sample size results in greater accuracy of the sensitivity estimate and firmer conclusions concerning which markers should be included in subsequent studies. After the best panel of markers has been identified on the basis of preoperative patient sera, the next step would be to examine the panel on the sera obtained before clinical diagnosis (such sera are much more difficult to obtain) and stored in biorepositories developed as a valuable by-product of screening trials. In general, the accuracy of the classification trees in the validation data is much lower than in the logistic regression and mixture models, which yield fairly similar results. It is likely that the classification-tree approach would perform better where discrete variables are involved in prediction, such as menopausal status or BRCA carrier status, as distinct from markers that are continuous variables. The logistic regression model provides a commonly available approach to combining information in multiple markers, whereas MDA does provide a slight increase in performance at times. In one logistic regression, a squared term for M-CSF was significant and improved the sensitivity substantially from 40% to 50%. Although squared terms were not significant for any other combination of markers, it is possible for a substantial improvement in sensitivity to have been missed by not incorporating nonsignificant squared terms. Another issue is that logistic regression requires many fewer parameters than MDA, and thus the statistical accuracy with which the MDA parameters are estimated is likely to be less than that for logistic regression. Hence the estimate for sensitivity based on the MDA model may be adversely affected, and only improved with a substantial increase in number of subjects. Another possibility is that the available software for implementing MDA does not allow for separate variances and covariances in patients and controls. It is likely that there is significantly greater variation in the joint distribution of markers among ovarian cancer patients than in controls, which is accounted for in this study by the greater number of subclasses in the patient cases. However, more flexibility would result if patient cases and controls, and their subclasses, had separate variance and covariance matrices. This expansion of the model is the subject of additional work that will provide greater accuracy in approximating the true multivariate marker distributions, and consequently achieve improved operating characteristics. However, in any given situation, it may not be clear whether MDA is preferable to logistic regression, and the two methods should be viewed as giving alternative approaches for combining the information in multiple biomarkers. These results show the promise of combining the information on multiple markers in a systematic approach for the early detection of ovarian cancer. The preoperative sensitivity estimate of 70% will likely be an overestimate of the early-stage screening sensitivity, thus adding further impetus for addition of new markers to the panel. Additional estimates of screening sensitivity could be determined by measuring markers in sera collected in a prospective screening program. The stage at the time of screen detection is not known in a retrospective study on sera from a biorepository. Therefore, stage-specific screening sensitivity cannot be measured. Only a prospective clinical trial can evaluate the sensitivity for early-stage preclinical disease, while simultaneously estimating positive predictive value. Furthermore, a prospective randomized clinical trial will provide the ultimate measure of a screening program; namely, the disease-specific reduction in mortality of the target disease. Until this criterion can be significantly reduced, measurement of potential biomarkers for the early detection of ovarian cancer should remain in the context of clinical research studies and cannot be advocated for clinical care in the general population. However, for high-risk individuals from families with genetic mutations or multiple ovarian and/or breast cancers, for whom screening with CA-125 may already be ongoing,30 definitive evaluation of the addition of other markers would require a prospective screening trial of multiple markers.
The following authors or their immediate family members have indicated a financial interest. No conflict exists for drugs or devices used in a study if they are not being evaluated as part of the investigation. Received more than $2,000 a year from a company for either of the last 2 years: Robert C. Bast Jr, Fujirebio.
Supported by a SPORE Grant in Ovarian Cancer 1P50 CA83639 from the National Cancer Institute, Department of Health and Human Services. A poster presentation of preliminary results from this study was given at the 38th Annual Meeting of the American Society of Clinical Oncology, Orlando, FL, May 18-21, 2002. Authors disclosures of potential conflicts of interest are found at the end of this article.
1. Landis SH, Murray T, Bolden S, et al: Cancer statistics, 1998. CA Cancer J Clin 48: 6-29, 1998[Abstract] 2. Wingo PA, Ries LA, Rosenberg HM, et al: Cancer incidence and mortality, 1973-1995: A report card for the U.S. Cancer 82: 1197-1207, 1998[CrossRef][Medline] 3. Parker SL, Davis KJ, Wingo PA, et al: Cancer statistics by race and ethnicity. CA Cancer J Clin 48: 31-48, 1998[Abstract] 4. Jacobs I, Bast RC Jr: The CA 125 tumour-associated antigen: A review of the literature. Hum Reprod 4: 1-12, 1989 5. Skates SJ, Xu FJ, Yu YH, et al: Toward an optimal algorithm for ovarian cancer screening with longitudinal tumor markers. Cancer 76: 2004-2010, 1995[CrossRef][Medline] 6. Jacobs IJ, Skates SJ, MacDonald N, et al: Screening for ovarian cancer: A pilot randomised controlled trial. Lancet 353: 1207-1210, 1999[CrossRef][Medline] 7. Jacobs I, Davies AP, Bridges J, et al: Prevalence screening for ovarian cancer in postmenopausal women by CA 125 measurement and ultrasonography. BMJ 306: 1030-1034, 1993
8. Einhorn N, Sjovall K, Knapp RC, et al: Prospective evaluation of serum CA 125 levels for early detection of ovarian cancer. Obstet Gynecol 80: 14-18, 1992
9. Crump C, McIntosh MW, Urban N, et al: Ovarian cancer tumor marker behavior in asymptomatic healthy women: Implications for screening. Cancer Epidemiol Biomarkers Prev 9: 1107-1111, 2000
10. McIntosh MW, Urban N, Karlan B: Generating longitudinal screening algorithms using novel biomarkers for disease. Cancer Epidemiol Biomarkers Prev 11: 159-166, 2002
11. Kim JH, Skates SJ, Uede T, et al: Osteopontin as a potential diagnostic biomarker for ovarian cancer. JAMA 287: 1671-1679, 2002
12. Woolas RP, Xu FJ, Jacobs IJ, et al: Elevation of multiple serum markers in patients with stage I ovarian cancer. J Natl Cancer Inst 85: 1748-1751, 1993 13. van Haaften-Day C, Shen Y, Xu FJ, et al: OVX1, macrophage-colony stimulating factor, and CA-125-II as tumor markers for epithelial ovarian carcinoma: A critical appraisal. Cancer 92: 2837-2844, 2001[CrossRef][Medline] 14. Einhorn N, Knapp RC, Bast RC, et al: CA 125 assay used in conjunction with CA 15-3 and TAG-72 assays for discrimination between malignant and non-malignant diseases of the ovary. Acta Oncol 28: 655-657, 1989[Medline] 15. Zhang Z, Barnhill SD, Zhang H, et al: Combination of multiple serum markers using an artificial neural network to improve specificity in discriminating malignant from benign pelvic masses. Gynecol Oncol 73: 56-61, 1999[CrossRef][Medline] 16. Petricoin EF, Ardekani AM, Hitt BA, et al: Use of proteomic patterns in serum to identify ovarian cancer. Lancet 359: 572-577, 2002[CrossRef][Medline] 17. Hastie T, Tibshirani R: Discriminant analysis by Gaussian mixtures. J R Stat Soc B Methodol 58: 155-176, 1996 18. Lee T, Adolph A, Krepart GV, et al: The benefits of comprehensive surgical staging in the management of early-stage epithelial ovarian carcinoma. Gynecol Oncol 85: 351-355, 2002[CrossRef][Medline]
19. Muggia FM, Braly PS, Brady MF, et al: Phase III randomized study of cisplatin versus paclitaxel versus cisplatin and paclitaxel in patients with suboptimal stage III or IV ovarian cancer: A Gynecologic Oncology Group study. J Clin Oncol 18: 106-115, 2000
20. Alberts DS, Liu PY, Hannigan EV, et al: Intraperitoneal cisplatin plus intravenous cyclophosphamide versus intravenous cisplatin plus intravenous cyclophosphamide for stage III ovarian cancer. N Engl J Med 335: 1950-1955, 1996 21. Filella X, Friese S, Roth HJ, et al: Technical performance of the Elecsys (R) CA 72-4 test: Development and field study. Anticancer Res 20: 5229-5232, 2000[Medline] 22. Xu FJ, Ramakrishnan S, Daly L, et al: Increased serum levels of macrophage colony-stimulating factor in ovarian cancer. Am J Obstet Gynecol 165: 1356-1362, 1991[Medline] 23. Cox DR, Snell EJ: Analysis of Binary Data (ed 2). New York, NY, Chapman and Hall, 1989 24. McIntosh MW, Pepe MS: Combining several screening tests: Optimality of the risk score. Biometrics 58: 657-664, 2002[CrossRef][Medline]
25. Baker SG: The central role of receiver operating characteristic (ROC) curves in evaluating tests for the early detection of cancer. J Natl Cancer Inst 95: 511-515, 2003 26. Breiman L: Classification and Regression Trees. Belmont, CA, Wadsworth International Group, 1984 27. S-PLUS 2000 Guide to Statistics. Seattle, WA, Data Analysis Products Division, MathSoft Inc, 1999 28. Ripley BD: Pattern recognition and neural networks. New York, NY, Cambridge University Press, 1996 29. Baker SG: Identifying combinations of cancer markers for further study as triggers of early intervention. Biometrics 56: 1082-1087, 2000[CrossRef][Medline] 30. NIH Consensus Conference. Ovarian cancer: Screening, treatment, and follow-upNIH Consensus Development Panel on Ovarian Cancer. JAMA 273: 491-497, 1995[Abstract] Submitted March 14, 2003; accepted April 29, 2004. This article has been cited by other articles:
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||
|
Copyright © 2004 by the American Society of Clinical Oncology, Online ISSN: 1527-7755. Print ISSN: 0732-183X
|