|
|||||
|
|
||||||
Journal of Clinical Oncology, Vol 22, No 21 (November 1), 2004: pp. 4401-4409 © 2004 American Society of Clinical Oncology. DOI: 10.1200/JCO.2004.66.155 Cancer Consultation Preparation Package: Changing Patients but Not Physicians Is Not EnoughFrom the Medical Psychology Research Unit, School of Psychology/Department of Cancer Medicine, University of Sydney; Departments of Medical Oncology and Radiation Oncology, Royal Prince Alfred Hospital, Sydney, Australia Address reprint requests to Phyllis Butow, PhD, Medical Psychology Research Unit, University of Sydney, Sydney, NSW 2006, Australia; e-mail: phyllisb{at}med.usyd.edu.au
PURPOSE: This study evaluated a cancer consultation preparation package (CCPP) designed to facilitate patient involvement in the oncology consultation. PATIENTS AND METHODS: A total of 164 cancer patients (67% response rate) were randomly assigned to receive the CCPP or a control booklet at least 48 hours before their first oncology appointment. The CCPP included a question prompt sheet, booklets on clinical decision making and patient rights, and an introduction to the clinic. The control booklet contained only the introduction to the clinic. Physicians were blinded to which intervention patients received. Patients completed questionnaires immediately after the consultation and 1 month later. Consultations were audiotaped, transcribed verbatim, and coded. RESULTS: All but one patient read the information. Before the consultation, intervention patients were significantly more anxious than were controls (mean, 42 v 38; P = .04); however anxiety was equivalent at follow-up. The CCPP was reported as being significantly more useful to family members than the control booklet (P = .004). Patients receiving the intervention asked significantly more questions (11 v seven questions; P = .005), tended to interrupt the physician more (1.01 v 0.71 interruptions; P = .08), and challenged information significantly more often (twice v once; P = .05). Patients receiving the CCPP were less likely to achieve their preferred decision making style (22%) than were controls (35%; P = .06). CONCLUSION: This CCPP influences patients' consultation behavior and does not increase anxiety in the long-term. However, this intervention, without physician endorsement, reduced the percentage of patients whose preferred involvement in decision making was achieved.
Models of medical decision making have shifted in recent years from emphasizing the paternalistic responsibility of physicians to ensure a good outcome, to advocating shared decision making. Shared decision making is seen as avoiding the dangers both of placing too much power in the physicians' hands and too much responsibility on patients. Participatory models acknowledge that physicians and patients may have different values and preferences that affect the course of clinical actions. Thus models of shared decision making propose that the decision is a process of shared understanding of personal values and subsequent negotiation to achieve an appropriate treatment decision. The majority of cancer patients in the Western world now desire full information about their disease, although in all reported studies there is a small but significant proportion of patients who prefer minimal information and/or a passive role in decisions about their care.1-3 There is still considerable variation in the extent to which patients are informed of treatment options and participate in decision making.4 A number of studies have demonstrated positive patient outcomes as a result of involvement in decision making. We investigated the impact of patient roles in decision making in 274 cancer patients visiting an oncologist for the first time.5 The treatment decision was unresolved in 12% by 1 week postconsultation, but of the remaining patients, only 34% achieved their desired role in decision making (range, 29% to 41% among patients of the 10 oncologists involved in the study). Patients who had achieved their preferred role were most satisfied with their consultation, whereas patients who were less active than desired were least satisfied (P = .01). Street and Voigt6 examined the relationship between perceptions of control over treatment decisions in early breast cancer patients and subsequent health-related quality of life. Patients who more actively participated in their consultations, particularly in terms of offering opinions, assumed more responsibility for treatment decisions in the year after surgery than did less expressive patients. Patients who reported more involvement in their consultation also reported higher levels of quality of life than did patients who perceived that they had less decisional control. These findings emphasize the importance of facilitating patient involvement in decision making so that they achieve their desired involvement. A number of strategies have been proposed to facilitate patient involvement, including decision aids and training or prompts in asking questions. In three separate randomized trials we have found that a question prompt sheet given to cancer patients immediately before their initial appointment with an oncologist increased question asking, particularly about prognosis, and when endorsed by the physician, decreased patient anxiety, improved patient recall, and shortened consultation duration.7-9 We concluded that a question prompt sheet addressed by the physician is a simple, inexpensive, and effective means of promoting patient question asking in the cancer consultation. However, question asking is only part of patient activity and involvement. For patients to be able to participate in decision making, they first need to understand the basis of medical decision making in general and the specific features of their situation that influence that process. Second, patient expectations of patient roles in decision making must encompass active involvement. Third, patient anxiety and distress about their situation must be sufficiently ameliorated to enable effective cognitive functioning. Fourth, patients and physicians need to come to a shared understanding of personal values and to then negotiate an appropriate treatment decision. We have developed a cancer consultation preparation package (CCPP) for patients, with the goal of informing patients of their rights, proposing questions that they might choose to ask, and outlining evidence-based decision making. The package aims to change patient behavior, and through these changes, alter physician behavior. It was hoped that if a relatively inexpensive patient-based intervention could achieve these aims, then more expensive, physician-based interventions (such as communication skills training) might be unnecessary. The aim of this study was to evaluate the impact of providing patients with the CCPP at least 48 hours before their initial consultation with an oncologist. We hypothesized that patients receiving the CCPP package (compared with patients receiving a control booklet) would ask more questions and receive more information and decisional support from their physicians, and have enhanced achievement of their information and involvement preference, increased satisfaction with the treatment decision-making process, increased satisfaction with their oncology consultation, reduced anxiety, and reduced depression.
A randomized trial design was used to investigate the effect of providing cancer patients with a CCPP versus a control booklet. The control booklet informed patients about the physical and spatial characteristics, staffing, and procedures of the Sydney Cancer Centre (Sydney, Australia). The full CCPP contained the control booklet plus three components designed to provide a conceptual framework for patients about evidence-based clinical decision making and to inform patients about their potential role in decision making. The following three components were included. First, a booklet developed by our group, entitled How Treatment Decisions Are Made, introduces the notion of evidence-based medicine, outlines levels of evidence, presents a synopsis of factors other than evidence that may influence treatment recommendations, and encourages active involvement in the consultation. Second, a brochure produced by Central Sydney Area Health Service, entitled Your Rights and Responsibilities as a Patient, presents the legal rights of patients in an Australian hospital, and avenues for resolving complaints and disputes. Third, a question prompt sheet, developed and previously evaluated by our group,7-9 endorses question asking, and includes 19 suggested questions and a recommendation to prepare a list of questions.
Procedure A research nurse telephoned eligible patients to inform them of the study and invite their participation. Patients were informed that they would be offered a copy of the audiotape after their consultation. The research nurse assigned an identification to consenting patients, determined random assignment, and sent the appropriate package with a consent form at least 48 hours before the first consultation. Physicians were blinded to which package the patient received. Patients completed questionnaires assessing demographic variables, anxiety, depression, information and involvement preferences, and satisfaction with the CCPP before the consultation. Their consultation with the oncologist was audiotaped, with a copy offered to the patient and the original retained for analysis (Fig 1).
Patients completed additional questionnaires immediately and 1 month after the consultation, assessing anxiety, depression, perception of information provided and achieved involvement in decision making, satisfaction with the treatment decision (if one had been made), and satisfaction with the consultation. Each oncologist recorded his or her satisfaction with the decision-making process, and the extent he or she believed the patient's information and involvement preferences were met, immediately after the consultation.
Measures Depression was measured using the Beck Depression Inventory (short form).11 Scores range from 13 to 52, with a high score indicating greater depression. Preferences for information were assessed using two items derived from the Cassileth Information Styles Questionnaire2 measuring preference for greater or lesser detail, and type of information (only information needed to care for myself properly, additional information only if it is good news, or as much information as possible, good or bad). Preferences for decisional control were assessed using a validated question from previous studies in cancer patients.12 Patients indicated whether they wanted to play an active, passive, or collaborative role with their physician when making treatment decisions. Patient and physician perception of information provided and role in decision making achieved were assessed using adaptations of the above items, in which patients and physicians indicated their perception of what actually happened in the consultation. Patient perceptions were compared with their stated preferences to provide a measure of achievement of desired role. Information-seeking behavior was assessed using the information subscale of the Krantz Health Opinion Survey.13 Scores range from 0 to 7, with high scores indicating high information-seeking behavior. Patient satisfaction with the booklet or CCPP was assessed using a series of Likert scales developed by our group, with high scores indicating greater satisfaction. Patients indicated whether they or others had read the information, and to what degree the intervention was useful, easy to understand, helpful to family and friends, and anxiety provoking, reassuring, disturbing, confusing, helpful, or upsetting. Patient satisfaction with the consultation was assessed using a 25-item Likert scale adapted from Roter14 and Korsch et al15 and used extensively in our work.9, 16 This scale assessed satisfaction with the amount and quality of information presented, the communication skills demonstrated by the physician, and the level of patient participation in the consultation. Scores range from 25 to 125, with high scores indicating greater satisfaction. Patient and physician satisfaction with the decision-making process were assessed using a 5-point Likert scale designed for this study. Respondents indicated whether they were extremely satisfied, very satisfied, satisfied, unsatisfied, or very unsatisfied with the decision-making process.
Coding of Audiotapes
In addition, total questions asked by the patient and relatives, total number of words spoken by the patient and physician, number of interruptions by both patient and physician, and duration of the consultation were recorded. Questions were also categorized and summed under nine themes: history and symptoms, diagnosis, tests, prognosis, treatment of adverse effects, treatment options, level of evidence, clinical trials, and other. Given that many patients asked no questions in each category, these variables were recoded into zero, one to two, or more than two questions. Finally, the questions were reanalyzed and categorized into two groups: new questions (introducing a new issue) versus clarification questions (concerning an issue already under discussion); these were also summed. This project received ethical approval from the Central Sydney Area Health Service and the University of Sydney ethics committees.
A total of 246 patients were invited to participate and 200 consented to be randomly assigned into the study (81%). Nonconsent was primarily because patients felt too sick or stressed. Of the 200 patients randomly assigned, 18 were subsequently identified as ineligible; nine had seen another oncologist previously, one canceled the appointment, and eight withdrew primarily because they felt too ill or stressed, leaving 164 patients. Age and sex of nonparticipating patients were not significantly different from those of patients who participated. Twenty-three of the 164 patients did not complete the final questionnaire (86% retention rate). Of these, 13 had died. A total of 160 audible consultation audiotapes were available for verbatim transcription and coding. All but one patient wanted a copy of the tape to take home. Given that no significant differences were found on demographic or disease variables between control and intervention arms (Tables 2 and 3), subsequent analyses did not adjust for potential confounders.
A treatment recommendation was made in 93% of the consultations; however, in 14% of cases, patients subsequently reported that no treatment decision was made, perhaps because this was a second opinion. Of the recommendations made, 24% were for no treatment, 4% were for observation, 29% were for palliative care, and 42% were for treatment with curative intent. There were no differences between groups in the distribution of type or presence of recommendation.
Before the Consultation Satisfaction with the CCPP. No significant differences were found between groups in terms of reported anxiety provoked, perceived utility, or ease of understanding of the materials. Approximately half the patients reported that the material made no difference in their anxiety levels and one third reported a reduction in anxiety. Approximately one third reported that these materials were extremely useful, one third reported that these materials were very useful, and one third reported that these materials were a little useful. Approximately 50% of both groups found the material very easy to understand, with about one third reporting that they were easy to understand, and 13% reporting that they were reasonably easy to understand.
However, there was a significant difference in the reported usefulness of the CCPP and control booklet for the family ( Information and involvement preferences. There were no significant differences between the groups in information and involvement preferences measured before the consultation (Table 4). Eighty-seven percent of patients preferred as much information as possible, good or bad, whereas 37% wanted the physician to take the primary role in decision making, 49% wanted shared decision making, and 14% wanted to take the primary role.
Anxiety and depression. Before the consultation, patients who had received the CCPP were significantly more anxious than those who received the control booklet (mean, 42 v 38, respectively; t = 2.0; P = .04). Therefore, we controlled for anxiety before the consultation in subsequent analyses by computing change scores. The groups' depression levels were similar at baseline; both were in the low range (mean, 16.25).
Behavior During the Consultation Ten active patient behaviors were coded. The percentages of consultations in which patient active behaviors occurred are listed in Table 5. When summed, no significant difference between groups was found (t = 0.94; P = .35). CCPP patients showed on average five active behaviors, whereas booklet patients showed 4.76 active behaviors. Four of these behaviors were examined individually (initiates agenda, voices concerns, questions or challenges, and interrupts) because these were judged to be particularly challenging for patients, and had some variability. Expression of agenda and concerns were not significantly different between groups. However, patients in the CCPP group tended to interrupt more often (median, 1.01 times compared with 0.71 times; z = 0.17; P = .08) and challenged information significantly more often (median, two v one time; z = 2.4; P = .05).
Physician behavior. There was no significant difference between groups in the total number of critical information items provided by the physician. Zero of four critical items were given in 8% of consultations, one item was given in 16% of consultations, two to three items were given in 71% of consultations, and in only 5% of consultations were all four items given. One of the items (cost of treatment) was rarely discussed (n = 19; 12%). The frequency of behaviors encouraging patient participation is listed in Table 6. On average, oncologists demonstrated about 7.5 of the 12 behaviors, with no significant differences between the groups. Physicians' rapport-building behaviors are listed in Table 7. No significant differences were observed between groups. Physicians commonly initiated social topics and issues, and addressed patient anxiety, but less commonly asked patients how they would like to be addressed, and often interrupted the patient. Consultation length was similar between groupson average, 36 minutes per consultation. Similarly, physicians and patients spoke for about the same amount of time in both groups (with physicians speaking on average twice as long as patients).
After the Consultation Achievement of preferred decision-making style. No significant differences were found between groups in reported involvement in decision making after the consultation (Table 4). A new variable was created, with patients receiving a score of 1 if their reported involvement matched their preferred style stated before the consultation, and a score of 0 if their actual decision-making style did not match their preferred style. There was a trend for significant differences between the groups, but this was against expectations. Patients receiving the CCPP were less likely to achieve their preferred decision-making style (22%) than those receiving the control booklet (35%; 2 = 3.56; P = .06). Satisfaction. Satisfaction with the consultation and the treatment decision were both high and not normally distributed, so nonparametric Mann-Whitney tests were conducted. No significant differences were found between the groups in satisfaction with either the consultation or treatment decision. Physicians were also equally satisfied with decision making whether or not their patients had received the CCPP or the control booklet. Anxiety and depression. In both groups, anxiety decreased by 3 points after the consultation, and there was no significant difference between the groups immediately after the consultation and 1 month later. No significant differences between groups were observed in raw or change scores on depression immediately after the consultation or 1 month later.
Interaction With Information Style
We had hypothesized that a comprehensive package including elements designed to facilitate patient question asking and understanding of medical decision making, delivered well before the first oncologic consultation to allow time for review, would result in patients asking more questions, and being more likely to achieve their involvement preference. This relatively inexpensive intervention did change patient behavior. As in all previous studies evaluating question prompt lists (QPLs), patients receiving the full package (which included a QPL) asked significantly more questions about prognosis. They also raised significantly more new topics, challenged information more often, and asked more questions overall. The number of questions asked (13 questions) by these patients is much higher than we have noted in previous QPL studies, in which an average of nine questions were asked.9 Although a direct comparison is not possible, this result does suggest that providing patients with more time to consider, show their family, and use such an intervention allows it to have a greater impact. (In our earlier studies, patients were provided the QPL in the waiting room, just before their oncology consultation). Although patients' questions did increase, patients receiving the comprehensive package did not request, and oncologists did not provide, more information about the evidence base behind treatment recommendations. Because this theme was targeted specifically by one of the booklets included in the full package, this was somewhat disappointing. It seems that simply receiving a booklet through the mail is not sufficient to empower patients to seek clarification of the basis for treatment recommendations. Overall, discussion of this issue was limited. Although the physicians in our study performed some facilitative actions commonly (eg, asking the patient for their agenda and checking their understanding), they were much less likely to discuss the quality of evidence, refer to treatment guidelines, acknowledge differences of medical opinion, or offer decisional delay. This is not surprising, given that the notion of evidence-based, patient-centered care is a relatively new concept in medicine. Although patients receiving the full package changed their behavior, this did not result in them being more likely to believe they had achieved their involvement preference. Although approximately one third of patients in the control group reported achieving their involvement preference, a figure similar to that reported in our previous study,5 only one fifth of patients receiving the full package reported achieving their involvement preference. Thus the intervention actually seemed to decrease the likelihood of patients participating in decisions in the way they preferred. In particular, within the group receiving the full package, more of the patients who had declared they wanted to share decision making believed that the physician had made the decision. Perhaps these better-informed patients judged their physician's behavior more stringently. Although physicians in this study were aware of, and supportive of, the intervention being tested, they were not asked or trained specifically to respond to more active patients and they were blind to the intervention. In our earlier study of a QPL, physicians were randomly assigned to ignore or actively endorse and work through the question prompt sheet.11 Positive outcomes for patients who received the question prompt sheet were experienced only when they saw a physician randomly assigned to the endorsement condition. It seems that interventions need to target both parties, and oncologists need to endorse the intervention and/or be trained to respond adequately to more active patients. Furthermore, this suggests that interventions that do not involve the physician, such as by nurses or administrative assistants, also might not be effective. This is an important finding of our study, showing that a shared or collaborative approach cannot be achieved by targeting patients alone, but will require a change in physician behavior and training. We had hoped that empowered patients would stimulate a concomitant change in physician behavior without the need for a physician-based intervention. It is perhaps not surprising that this was not a successful approach. As other authors have noted, patients are in a relatively low status position in the consultation room, and both patients and physicians have long-standing and hard-to-shift expectations of a physician-led interaction. Cancer patients are especially vulnerable because they are facing a life-threatening illness, and are looking primarily for reassurance from their physician. Therefore, expecting patients to not only change their own behavior (which these patients did), but to effect a change in consultation behavior toward the ideal shared decision-making model, is perhaps naive. It seems that we cannot escape the necessity for properly conducted communication skills training programs for physicians, which incorporate the principles of shared decision making and provide the skills for facilitating this model. Although most patients reported no influence on anxiety, patients receiving the full package were significantly more anxious before seeing the oncologist than those receiving the control booklet. At that time, patients in both groups reported similar preferences for information and involvement, so it did not seem that the package had succeeded in changing patients' preference to a more active role. Perhaps those receiving the full package thought more would be expected of them and this gap between preferences and expectations increased their anxiety. Many patients viewing similar materials on the Web may similarly be more anxious if they believe that more participation will be expected of them. Many Web sites are publishing lists of questions and promoting behaviors similar to those described in the CCPP. Thus these findings have implications beyond the current study. In this study, the heightened anxiety was reduced after the consultation. Either the oncologists (who behaved similarly toward both groups) successfully allayed the heightened anxiety, the patients discovered they were not actually expected to be more active, or those patients who were more active found the experience less worrying than expected. In any case, it seems important that patients exposed to such materials are reassured that the physicians they are about to see are happy to, and have been trained to, meet their needs, whatever their preferences. This again emphasizes the need for concomitant physician training. We found that the package was welcomed, deemed useful, and read by almost all patients. The fact that patients' and physicians' self-reports of the utility of the intervention did not show differences between groups, whereas measures of consultation behavior did, emphasizes the importance of obtaining direct observations of behavior, rather than relying on possibly unreliable self-reflection. We have found consultation audiotapes to be an invaluable audit tool in studies of this kind. Only half of the patients receiving the full package showed it to their spouse or other close person, compared to three fourths of those receiving a much shorter control booklet. However, significantly more family members were reported to find the full package useful. Patients may have believed the information was too long and/or controversial to show their family members; however, those who assumed their family members would be interested in this material judged correctly.
Limitations of the Study Because decision making sometimes occurs over time, it would have been interesting to monitor patient and physician behavior over several consultations. This was beyond the capacity of this study and would be a worthwhile addition to future research in this area. It is possible that some or all of the components of the consultation preparation package were difficult for patients to understand and retain, thus limiting their impact. This may have been true, in particular, of the booklet explaining evidence-based medicinea difficult concept to portray in a few pages. The materials were constructed for comprehension by a person with a reading level below grade 10. During the pilot study, patients reported that the materials were easy to understand (as they did in the current study), and they were able to summarize the points made. However, direct evaluation of understanding and recall (not included in the current study) would increase confidence that patients had understood the material. In conclusion, this CCPP, delivered at least 2 days before the initial consultation with an oncologist, was successful in increasing patient question-asking behavior and level of activity in the consultation without increasing anxiety by the end of the consultation. Patients valued the package, for both themselves and their families. It seems that active endorsement of patient activity in the consultation by the physician is needed to allow such interventions to have their full impact. Additional research is needed to identify more effective ways of facilitating patient involvement in decision making.
The authors indicated no potential conflicts of interest.
Supported by the National Health and Medical Research Council of Australia. Presented in poster form at the 39th Annual Meeting of the American Society of Clinical Oncology, Chicago, IL, May 31-June 3, 2003, and at the Clinical Oncology Society of Australia meeting, Sydney, Australia, November 28-30, 2002. Authors' disclosures of potential conflicts of interest are found at the end of this article.
1. Blanchard CG, Labreque MS, Ruckdeschel JC, et al: Information and decision-making preferences of hospitalised cancer patients. Soc Sci Med 27:1139-1145, 1988 2. Cassileth BR, Zupkis RV, Sutton-Smith K, et al: Information and participation preferences among cancer patients. Ann Intern Med 92:832-836, 1980
3. Degner LF, Kristjanson LJ, Bowman D, et al: Information needs and decisional preferences in women with breast cancer. JAMA 277:1485-1492, 1997
4. Tattersall MHN, Butow PN, Griffin A-M, et al: The take-home message after a cancer consultation: A randomised trial of consultation audiotapes and individualised letters to patients. J Clin Oncol 12:1305-1311, 1994 5. Gattelari M, Butow P, Tattersall MHN: Sharing decisions in cancer care. Soc Sci Med 52:1865-1878, 2001
6. Street RL, Voigt B: Patient participation in deciding breast cancer treatment and subsequent quality of life. Med Decis Making 17:298-306, 1997
7. Butow PN, Dunn SM, Tattersall MHN, et al: Patient participation in the cancer consultation: Evaluation of a question prompt sheet. Ann Oncol 5:199-204, 1994 8. Brown R, Butow P, Boyer MJ, et al: Promoting patient participation in the cancer consultation: Evaluation of a prompt sheet and coaching in question asking. Br J Cancer 80:242-248, 1999[CrossRef][Medline] 9. Brown RF, Butow PN, Dunn SM, et al: Promoting patient participation and shortening cancer consultations: A randomised trial. Br J Cancer 85:1273-1279, 2001[CrossRef][Medline] 10. Spielberger CD: Manual for the State Trait Anxiety Inventory (Form Y). Palo Alto, CA, Consulting Psychologists Press, 1983 11. Beck AT, Steer RA, Brown GK. Manual for Beck Depression Inventory-II. San Antonio, TX, Psych Corp, 1996 12. Degner LF, Sloan JA. Decision-making during serious illness: What role do patients really want to play? J Clin Epidemiol 45:941-948, 1992[CrossRef][Medline] 13. Krantz DS, Baum A, Wideman M: Assessment of preferences for self-treatment and information in health care. J Pers Soc Psychol 39:977-990, 1980[CrossRef][Medline] 14. Roter DL: Patient participation in the patient-provider interaction: The effects of patient question asking on the quality of interaction, satisfaction and compliance. Health Educ Monogr 5:281-315, 1977[Medline]
15. Korsch BM, Gozzi EK, Francis V: Gaps in doctor-patient communication. Pediatrics 42:855, 1968
16. Dunn SM, Patterson PU, Butow PN, et al: Cancer by another name: A randomised trial of the effects of euphemism and uncertainty in communicating with cancer patients. J Clin Oncol 11:989-996, 1993 17. Charles C, Gafni A, Whelan T: Shared decision making in the medical encounter: What does it mean? (Or it takes at least two to tango). Soc Sci Med 44:681-692, 1997 18. Feste C, Anderson RM: Empowerment: From philosophy to practice. Patient Educ Couns 26:139-144, 1995[CrossRef][Medline]
19. Emanuel EJ, Emanuel LL: Four models of the physician-patient relationship. JAMA 267:2221-2226, 1992 20. Gafni A, Charles C, Whelan T: The physician-patient encounter: The physician as a perfect agent for the patient versus the informed treatment decision making model. Soc Sci Med 47:347-354, 1998 Submitted June 30, 2003; accepted July 14, 2004.
This article has been cited by other articles:
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||
|
Copyright © 2004 by the American Society of Clinical Oncology, Online ISSN: 1527-7755. Print ISSN: 0732-183X
|