Advertisement
Journal of Clinical Oncology  
Search for:
Limit by:
  Browse by Subject or Issue
Home Search or Browse JCO My JCO Subscriptions Customer Service Site Map

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Purchase Article
Right arrow View Shopping Cart
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a colleague
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Save to my personal folders
Right arrow Download to citation manager
Right arrowRights & Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Wright, E.P.
Right arrow Articles by Cull, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Wright, E.P.
Right arrow Articles by Cull, A.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Facebook   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?
Journal of Clinical Oncology, Vol 21, Issue 2 (January), 2003: 374-382
© 2003 American Society for Clinical Oncology

Feasibility and Compliance of Automated Measurement of Quality of Life in Oncology Practice

E.P. Wright, P.J. Selby, M. Crawford, A. Gillibrand, C. Johnston, T.J. Perren, R. Rush, A. Smith, G. Velikova, K. Watson, A. Gould, A. Cull

From Cancer Research UK, Clinical Centre in Leeds, St James’s University Hospital, University of Leeds, Leeds; Department of Medical Oncology, Airedale General Hospital, Keighley, England; Cancer Research UK Medical Oncology Unit, Western General Hospital; and Information and Statistics Division, National Health Services Scotland, Edinburgh, Scotland, United Kingdom.

Address reprint requests to E.P. Wright, PhD, Cancer Research UK, Clinical Centre in Leeds, St James’s University Hospital, Beckett St, Leeds, England, LS9 7TF; email: medepw{at}cancermed.leeds.ac.uk.


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 PATIENTS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Purpose: Systematic quality-of-life (QOL) assessment may have value in oncology practice by increasing awareness of a wide range of issues, possibly increasing detection of psychologic morbidity, social problems, and changes in physical status, and improving care and its outcomes. However, logistic problems are substantial. Automated systems solve many of these problems. We field-tested the feasibility and compliance that can be achieved using a computer touchscreen system in two consecutive studies.

Patients and Methods: In study 1, a prospective cohort of 272 patients was offered QOL assessment at each clinic appointment for 6 months. In study 2, all patients (N = 1,291) were offered QOL assessment as part of clinic routine during a 12-week period.

Results: In study 1, 82% of patients agreed to take part, but over time, compliance was poor (median, 40%; mean, 43%) and deteriorated with longer follow-up. In study 2, the overall compliance was greatly increased (median, 100%; mean, 70%), and compliance was retained over multiple visits. In study 1, compliance was better in younger patients, males, and socially advantaged patients, but was not affected by the presence of depression or anxiety, or QOL. In the second study, building on experience in the first study, data collection and storage in the computer system was excellent, achieving 98% of collected data stored in one center. In general, patients were comfortable with the computers and the approach. Data collection on the wards was more difficult and less complete than in clinics, especially for patients undergoing acute admissions.

Conclusion: Feasibility with higher compliance was demonstrated in study 2, in which the data collection was integrated into routine care, and can be improved with further technical initiatives and education of staff.


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 PATIENTS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
QUALITY OF LIFE (QOL) is now established in cancer clinical trials as a principal or subsidiary end point, and we are beginning to appreciate the clinical meaning and value of these data.1–4 However, the value of the direct measurement of QOL in oncology practice also may be substantial.5–9 It may enhance the interaction between healthcare workers and cancer patients by increasing awareness of a wide range of issues, including detection of psychologic morbidity and assessment of functional status and physical symptoms, and therefore, it can influence the process of care and its outcomes. The discovery of problems and issues may be increased by the use of QOL instruments and the presentation of those data to healthcare workers.

Low detection rates for anxiety, depression, and other psychologic distress and inappropriate referral to support services are recognized in oncology.10–12 Self-report screening questionnaires for psychologic distress have been tested with cancer patients, and the detection rates, although not high, are better than those found in standard clinical practice.13 The introduction of routine screening for psychologic distress should improve detection and may result in more appropriate referrals and improved outcomes, although this has not yet been demonstrated.14

There remain barriers to overcome before QOL measures and psychosocial screening can be established routinely in oncology and lead to benefits for patients. The manual collection of these data, their analysis, entry into databases, and presentation on paper are difficult, laborious, and consume substantial time and resources. It remains uncertain whether patients will be willing to comply with routine QOL data collection. Typically, approximately 70% of the patients in clinical trials complete the baseline QOL measurement, but with follow-up assessments, the compliance is lower and missing data are a problem. Compliance with QOL assessment in clinical trials with regular support from research staff may differ from compliance with routine QOL data collection in practice, in a busy oncology clinic. Unlike other clinic procedures (weighing, blood tests, and so on), the noncompletion of the QOL assessment might not be expected by patients to hinder medical consultation or prevent treatment, so it might be perceived as unnecessary.

We feel that for the field to progress, the logistic problems must be overcome and feasibility and compliance assessed. The collection of QOL data should become robust, inexpensive, easy, and readily interpretable. Its place in clinical practice can then be evaluated in large patient numbers and different clinical settings. For this reason, we and others have developed and evaluated automated systems.15–19 The ideal system will allow direct input from patients to measure their responses to standardized questionnaires of appropriate reliability, validity, and scope of inquiry. The data should automatically be entered into a database, analyzed, and presented to healthcare workers in real time to make it possible that the process of care is immediately informed. Although this ideal has not yet been achieved, we have shown that the use of computer touchscreens with relatively brief cancer-specific questionnaires (the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30, version 3.0 [EORTC QLQ-C30]2 and the Hospital Anxiety and Depression Scale [HADS]20) allows the collection of data quickly and easily, and that these data are usually the same as those collected by paper and pencil approaches.17 This approach is acceptable to patients and will discover additional information to that found in conventional medical notes. There is evidence that automated QOL data collection will alter the process of care, although there are not yet sufficient data for us to conclude that it can improve outcomes for our patients.9,21

The broad aims of the projects were to introduce automated regular measurement of QOL in oncology clinical practice and to examine the feasibility of the approach in terms of patient willingness to participate in the project, compliance over time, and attitude to the measurement. The use of QOL results by the professionals was not the focus of this study, but some information was collected and limited results are reported here.

In this article, we report our experience of field-testing the feasibility and compliance that can be achieved with computer touchscreen systems and cancer patients in clinical practice. First, we assessed compliance in a cohort of patients who gave informed consent to enter the study, and the data that related to their longitudinal follow-up was collected (study 1). This study ran from April 1997 to June 1998. The results of this study next led us to try a strategy in which all patients in a practice (clinic and ward based) were asked to complete the touchscreen systems at each visit, and the data that related to their longitudinal follow-up were extracted from the total data pool—an all-comers approach (study 2), undertaken in 1999. For this latter approach, we were given permission by our institutional ethics committees to offer patients the QOL assessments without prior individual informed consent. Study 1 was performed in two centers, St James’s Hospital, Leeds, and Western General Hospital, Edinburgh, United Kingdom, and, in addition, at Airedale Hospital, West Yorkshire, United Kingdom, in study 2.


    PATIENTS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 PATIENTS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Studies 1 and 2
In both studies, the instruments were the EORTC QLQ-C30, which comprises 30 questions, including functioning scales (physical, role, emotional, cognitive, and social) and symptom scales and items, and the HADS, a 14-item questionnaire designed specifically for detecting anxiety and depression in physically ill people. The questionnaires were presented to patients via a desktop computer touchscreen. For security, the hardware was locked to a trolley in Edinburgh and housed in locked cabinets in Leeds and Airedale. The computers were used by patients in quieter areas of the clinic to try to ensure privacy. A computer program was written using Visual Basic 5 (Microsoft Corp., Seattle, WA) for presenting the questionnaires on the computer touchscreen. The program included storage of the raw scores on an MS Access 2 (Microsoft Corp., Seattle, WA) database and conversion of the scores to scale score for paper printout. Questions were presented on the touchscreen one question at a time using the same instructions as with the paper versions. A bar code reader allowed patients to access the program using bar codes derived from the patient’s name and hospital number. Once the patients had completed the questionnaires, the computer program scored the results automatically, and an immediate printout of aggregated scores was available. Patients were told the purpose of completing the questionnaires was to provide information about the feasibility of introducing routine QOL assessment and that this would contribute toward planning patient-centered care in clinics. No assurance was given to patients about staff using the QOL results, and patients were encouraged to report any concerns or difficulties to the healthcare team as usual.

Study 1: Prospective Cohort Study
Consecutive patients new to the medical oncology outpatient clinics at St James’s University Hospital in Leeds and consecutive cancer patients attending selected oncology (medical oncology, radiation oncology, hematology, gynecology, testis, and colorectal) outpatient clinics at the Western General Hospital in Edinburgh were included. Exclusion criteria were inability to read English, cognitive impairment, and inability to use the touchscreen because of physical or visual disability. Reasons for refusal to participate were noted, if given. Diagnosis, age, and sex of refusing patients were recorded. Signed informed consent was obtained from all patients who agreed to take part. Sociodemographic details were collected from the consenting patients, and clinical details were collected from the medical notes.

In both centers, patients were recruited and followed up for 6 months. At the time of consent, patients were given a bar code that was attached to their appointment card. The patients were instructed how to use the bar code reader and how to complete the questionnaires using the touchscreen, which took up to 5 minutes per patient. This consent-baseline visit was supervised by research staff, and further supervision was not provided at follow-up visits unless requested by the patient. Patients were asked to complete the two questionnaires via the touchscreen every time they attended the outpatient oncology clinic during 6 months unless they visited more frequently than once a week. An immediate printout of the results from each visit was available. However, doctors were free to choose whether to use the QOL results. Later, the results were attached to a QOL mount sheet, designed specifically for QOL reports in the investigations section of the medical notes, by the clinic nursing or clerical staff, according to usual procedures. At visits after the consent visit, the clinic patients were not prompted by the staff to complete the questionnaires; the responsibility was placed entirely on the patient, and no feedback was given concerning use of the QOL results.

Study 2: All-Comers Study
In study 2, all patients attending a nurse-led adjuvant chemotherapy clinic, a medical oncology clinic, and the oncology wards in Leeds, and all outpatients in the Edinburgh clinics and one specific clinic in Airedale General Hospital, were asked to complete the EORTC QLQ-C30 and the HADS at all visits using the touchscreens over a set 3-month period. Because there was no consent procedure, no consideration of eligibility was made before patients entered the study. However, records were kept of patients who would have been ineligible using the same criteria as study 1. In Leeds, patients attending the oncology wards completed the questionnaire on admission to the ward. In the clinics, patients completed the questionnaires via the touchscreen during the patient sign-in procedure in process. In the 3-month period of the study, some patients attended once only and others had a number of appointments, resulting in single and multiple QOL assessments. The new routine clinic procedure was explained by the research officers, a written information sheet was provided, and patients were informed that the new system was being monitored and that their feedback was helpful. Patients were not asked to sign a consent form, but they provided verbal consent and were asked on the opening screen of the touchscreen whether they wanted to continue with the assessment.

Procedures differed somewhat in the participating centers. In Leeds, the system was networked through the hospital network to a printer. In Edinburgh, printing was local to the clinic, and the printout was attached without comment to the case notes before they were taken into the consultation. In Leeds and Airedale, clinic and ward staff were asked to collect the printout in the same way as other results and attach it to the front of the medical notes, and these were to be signed by the medical oncologists as is usual procedure for all test results before filing. An information sheet was given to each clinic member of staff before the study began. Medical professionals attending to the patient had the printout of QOL scores available to them. At the end of each patient consultation, doctors in Leeds and Airedale were asked to complete a short questionnaire on the usefulness of the QOL results for the respective patient. Physicians were asked to indicate whether they used the QOL data, whether they found it clinically useful, and, if yes, in what way (providing information, confirming knowledge, identifying problems, contributing to management, and so on).

Data Analysis
Study 1. Baseline participation was measured as the number of patients completing the QOL assessment on the date of consent divided by the total number of people approached for consent. Patient compliance with routine QOL data collection was calculated by dividing the number of occasions that a QOL assessment was completed, after the consent-baseline visit, by the number of opportunities they had to complete the QOL assessment over the 6-month period of follow-up. Compliance for each visit was similarly calculated; for example, for visit 3, the denominator was the number of patients in the prospective cohort who made three visits (after baseline) and the numerator was the number of patients who provided the data. Evidence of QOL completion was from records on the computer database and from printouts of results in the medical notes. Demographic and psychologic measurements were taken on each patient, including sex, age, marital status, Carstairs index22 (an index measuring social deprivation derived by translating patients’ postal codes into Carstairs scores, expressed as quintiles ranging from 1 = most affluent to 5 = most socially deprived), education level, treatment progression at 3 months after consent, HADS depression, HADS anxiety, EORTC QLQ-C30 functional scales, and QOL. On each visit subsequent to the baseline assessment, patients were categorized as compliant if they completed the touchscreen questionnaires. This gave a longitudinal sequence of binary responses for each patient. The number of visits per patient varied between one and 18, with a median of three visits.

Logistic regression analyses were fitted using generalized estimating equations,23 which related the probability of compliance on each visit to the baseline demographic and psychologic measurements taken on each patient. Sex, marital status, Carstairs index, education, and response to treatment at 3 months were fitted as classification factors, and the other variables were fitted as mean-centered continuous covariates. A term was included for the visit number, with the first visit coded as 0. Where significant differences were found, the continuous covariates were categorized to explore the nature of the differences. The generalized estimating equations analysis extends fixed effects logistic regression analysis24 by estimating a term for the correlation between the compliance on each visit for the same patient, assuming independence of compliance among different patients. The within-patient correlation was assumed to take a first-order autoregressive form, which implies that the results for sequential visits are more highly correlated than for visits further apart.

Study 2. In study 2, at the end of the 3 months, all patient appointments or admissions were counted. The number of QOL assessments completed was recorded. The total number of results filed in the medical notes was checked (Edinburgh excluded). The number and dates of completed questionnaires were recorded from the QOL database. Global participation was calculated as the number of patients completing QOL assessment divided by the total number of patients in each clinic; compliance at each visit had to be derived from the total collected data rather than a selected prospective cohort. Compliance was calculated for each visit by dividing the number of times that a QOL assessment was completed by the number of possible completions at that visit; for example, for visit 3, the denominator was the total number of patients recorded as having attended a third time, and the numerator was the number of QOL assessments completed at a third visit. Descriptive statistics were used to analyze doctors’ views on the clinical usefulness of QOL data for their individual patients.

Studies 1 and 2. Patients were asked about the equipment, the clinic routine, the usefulness of the questionnaires, and their overall attitude toward routine QOL assessment. The number of QOL printouts stored in the medical notes and the number of complete data entries on the computer touchscreen were counted and compared, and each center gave a description of any problems encountered with the system. Patient groups (participants, refusers, and centers) were compared in terms of demographic and clinical variables using the {chi}2 test for categorical variables and the Mann-Whitney U test and the independent samples two-sample Student’s t test (using Levene’s test for equality of variances) for continuous variables. Descriptive statistics were used to express patient attitude, and the {chi}2 test for categorical variables was used to compare computer usage with age. Statistical analysis was performed using the Statistical Package for Social Sciences (SPSS Inc, Chicago, IL) and SAS 8.1 (SAS Institute, Cary, NC).


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 PATIENTS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Study 1 Compliance at Baseline and Over Time
During the study 1 period, 6% of 345 patients who attended the outpatient clinics were not approached because of ineligibility. Among the 324 patients approached, 272 consented and 52 refused. A total of 1,250 patient appointments were attended over the study period by the consenting group, ranging from some patients attending only once to one patient attending 19 times, including the consenting visit. Seven consented and then did not complete an assessment; therefore, 265 patients consented and completed an assessment. A baseline compliance estimate (assessed/approached) was thus 82% (265 assessed of 324 approached) in study 1. The patients who consented were compared with those who refused by age, sex, and disease progression, and no significant differences were found between the two groups. Reasons for refusal were felt too ill (n = 10), could not be bothered (n = 22), felt too distressed (n = 7), did not like computers (n = 4), and other (n = 9).

The majority of patients partially complied; that is, they completed the QOL assessment at some appointments but not at others. There was a large group who did not complete any QOL assessments after the baseline visit and a smaller group who completed the QOL assessment at every visit (Fig 1AGo). The consent-baseline visit is excluded from these data because, for this episode, patients were under direct supervision. The median compliance was 40% and the mean was 43% over all visits.



View larger version (23K):
[in this window]
[in a new window]
 
Fig 1. (A) Percentage of compliance after consent visit in study 1. (B) Percentage of compliance in study 2.

 
Study 2 Compliance at Baseline and Over Time
During the 3 months of study 2, 1,291 patients attended the clinics, some of whom attended more than once, resulting in a total number of patient visits of 1,826. Patients are described in Table 1Go. QOL assessments were completed on 1,271 of the 1,826 patient visits and not completed on 555 patient visits. Among these 555 noncompletions, 333 patients refused, of whom 210 gave a simple refusal ("do not want to" or "can’t be bothered"), 78 were too unwell physically or emotionally, eight were in another QOL trial, seven disliked computers, and 30 stated various other reasons. Forty were felt to be ineligible (most common reasons were "too ill" or unable to speak English). In 100 patients, data were not collected because other aspects of the clinic visit took precedence (called to see staff or have tests). Computers malfunctioned in 22 cases. Global compliance was better in men (P = .043) and younger people (80%, younger than 40 years; 71%, 40 to 60 years; and 64%, older than 60 years).


View this table:
[in this window]
[in a new window]
 
Table 1. Patient Characteristics
 
A substantial proportion of patients complied completely, although unlike in study 1, these included a large number of patients who attended on one occasion only. There were a few patients who partially complied and a significant minority who did not complete the touchscreen questionnaires at all (Fig 1BGo). The overall compliance was greatly increased in comparison to study 1, (mean, 72%; median, 100%) and the distribution was altered.

Fig 1AGo and 1BGoGo show the number of patients (vertical axis) compared with the level of compliance for those patients (horizontal axis). Figure 1AGo describes study 1 but excludes the initial visit, which was supervised; Fig 1BGo describes Study 2. Figure 1BGo shows not only higher compliance but also a higher proportion of patients who were completely compliant and a very small proportion with an intermediate level of (partial) compliance. There remain a residual number of patients who were noncompliant in study 2.

For study 2, overall compliance at two Leeds clinics, one clinic in Airedale Hospital, and the Edinburgh clinics was compared. The difference in clinic compliance was significant (P < .001), with the nurse-led adjuvant chemotherapy clinic at Leeds having the highest compliance, with a mean of 93%, and the other clinics having a mean compliance of 65% to 70%.

Study 1: Factors Predicting Compliance
In study 1, with informed consent, the considerable detail collected allowed us to examine the relationship of compliance to demographic and clinical variables using the approach described above. A complete set of explanatory variables was available in the 214 patients who attended for at least one visit beyond the informed consent visit. Table 2Go shows the explanatory variables and the results of the logistic regression analysis. The number of visits per patient after consent varied between one and 18, with a median of three, giving a total of 891 observations, with visit 1 having the best compliance.


View this table:
[in this window]
[in a new window]
 
Table 2. GEE Logistic Regression: Odds Ratios of Compliance
 
Compliance was better in younger patients, male patients, and patients with less deprivation, as measured by the Carstairs index. There was some evidence to suggest that married and divorced, separated, or widowed patients were more compliant than single persons. Depression, anxiety, and QOL scores were not associated with differences in compliance. None of the functional scales were significantly statistically related to compliance. Education and response to treatment at 3 months were not significantly statistically related to compliance.

Studies 1 and 2 Follow-Up and Compliance Over Time
For both studies, Fig 2AGo and 2BGo show the percentage of QOL assessments completed at each clinic visit in the two studies. Note that the consent-baseline visit is not included in the analysis of study 1, and in that study, we are describing the sequence of unsupervised visits. At almost all visits, the compliance was higher using the all-comers approach of study 2. Using this approach, compliance did not decrease below 60% or deteriorate with time. In the prospective cohort of study 1, compliance decreased quickly to below 40% on the third visit.



View larger version (19K):
[in this window]
[in a new window]
 
Fig 2. Percentage of quality-of-life assessments completed by eligible patients by visit in (A) study 1 and (B) study 2.

 
For this comparison, we have corrected the patient numbers for the ineligible patients identified in study 2. Thus, 1,291 patients (all in the study) made one visit and 27 were ineligible; therefore, the denominator for the first visit is 1,264 patients. The inclusion or exclusion of eligible patients does not alter the conclusions.

Study 1 Patient Feedback
Questionnaires for patients were sent out at the end of the studies to those who had not died or become too ill to complete the forms. One hundred fifty-six questionnaires were sent out, and 109 (70%) were returned. Patients returning the questionnaires were significantly more likely to completely comply, so a selection process in the opinions expressed is likely. Thirty-eight percent of patients who had returned feedback questionnaires had had quite a bit or a lot of experience with computers, and this was age related (P < .001). Most patients had "no problems" with the computing equipment (79%, touchscreen; 75%, bar code reader). Two percent of patients needed "quite a bit" or "a lot of help" with the equipment after the first time, with the others "managing completely on their own" (79%) or needing "a little help" (19%). Typically, "a little help" involved reminding patients how to use the bar code reader or the touchscreen.

Study 2 Patient Feedback
In study 2, 54% of 1,291 questionnaires were returned. Forty-five percent of patients reported no previous experience with computers, and 23% reported only a little experience. However, 94% said they had experienced no problem with the computer touchscreen, and only five of 688 patients who returned their questionnaires reported either "a lot" or "quite a bit" of problems with the computer touchscreen. Ninety-five percent had no problem with the bar code system.

Table 3Go gives a summary of the feedback from both studies. Patients were asked to score their responses on a five-point scale from "definitely yes," "probably yes," "not sure," "probably no," and "definitely no" in each case.


View this table:
[in this window]
[in a new window]
 
Table 3. Summary of Patient Feedback
 
Study 2 Doctors’ Views on the Clinical Usefulness of the QOL Data
The data were collected on an exploratory subsample only for the patients in Leeds and Airedale. Thirteen physicians participated. They completed 315 questionnaires (86%) out of 366 individual consultations during the study period. In 41% of the visits, the doctors used the information (responses "somewhat, quite a bit, or very much"), and in 26% or the visits, they used it only "a little." Similarly, in 42% of the visits, physicians found the QOL data clinically useful ("somewhat, quite a bit, or very much"), and in 21% of the visits, they found it "a little" useful. The QOL data provided additional information in 24% of the visits, confirmed doctors’ knowledge of patient problems in 24% of visits, identified issues for discussion in 14% of visits, and contributed to patient management in only 5% of the consultations.

Study 1 Data Collection Problems
The patients who consented to take part in study 1 attended a total of 1,335 times during the study period. On 679 occasions, there was evidence found from the medical notes (printout) or the computer database that a QOL assessment had been completed, which reflects the poor compliance after the first occasion. In most cases, there was evidence of QOL completion from both sources, but in a small proportion, data were found in the notes only (7.2%) or on the database only (11.2%). The failure to find all of the printouts even when data are collected is likely to reflect widespread incompleteness of results filing in our hospitals. Reasons for the (lower) failure to secure data entry into the database despite initial data capture are varied. In Edinburgh, data were lost from the database when a new program was installed onto the computer hard drive. There were problems in both centers with the computer program being corrupted by people not switching the computers off properly or switching off midprogram. This created error messages, which if not noticed promptly, meant that patients were unable to use the system. This may also have been one of the reasons that data were not stored in the database. In Leeds, there were 8 days when the hospital computer network was not functioning properly. This caused problems with resetting the computers after the network was restored and problems with printouts when the system went down.

Study 2 Data Collection Problems
Data collection and storage were more complete in study 2, reflecting experience gained in study 1. Among all the patients from whom data were collected, 98% (Leeds) and 91% (Edinburgh) had complete data collected and stored in the database.

Study 2: Ward Study
Study 2 included a limited assessment of compliance on the ward. The study of ward compliance was carried out on the medical oncology wards of St James’s University Hospital. The ward has 25 beds and two teams of doctors headed by two and three consultants, respectively, dealing with medical management of a wide range of cancer patients. Patients completed the assessment on one occasion during their admission at, or as close as possible to, the time of admission. There were 140 elective admissions, 86 acute admissions, and 23 nonclassified admissions over the 12-week study period. Global compliance with the computer touchscreen was 43.1%. Among the 140 patients who did not complete the questionnaires, 90 were ineligible, 31 refused, and on 14 occasions other ward processes and procedures were given precedence over the questionnaires; there were computer software errors on five occasions. The majority of ineligible patients were either too physically or emotionally unwell to complete the questionnaires. Therefore, 68% of all eligible patients completed the questionnaires.

Fifty-six percent of ward patients returned their feedback questionnaires. Although the majority did not have any previous experience with computers, none reported significant problems with the computer touchscreen. As with outpatients, an overwhelming majority felt that the questionnaires and touchscreens had not interfered with their hospital stay and had not caused them any worry or distress.


    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 PATIENTS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
The following conclusions can be drawn from the two studies: (1) It is feasible to use the computer touchscreen systems to generate data on a high proportion of large numbers of patients attending oncology clinics and to a lesser degree on wards. (2) An approach that incorporates data collection into routine clinical practice generates better compliance overall and, in particular, better data to describe changes over time than an approach that identifies a separate cohort prospectively. (3) Patients, in general, find the equipment easy to use with few problems, and their feedback is generally positive. (4) Experience and development of hardware and software improves results. Although there is room for further improvement, current completeness of data (study 2) is good.

Because of the differences in study design, direct comparison of compliance between the two studies is difficult. Study 2 represents our best attempt to resemble, as closely as possible, clinic practice; the result that compliance did not decrease below 60% is encouraging. Study 2 also showed robust data collection and data storage systems drawing on the experience gained in the earlier study.

The main reason for noncompliance was simple refusal. More than half of the refusers stated they could not be bothered to complete the assessment, with others feeling too ill or too distressed. Although it was encouraging that depression, anxiety, functional scales, and overall QOL did not predict for poor compliance, compliance was not randomly distributed; it was better in younger and economically advantaged patients. The reasons for refusal and the relation of social deprivation and age to noncompliance are of some concern. It may be that some people with a high level of need would not benefit from introduction of routine QOL assessment because of nonparticipation. It is difficult to determine how further developments in the system will address this problem, but a reason for optimism is found in the literature. In a review of studies that examined the adoption of new innovations in organizations, Rogers25 found that late adopters (or, in our studies, the noncompliers) were more likely to have less education and have lower social status than early adopters. However, the adoption of innovation usually occurs even with the late-adopter group over time. If routine assessment of QOL becomes commonplace in oncology outpatient clinics, some late adopters may gradually accept routine QOL assessment. This is an area that requires further scrutiny and will continue to be assessed in future studies. These automated and systematic methods for improving the care of cancer patients will complement, not replace, standard patient assessment.

Administrative error accounted for 28.6% of nonparticipation, with most patients being missed by the researcher during the clinic visit. This should improve with experience and the organization of this approach in clinics and wards. If only eligible patient visits are examined, the compliance rate increased to a mean of 71%. The nurse-led adjuvant clinic outperformed the other places of data collection, possibly reflecting the way the clinic is run. There are relatively low numbers of patients attending, patients attending tend to be younger and less ill, and patients are in a phase of active therapy.

Establishing the QOL assessment on the ward was more difficult than at the clinics. The global rate of compliance was much lower than at the clinics (43.1%). There seemed to be two main reasons for this: (1) 37% of ward admissions were acute—of these, 73% were ineligible for the study; and (2) because of varied admission times and demands on patient time at admission, it was much harder for the research team to catch the patient at the most opportune moment, resulting in 10% of patients not participating. There was a highly significant difference between the levels of compliance on elective admissions and acute admissions. If we remove the noneligible patient visits, compliance increases to a mean of 67.9%. This compliance rate is steady over ward visits one and two (where numbers were greater than 12).

The change in the distribution of compliance among patients between study 1 (Fig 1AGo) and study 2 (Fig 1BGo) is encouraging and interesting. Study 2, the all-comers approach, increased overall compliance and the proportion of patients who complied all of the time. It substantially reduced the proportion of patients who complied only some of the time (partial compliers). It is possible that improving access and the routine nature of collecting QOL data will encourage and persuade such partial compliers effectively but that there may remain a subgroup of refusers and zero compliers who will not provide this information.

Although the context of these studies is very different from that of a randomized prospective trial, it is interesting to compare the compliance reported in randomized trials. This issue was discussed extensively in a 1998 issue of Statistics in Medicine.26–36 Compliance depends on study design and the approach to data collection, follow-up, and repeated questioning. The best results for compliance over time in randomized prospective trials maintained the completeness of follow-up at more than 80% for some years.26 However, commonly in the routine clinical trials context compliance will decrease below 70% after a year. It is difficult to make a comparison to the present studies, particularly to study 2, where we evaluated an unselected population of patients attending our clinics and there was no prospective informed consent. In the setting of a clinical trial, willingness to enter the study and to complete the QOL questionnaires will be confirmed at the beginning when consent is given. In our clinical practice setting, the group of refusers were counted but would be excluded from a trial by refusing to give informed consent.

Feasibility and compliance are good enough to persevere with the goal of using automated QOL data collection to address some of the clinical challenges we have discussed. In particular, the results in study 2 are sufficiently good to be the basis of a successful program of work in this area. It is likely that compliance, and therefore the utility of these approaches, will improve as the all-comers approach is steadily built into the routine of clinics and, with greater difficulty, wards. This will rely on clinical or nursing staff taking on the task of introducing the assessment to patients, which may influence compliance initially until the system becomes fully integrated into practice. Our feedback suggests that there is no lack of willingness to include QOL assessment in routine practice among staff or patients. Over time, staff members are likely to become more familiar with interpreting QOL results and possibly will make more use of them. This may lead to patients (more than half of whom believed that the QOL results did not contribute to their consultation in study 2) beginning to see changes in the patient-doctor consultation. This should lead to benefits for both staff and patients, possibly leading to increased compliance.

Developments in organization and technology can only be one part of the picture. Formal evaluation is necessary to determine whether patients will benefit from the availability of these additional data to their healthcare professionals. Our preliminary data9,21 and work in lung cancer suggest that there will be improvements in the process of care,18 but final demonstration of improved outcomes must await the results of large randomized prospective trials. We have completed the accrual of patients into such a trial to evaluate the improvements in healthcare that may come from repeatedly measuring QOL in practice and returning these data to healthcare professionals.

The impact of QOL data depends on the commitment, training, and skills of the healthcare professionals to whom the data are presented. This remains a new area, and benefits for patients should increase as experience and training for healthcare cancer professionals in the use of QOL and related data increases. We believe that the collection of QOL data may enhance the interaction between healthcare professionals and patients, usefully screen for psychologic distress and social problems, and contribute to assessment of functional status and physical symptoms. Work is necessary to develop appropriate approaches in each of these areas and test their clinical value.


    ACKNOWLEDGMENTS
 
Carstairs scores were provided by the Office of National Statistics, London, United Kingdom.


    NOTES
 
Supported by a grant from the National Health Services National Research and Development Programme (E.P.W., A.S., and K.W.), Cancer Research UK (G.V., A.C., and P.J.S.), and the National Lotteries Charities Board (G.V.).


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 PATIENTS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
1. Selby P, Chapman JW, Etazadi-Amoli J, et al: The development of a method for assessing the quality of life of cancer patients. Br J Cancer 50:13–22, 1984[Medline]

2. Aaronson NK, Ahmedzai S, Bergamn B, et al: The European Organization for Research and Treatment of Cancer QLQ-C30: A quality of life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 85:365–376, 1993[Abstract/Free Full Text]

3. Osoba D: Lessons learned from measuring health-related quality of life in oncology. J Clin Oncol 12:608–616, 1994[Abstract]

4. Osoba D, Rodrigues G, Myles J, et al: Interpreting the significance of changes in health related quality of life scores. J Clin Oncol 16:139–144, 1998[Abstract/Free Full Text]

5. Ganz P: Quality of life and the patient with cancer individual and policy implications. Cancer 74:1445–1452, 1994[CrossRef][Medline]

6. Detmar SB, Aaronson NK: Quality of life assessment in daily clinical oncology practice: A feasibility study. Eur J Cancer 34:1181–1186, 1998[CrossRef][Medline]

7. Lohr KN: Applications of health status assessment measures in clinical practice: Overview of the third conference on advances in health status assessment. Med Care 30:MS1–MS14, 1992 (suppl)[CrossRef][Medline]

8. Higginson IJ, Carr AJ: Using quality of life measures in the clinical setting. BMJ 322:1297–1300, 2001[Free Full Text]

9. Velikova G, Brown J, Smith A, et al: Computer based quality of life questionnaires may contribute to doctor patient interactions. Br J Cancer 86:51–59, 2002[CrossRef][Medline]

10. Cull A, Stewart M, Altman DG: Assessment of and intervention for psychosocial problems in routine oncology practice. Br J Cancer 72:229–235, 1995[Medline]

11. Ford S, Fallowfield L, Lewis S: Can oncologists detect distress in their out-patients and how satisfied are they with their performance during bad news consultations? Br J Cancer 70:767–770, 1994[Medline]

12. Ramirez AJ: Liaison psychiatry in a breast cancer unit. J R Soc Med 82:15–17, 1989[Abstract]

13. Ibbotson T, Maguire P, Selby P, et al: Screening for anxiety and depression in cancer patients: The effects of disease and treatment. Eur J Cancer 30A:37–40, 1994[CrossRef][Medline]

14. Gilbody S, House A, Sheldon T: Routinely administered questionnaires for depression and anxiety: Systematic review. BMJ 322:406–409, 2001[Abstract/Free Full Text]

15. Sigle J, Porzsolt F: Practical aspects of quality of life measurement: Design and feasibility study of the quality of life recorded and the standardised measurement of quality of life in an outpatient clinic. Cancer Treat Rev 22:75–89, 1996 (suppl A)[Medline]

16. Buxton J, White M, Osoba D: Patients’ experiences using a computerized program with a touch-sensitive video monitor for the assessment of health related quality of life. Qual Life Res 7:513–519, 1998[CrossRef][Medline]

17. Velikova G, Wright EP, Smith AB, et al: Automated collection of quality-of-life data: A comparison of paper and computer touch-screen questionnaires. J Clin Oncol 17:998–1007, 1999[Abstract/Free Full Text]

18. Taenzer P, Bultz BD, Carlson LE, et al: Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients. Psychooncology 9:203–213, 2000[CrossRef][Medline]

19. Cull A, Gould A, House A, et al: Validating automated screening for psychological distress by means of computer touchscreens for use in routine oncology practice. Br J Cancer 85:1842–1849, 2001[CrossRef][Medline]

20. Zigmond AS, Snaith RP: The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand 67:361–370, 1983[Medline]

21. Velikova G, Wright EP, Smith A, et al: Self-reported quality of life (QL) of individual cancer patients: Concordance of results with disease course and medical records. J Clin Oncol 19:2064–2073, 2001[Abstract/Free Full Text]

22. Carstairs V, Morris R: Deprivation and Health in Scotland. Aberdeen, United Kigdom, Aberdeen University Press, 1991

23. Liang KY, Zeger SL: Longitudinal data analysis using generalized linear models. Biometrika 73:13–22, 1986[Abstract/Free Full Text]

24. Nelder JA, Wedderburn RWM: Generalized linear models. J R Stat Soc A 135:370–384, 1972

25. Rogers EM: Innovations and Adopter Categories, in Diffusion of Innovations. New York, NY, The Free Press, 1995, pp 252–280

26. Fallowfield L: Compliance issues in quality of life assessment: Experiences of two Cancer Research Campaign sponsored groups. Stat Med 17:541–546, 1998[CrossRef][Medline]

27. Hahn E, Webster K, Cella D, et al: Missing data in quality of life research in Eastern Cooperative Oncology Group (ECOG) clinical trials: Problems and solutions. Stat Med 17:547–559, 1998[CrossRef][Medline]

28. Kiebert G, Curran D, Aaronson N: Quality of life as an endpoint in EORTC clinical trials. Stat Med 17:561–569, 1998[CrossRef][Medline]

29. Olschewski M: Compliance with QOL assessment in multicentre German breast cancer trials. Stat Med 17:571–575, 1998[CrossRef][Medline]

30. Mosconi P, Torri V, Cifani S, et al: The multicentre assessment of quality of life: The interdisciplinary Group for Cancer Care Evaluation (GIVIO) experience in Italy. Stat Med 17:577–585, 1998[CrossRef][Medline]

31. Bernhard J, Peterson H, Coates A, et al: Quality of life assessment in International Breast Cancer Study Group (IBCSG) trials: Practical issues and factors associated with missing data. Stat Med 17:587–601, 1998[CrossRef][Medline]

32. Bernhard J, Gusset H, Hurny C: Practical issues in quality of life assessment in multicentre trials conducted by the Swiss Group for Clinical Cancer Research. Stat Med 17:633–639, 1998[CrossRef][Medline]

33. Osoba D, Zee B: Completion rates in health related quality of life assessment: Approach of the National Cancer Institute of Canada Clinical Trials Group. Stat Med 17:603–612, 1998[CrossRef][Medline]

34. Kaasa S, Hjermstad MJ, Jordhoy M, et al: Compliance in quality of life data: A Norwegian experience. Stat Med 17:623–632, 1998[CrossRef][Medline]

35. Moinpour C, Lovato L: Ensuring the quality of quality of life data: The Southwest Oncology Group experience. Stat Med 17:641–651, 1998[CrossRef][Medline]

36. Coates A, Gebski V: Quality of life studies of the Australian New Zealand Breast Cancer Trials Group: Approaches to missing data. Stat Med 17:533–540, 1998[CrossRef][Medline]

Submitted November 9, 2001; accepted September 29, 2002.


Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Facebook Facebook   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
JCOHome page
M. E. Mills, L. J. Murray, B. T. Johnston, C. Cardwell, and M. Donnelly
Does a Patient-Held Quality-of-Life Diary Benefit Patients With Inoperable Lung Cancer?
J. Clin. Oncol., January 1, 2009; 27(1): 70 - 77.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
E. Basch, A. Iasonos, A. Barz, A. Culkin, M. G. Kris, D. Artz, P. Fearn, J. Speakman, R. Farquhar, H. I. Scher, et al.
Long-Term Toxicity Monitoring via Electronic Patient-Reported Outcomes in Patients Receiving Chemotherapy
J. Clin. Oncol., December 1, 2007; 25(34): 5374 - 5380.
[Abstract] [Full Text] [PDF]


Home page
Mayo Clin Proc.Home page
M. H. Frost, A. E. Bonomi, J. C. Cappelleri, H. J. Schunemann, T. J. Moynihan, N. K. Aaronson, and Clinical Significance Consensus Meeting Group
Applying Quality-of-Life Data Formally and Systematically Into Clinical Practice
Mayo Clin. Proc., October 1, 2007; 82(10): 1214 - 1228.
[Abstract] [Full Text] [PDF]


Home page
Mayo Clin Proc.Home page
E. A. Hahn, D. Cella, O. Chassany, D. L. Fairclough, G. Y. Wong, R. D. Hays, and Clinical Significance Consensus Meeting Group
Precision of Health-Related Quality-of-Life Data Compared With Other Clinical Measures
Mayo Clin. Proc., October 1, 2007; 82(10): 1244 - 1254.
[Abstract] [Full Text] [PDF]


Home page
ChestHome page
J. P. Griffin, K. A. Koch, J. E. Nelson, and M. E. Cooley
Palliative Care Consultation, Quality-of-Life Measurements, and Bereavement for End-of-Life Care in Patients With Lung Cancer: ACCP Evidence-Based Clinical Practice Guidelines (2nd Edition)
Chest, September 1, 2007; 132(3_suppl): 404S - 422S.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
B. F. Eichhorst, R. Busch, T. Obwandner, I. Kuhn-Hallek, P. Herschbach, and M. Hallek
Health-Related Quality of Life in Younger Patients With Chronic Lymphocytic Leukemia Treated With Fludarabine Plus Cyclophosphamide or Fludarabine Alone for First-Line Therapy: A Study by the German CLL Study Group
J. Clin. Oncol., May 1, 2007; 25(13): 1722 - 1731.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
E. Basch, D. Artz, D. Dulko, K. Scher, P. Sabbatini, M. Hensley, N. Mitra, J. Speakman, M. McCabe, and D. Schrag
Patient Online Self-Reporting of Toxicity Symptoms During Chemotherapy
J. Clin. Oncol., May 20, 2005; 23(15): 3552 - 3561.
[Abstract] [Full Text] [PDF]


Home page
J Natl Cancer Inst MonogrHome page
M. S. Donaldson
Taking Stock of Health-Related Quality-of-Life Measurement in Oncology Practice in the United States
J Natl Cancer Inst Monographs, October 1, 2004; 2004(33): 155 - 167.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Purchase Article
Right arrow View Shopping Cart
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a colleague
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Save to my personal folders
Right arrow Download to citation manager
Right arrowRights & Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Wright, E.P.
Right arrow Articles by Cull, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Wright, E.P.
Right arrow Articles by Cull, A.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Facebook   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

About
JCO
 Editorial
Roster
 Advertising
Information
 Librarians &
Institutions
 Rights &
Permissions
 PDA Services

Copyright © 2003 by the American Society of Clinical Oncology, Online ISSN: 1527-7755. Print ISSN: 0732-183X
Terms and Conditions of Use
  HighWire Press HighWire Press™ assists in the publication of JCO Online