Content validation of the EORTC QLQ-C15-PAL with advanced cancer patients and health care professionals from palliative care services in Chile

Abstract

Background

The assessment of patients’ quality of life (QOL) is essential when evaluating the outcome of palliative care; however, no instruments have been validated for measuring symptoms and QOL in patients receiving palliative care in Chile. We aimed to investigate the content validity of the EORTC Quality of Life Questionnaire Core 15 Palliative Care (QLQ-C15-PAL), replicating the methods used previously to shorten the EORTC Quality of Life Questionnaire Core 30 (QLQ-C30) for use among patients in palliative care.

Methods

This cross-sectional study was conducted from October to November 2017 in four palliative care services. Patients with advanced cancer and health care professionals (HCPs) were invited to individual interviews to determine the relevance, appropriateness and relative importance of the 30 items of the QLQ-C30 for evaluating the outcome of palliative care, and whether relevant additional issues should be included.

Results

A total of 48 patients and 35 HCPs participated. The most important dimensions selected were pain, physical functioning, sleeping difficulties, emotional functioning, nausea/vomiting, fatigue, social functioning, lack of appetite, role functioning and constipation. Qualitative data identified important additional issues not covered by the questionnaire such as satisfaction with care, emotions and psychological support, as well as linguistic issues in the dyspnea and constipation items.

Conclusions

The EORTC QLQ-C15-PAL showed good content validity in the assessment of symptoms and QOL of advanced cancer patients; therefore, we recommend the use of this questionnaire in palliative care in Chile. Dyspnea and constipation items were revised by the EORTC group. More research is needed to add a social dimension for a comprehensive assessment of patients’ QOL.

Background

Palliative care aims to improve the quality of life (QOL) of patients through the early detection and treatment of their symptoms [1]. Thus, the assessment of patients’ QOL is essential when evaluating the outcome of palliative care. Nevertheless, assessment of QOL may be difficult in patients with advanced cancer due to the number and severity of symptoms they experience. To reduce the burden on patients, patient-reported outcomes (PROs) instruments in palliative care should be brief, cover the main symptoms and problems, and at the same time avoid content of limited relevance.

The European Organization for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire Core 15 Palliative Care (QLQ-C15-PAL) is an abbreviated 15-item version of the EORTC Quality of Life Questionnaire Core 30 (QLQ-C30), which is one of the most widely used, validated, translated and published instruments for assessing symptoms and QOL in cancer patients [2]. The QLQ-C15-PAL contains the items of the QLQ-C30 which were identified as the most important for palliative care, based on interviews with health care professionals and patients [3], and on statistical analyses using item response theory [4, 5]. This development process secures that studies may compare their results obtained from the QLQ C15-PAL with studies using the original QLQ-C30 questionnaire [3]. In addition, the QLQ-C15-PAL has been successfully validated and translated in several countries [6,7,8,9,10,11,12,13,14], including Spanish-speaking countries [15, 16].

The Chilean-Spanish version of the QLQ-C30 and some modules have been validated before [17, 18]. A few studies have used the QLQ-C30 to evaluate patients’ QOL in oncology research [19,20,21,22], but no instruments have been validated for measuring symptoms and QOL in patients receiving palliative care in Chile. When the QLQ-C15-PAL was developed, its content validity was evaluated by health care professionals and patients from six European countries [3]. However, because of differences between these European countries and Chile in their health care systems, including how palliative care is organized, and the availability of palliative care services, it would be relevant to investigate the content validity of the QLQ-C15-PAL in Chilean population. In Chile most palliative care services are in the public health care system, but some services are fully private. Although Chile has the highest number of palliative care services in Latin America [23], Chile still has a fewer number of palliative services compared to the Western European countries. In 2013, the ratio of services to the population in Chile was 1: 808,000, which is lower compared to the six European countries with a ratio of services to the population between 1: 48,000 (in the United Kingdom), and 1: 122,000 (in Denmark) [24]. Therefore, we aimed to investigate the content validity of the QLQ-C15-PAL questionnaire with patients and health care professionals from palliative care services in Chile, replicating the methods used previously to shorten the items of the QLQ-C30 among European patients in palliative care [3].

Methods

Patients and health care professionals

This cross-sectional study was conducted from October to November 2017 with participants from the palliative care services of four public hospitals in Santiago in Chile. We planned to recruit at least 10 patients and 10 heath care professionals (HCPs) from each palliative care service.

Outpatients with advanced cancer undergoing palliative care treatment, with knowledge of their diagnosis, and who had given informed consent were eligible. Patients who were too ill to participate in interviews, and non-native Spanish speakers were excluded. HCPs with their main job in palliative care were eligible. For patients, the primary cancer site was registered, occupation and years of experience were registered for HCPs, and demographic characteristics were collected for all participants.

Questionnaires

The Chilean-Spanish version of the QLQ-C30 questionnaire (version 3) was used for this study, and was obtained from the EORTC Quality of Life Department in Brussels. The QLQ-C30 consists of 30 items distributed in five functional scales measuring physical, emotional, role, cognitive and social functioning; three symptoms scales measuring fatigue, pain, nausea/vomiting; one scale measuring “global health and quality of life status”, and six single items measuring sleeping difficulties, dyspnea, constipation, lack of appetite, financial difficulties, and diarrhea. All items are rated on 4-points Likert scales that range from 1 (not at all) to 4 (very much), with the exception of the global health/quality of life scale, which is rated from 1 (very poor) to 7 (excellent) [25, 26].

The QLQ-C15-PAL is an abbreviated version of the QLQ-C30, which was developed for patients in palliative care preserving the main advantages of the original questionnaire. The QLQ-C30 was shortened to 15 items by omitting items of the QLQ-C30 that were considered inappropriate or not highly relevant in palliative care by patients and health care professionals in interviews, [3] and by shortening multi-item scales of QLQ-C30 using item response theory [4, 5]. Four scales, i.e., physical functioning, emotional functioning, nausea/vomiting and fatigue, were shortened retaining the items that best predicted scores on the original scales. Due to the low relevance reported in the interviews, the two-item global QOL scale was reduced to one item by omitting overall health, and five scales/items were completely omitted (social, role and cognitive functioning scales, diarrhea and financial difficulties items).

Procedure for interviews

To validate the content of the QLQ-C15-PAL questionnaire, we conducted semi-structured interviews following the procedure originally used to develop a shortened version of the QLQ-C30 for palliative care patients [3], and the EORTC Quality of Life Group Guidelines for developing questionnaire modules [27]. The purpose of these interviews was to identify the most relevant issues for patients in palliative care among those included in the EORTC QLQ-C30 in order to investigate whether the QLQ-C15-PAL also has the appropriate content for use in Chile.

Patients were asked to respond to the Chilean-Spanish version of the QLQ-C30 during individual interviews by a trained researcher. The interviewer then invited patients to comment on how well the QLQ-C30 items “evaluated the outcome of the palliative care they received”. Patients were asked to comment on the QLQ-C30 items in terms of relevance, appropriateness, relative importance, and breadth of coverage. The relevance of each item was rated using the response categories 1 “not at all”, 2 “a little”, 3 “quite a bit” and 4 “very much”. If an item was rated 1 or 2, patients were asked to report the reasons, e.g., “Why do you consider this question not or only a little relevant?”. The appropriateness was measured asking patients to identify items they perceived as inappropriate or upsetting. The relative importance was evaluated asking patients to select the 10 most important items when evaluating the success of palliative care. The breadth of coverage was assessed asking patients to report additional issues that were relevant for them but not covered by the QLQ-C30.

An identical interview was followed for HCPs, but they were required to comment on how well the QLQ-C30 items “evaluated the outcome of palliative care in general”, i.e., not for a specific patient, but for patients admitted to palliative care in general. HCPs were asked to comment on relevance, appropriateness, relative importance, and breadth of coverage of the QLQ-C30 items, using the same procedure as described above.

Statistical analysis

Participants’ characteristics were expressed as proportions for categorical variables, and as means, standard deviations, medians and ranges for continuous variables. The mean relevance score of each item was calculated after transforming the responses to 0–100 scales with 0 corresponding to “not at all” and 100 to “very much” [26]. The proportion of participants rating each item as “inappropriate or upsetting” and selecting each item as one of the 10 most important were calculated. The proportion of participants who selected at least one of the items from each multi-item scale as one of the 10 most important was also calculated. Single items and multi-item scales were ranked according to the proportion of patients and HCPs selecting them as among the 10 most important. This ranking named ‘importance percentage’ was calculated as the average: (percentage of patients + percentage of HCPs)/2; although the sample of patients was larger than HCP sample, both received equal weight. Furthermore, this ranking was used to compare the relative importance of the scales and items as perceived by Chilean patients/HCPs with the results of the original study [3]. HCPs were divided in two subgroups, i.e., “physicians” and “other HCPs” to explore differences between the rating of relevance and importance for each dimension of the QLQ-C30, tested by Mann-Whitney U Test. Qualitative data obtained from the interviews were categorized into responses about the lack of relevance in selected items, and the need to include other issues in the questionnaire, respectively. A p value < 0.05 was considered statistically significant. Analyses were performed using the statistical software Statistical Package for the Social Sciences (SPSS) version 23.

Results

Participation

A total of 48 patients with advanced cancer and 35 HCPs participated in the interviews. The median age of patients was 60 years, and the most common cancer diagnoses were prostate cancer (14.6%), stomach cancer (10.4%) and multiple myeloma (10.4%). HCPs had a median age of 39 years and the majority were physicians (34.3%), followed by nurses (20.0%), and psychologists (20.0%). For further details see Table 1.

Table 1 Characteristics of 48 patients and 35 health care professionals participating in interviews

Interviews

Relevance, appropriateness and relative importance of the EORTC QLQ-C30

The quantitative data including ratings of relevance, inappropriateness, and relative importance of items are summarized in Table 2, together with the qualitative data from categorized responses to the question: “Why do you consider this question not or only little relevant?” presented in Table 3, will be discussed simultaneously for each dimension of the QLQ-C30 questionnaire. Scales and items are presented in the order in which they appear in Tables 2 and 3, i.e., based on their importance rating, where the 10 most important were pain, physical functioning, sleeping difficulties, emotional functioning, nausea/vomiting, fatigue, social functioning, lack of appetite, role functioning and constipation.

Table 2 Relevance, inappropriateness and importance of items reported by 48 patients and 35 health care professionals

Table 3 Categorized reasons why some items were rated as little or not relevant by the participants

Pain (PA) scale

Pain was selected as the most important dimension of the QLQ-C30 and both items were rated as highly relevant.

Physical functioning (PF) scale

The last item 5 “need help with self-care” was rated as the most important item of the scale, followed by item 4 “stay in bed”. Items 2 “long walk” and 3 “short walk” were rated as less relevant by the respondents, who mentioned that these questions regarding to walking limitations were not appropriate for patients in palliative care. Item 1 “strenuous activities” was the item most often rated as inappropriate by HCPs (9%).

Sleeping difficulties (SL) item

Sleeping difficulties was rated as very relevant and chosen as one of the most important dimensions by 80% of participants.

Emotional functioning (EF) scale

The four items of this scale were rated more relevant by patients than by HCPs; however, 83% of HCPs compared to 73% of patients selected this scale as one of the 10 most important for palliative care. Item 24 “feel depressed” was most often selected as important particularly by HCPs. Nine participants indicated that item 23 “feel irritable” was poorly formulated, e.g., the word “irritable” could be replaced by “angry” (Table 3).

Nausea and vomiting (NV) scale

Nausea and vomiting were rated as highly relevant by respondents and selected as two important items by 69% of the HCPs.

Fatigue (FA) scale

More than a half of the patients selected fatigue as an important dimension (77%) in comparison with the HCPs (34%). Item 12 “feel weak” was the least important item selected by HCPs, mainly because they believed that this symptom was repeatedly measured. HCPs found that item 10 “need to rest” was the least important and less relevant of the scale.

Social functioning (SF) scale

Social functioning scale was selected as an important dimension by 49% of the participants. Both items, item 26 “your physical condition or medical treatment has interfered with your family life” and item 27 “your physical condition or medical treatment has interfered with your social activities” were scored with high relevance, especially item 26.

Lack of appetite (LA) item

Lack of appetite was more selected as an important item by HCPs than by patients (57% vs. 35%).

Role functioning (RF) scale

Role functioning scale was very important for patients (60%), scoring with a high relevance the item 6 “limitations at work or daily activities”.

Constipation (CO) item

Constipation was considered by 42% of the respondents as an important item, and about 20% (n = 17) of them suggested linguistic changes for this question because it was difficult to understand by patients (See also Table 4).

Table 4 Categorized comments about linguistic issues found in the dyspnea and constipation items of EORTC QLQ-C30

Financial difficulties (FI) item

This item was chosen as one of the most important by 49% of the HCPs compared to 35% of the patients. Few participants described this item as inappropriate for palliative care setting.

Global health status/ quality of life (QOL) scale

Participants rate both items as highly relevant. This dimension was selected as one of the most important more often by the HCPs than by patients (54% vs. 23%), although some respondents reported that item 30 as little relevant because they believed the concept “quality of life” is not understood by all patients in palliative care.

Dyspnea (DY) item

Similar numbers of patients and HCPs reported that dyspnea was a not well formulated item making it difficult for patients to comprehend, whereas 33% of participants (n = 27) suggested linguistic changes for dyspnea (Table 4).

Cognitive functioning (CF) scale

Cognitive functioning was generally regarded as less important than the other five functioning scales, selected only by 25% of respondents. Item 20 “concentrating problems” was the least relevant item in this scale.

Diarrhea (DI) item

Although rated as relevant, diarrhea was the issue least often selected as important.

The comparison of item relevance and importance scores between physicians (n = 12) and other HCPs (n = 23) showed no significant differences; therefore, they are not shown in Table 2.

Breadth of coverage of the EORTC QLQ-C30

Patients and HCPs were asked to report additional issues that were not included in the QLQ-C30, which they considered relevant for the outcome of the palliative care. In total, 91 topics were mentioned by the respondents. These were grouped into 10 overalls categories. The three most frequent categories were satisfaction with care, emotions and psychological support. Satisfaction with care included topics about satisfaction of patients with HCPs, and effectiveness of medication, mostly reported by patients. Emotions included topics about role loss and mood changes, and psychological support included phycological needs, and facing life with advanced cancer. For further details see Table 5.

Table 5 Additional issues that would be relevant to include when evaluating the outcome of palliative care

Discussion

In this study, we performed a content validation of the QLQ-C15-PAL with 48 patients and 35 HCPs from four palliative care services in Chile, replicating the methodology of a previous study conducted in six European countries [3]. In general, our results were similar to that study, confirming the content validity of the QLQ-C15-PAL questionnaire, but we made important observations that will be discussed later.

Of the 10 function/symptom scales included in the QLQ-C15-PAL questionnaire, eight were selected among the 10 most important dimensions to include in the assessment of palliative care in Chile, i.e., pain, physical functioning, sleeping difficulties, emotional functioning, nausea/vomiting, fatigue, lack of appetite and constipation. Responses about the five shortened scales from the original QLQ-C30 to form the QLQ-C15-PAL were comparable to the Groenvold et al. study [3]. Physical functioning and fatigue scales were particularly important scales by patients, whereas emotional functioning, nausea/vomiting and global health status/QOL scales were essential for HCPs. Most of the items of these scales that were finally retained in the QLQ-C15-PAL, were also selected by our respondents as relevant issues to measure the outcome of palliative care.

The most important dimension selected by the participants was pain (96%), which has been recognized in the literature as one of the most prevalent symptoms reported by advanced cancer patients in palliative care [28, 29]. Other dimensions frequently selected as important were physical functioning (89%), sleeping difficulties (80%), emotional functioning (78%), nausea/vomiting (57%), fatigue (56%) and social functioning (49%). These dimensions were previously identified as prevalent palliative needs in a study investigating the content validity of PROs instruments in palliative care, by comparing patient reported symptoms and problems to what was registered in the medical records [30]. Although social and role functioning were excluded in the development of the QLQ-C15-PAL due to the lack relevance reported in the original study [3], in our study these dimensions were selected as the most important by 49 and 43% of respondents respectively, principally HCPs selected social functioning in relation to family life of patients, and patients selected role functioning in relation to their limitations at work. Patients’ concern about their role in the family, the social support they received from family, and personal challenges related to work have been reported before by a palliative care service in a small qualitative study conducted in Chile [31].

Qualitative data corresponding to additional issues not covered by the questionnaire showed that HCPs reported twice as many topics as patients did. A reason may be that HCPs have the perspective of many patients while patients focus on their own situation. Further, the breadth of coverage question was asked at the end of the interview, hence, some patients may have been too fatigued to give comprehensive responses. The main additional issues reported in our study were satisfaction with care, emotions and psychological support. In contrast, additional issues related with existential and spiritual issues were frequently reported by Groenvold et al. [3]. Further research is needed to evaluate which aspects not covered by the QLQ-C15-PAL may be relevant for a comprehensive measurement of the QOL in Chilean palliative care patients, e.g., a social dimension. While social support for patients in palliative care and their families has been recommended by the Chilean Ministry of Health [32], as well as international organizations [1, 33], social needs do not seem to be covered by current palliative care in Chile, as only one of the four palliative care services in this study had a social worker in their teams.

The qualitative data was useful to identify unexpected linguistics issues in the dyspnea and constipation items, since 33 and 20% of the participants reported that these questions were not well formulated or were difficult to understand. A list with the comments about these two items was submitted to the Translation Unit of the EORTC Quality of Life Department for possible revision of the translation of these items. After their analysis both items were modified in the Chilean versions of the QLQ-C30, and the QLQ-C15-PAL questionnaires.

We recognize some limitations related to this study. First, we did not evaluate statistically the psychometric properties of the QLQ-C15-PAL in Chilean patients; however, it has been extensively validated in previous international studies [6,7,8,9,10,11,12,13]. Second, we planned to recruit at least 10 HCPs from each palliative care service, but half of the services investigated had less than 10 professionals in their teams. Nevertheless, we had no missing data for the study analysis, since the participants were accompanied by the researcher during their self-assessment of the QLQ-C30 or were assisted if necessary.

Conclusions

The EORTC QLQ-C15-PAL showed good content validity in the assessment of symptoms and QOL of advanced cancer patients. Additionally, we identified linguistic issues in the dyspnea and constipation items that were revised by the EORTC group. This questionnaire may help clinicians, and researchers to initiate palliative care interventions that may improve QOL of patients. Therefore, we recommend the use of the EORTC QLQ-C15-PAL in patients receiving palliative care in Chile. More research is needed to add a social dimension for a comprehensive assessment of patients’ QOL in Chile.