Advertisement
Original Article| Volume 63, ISSUE 4, P457-467, April 2022

What is a Good Death? A Choice Experiment on Care Indicators for Patients at End of Life

Open AccessPublished:November 14, 2021DOI:https://doi.org/10.1016/j.jpainsymman.2021.11.005

      Abstract

      Context

      Health systems should aim to deliver on what matters most to patients. With respect to end of life (EOL) care, knowledge on patient preferences for care is currently lacking.

      Objectives

      To quantify preference weights for key EOL care indicators.

      Methods

      We developed a discrete choice experiment survey with 13 key indicators related to patients’ experience in the last six weeks of life. We fielded the survey to a web-panel of caregiver proxies for recently deceased care recipients. We obtained 250 responses in each of five countries: India, Singapore, Kenya, the UK and the US. Latent-class analysis was used to evaluate preference weights for each indicator within and across countries.

      Results

      A 2-class latent-class model was the best fit. Class 1 (average class probability = 64.7%) preference weights were logically ordered and highly significant, while Class 2 estimates were generally disordered, suggesting poor data quality. Class 1 results indicated health care providers’ ability to control patients' pain to desired levels was most important (11.5%, 95% CI: 10.3%–12.6%), followed by clean, safe, and comfortable facilities (10.0%, 95% CI: 9.0%–11.0%); and kind and sympathetic health care providers (9.8%, 95% CI: 8.8%–10.9%). Providers’ support for nonmedical concerns had the lowest preference weight (4.4%, 95% CI: 3.6%–5.3%). Differences in preference weights across countries were not statistically significant.

      Conclusion

      Results reveal that not all aspects of EOL care are equally valued. Not accounting for these differences would lead to inappropriate conclusions on how best to improve EOL care.

      Key Words

      Key message

      This study provides information on what family caregivers of terminally-ill patients see as most important for delivering high quality EOL care and provides a framework for future efforts that aim to take a preference-based approach to quantify health system performance at the micro (e.g., facility) or macro (e.g., country) level.

      Introduction

      A common business truism is that “you can't improve what you don't measure.” Yet, despite extensive work to measure the quality of curative treatments within and across countries, few efforts have focused on systematically measuring how well health systems deliver end-of-life (EOL) care. The few efforts that have been attempted largely applied a Donabedian framework.
      • Donabedian A.
      Evaluating the quality of medical care.
      This framework focuses on measuring structural indicators (e.g., financial resources, personnel, equipment) that are presumed to be correlated with a good EOL experience.
      • Stjernswärd J
      • Foley KM
      • Ferris FD
      The public health strategy for palliative care.
      The underlying assumption is that meeting these indicators implies a better EOL experience.
      Two prior efforts by the Economist Intelligence Unit relied on this approach to produce a Quality of Death Index, or ranking, across countries.

      The economist intelligence unit and commissioned by lien foundation. The quality of death. Ranking end-of-life care across the world. 2010. Available at: http://www.lienfoundation.org/sites/default/files/qod_index_2.pdf. Accessed July 9, 2021.

      ,

      The economist intelligence unit and commissioned by lien foundation, the 2015 quality of death index: ranking palliative care across the world. 2015. 15.

      The rankings relied on various inputs, including whether or not a country had a national strategy for palliative care, availability of opioids and psychological supports, and many indicators on staffing ratios, clinical training opportunities, and other dimensions of access and quality of care, such as the presence of Do Not Resuscitate policies and patient satisfaction surveys. However, meeting these metrics does not necessarily translate to high quality care in the areas that most matter to patients or their family caregivers, where the latter often serve as surrogate decision-makers during the EOL period. In fact, prior efforts to quantify the quality of EOL care have largely ignored patient and caregiver preferences altogether.
      High-functioning health systems should aim to deliver on what matters most to patients, which requires understanding patient preferences. For curative treatment, arguably the most important indicators of health system performance are minimizing disability and premature mortality, followed by cost and equity concerns. For dying patients and their family caregivers, there are many other considerations.
      • Steinhauser KE
      • Clipp EC
      • McNeilly M
      • Christakis NA
      • McIntyre LM
      In search of a good death: Observations of patients, families, and providers.
      For example, dying at place of choice or having access to friends and family have been shown to matter more than marginal increases in life extension or even pain management.
      • Finkelstein E.A.
      • Bilger M
      • Flynn TN
      • Malhotra C
      Preferences for end-of-life care among community-dwelling older adults and patients with advanced cancer: a discrete choice experiment.
      Many quality indicators and patient reported outcome instruments have been developed to assess various dimensions of EOL care, however, few have attempted to quantify the relative importance that patients place across these dimensions.
      • Steinhauser KE
      • Christakis NA
      • Clipp EC
      • McNeilly M
      • McIntyre L
      Factors considered important at the end of life by patients, family, physicians, and other care providers.
      ,
      • Lankarani-Fard A
      • Knapp H
      • Lorenz KA
      • Golden JF
      • Taylor A
      Feasibility of discussing end-of-life care goals with inpatients using a structured, conversational approach: the go wish card game.
      The goal of this study is to complement the existing literature by quantifying preference weights that represent the relative value that patients place on key EOL care indicators using a discrete choice experiment (DCE) survey. DCE is a well-established method to assess preferences for health outcomes and other nonmarket goods. Using this approach, our results provide information on what family caregivers of EOL patients see as most important for delivering high quality EOL care and provide a framework for future efforts to take preference-based approaches to quantify health system performance at the micro (e.g., facility) or macro (e.g., region or country) level.

      Methods

      Study Setting and Participants

      Recruitment took place simultaneously among web-panels in five countries from April 16 to April 28, 2021. We aimed to have variation in geographic region and income across countries but for convenience limited the study to the following English speaking countries: India, Kenya, Singapore, United Kingdom and United States. To be eligible for the survey, web panelists from these countries had to 1) be at least 21 years of age, 2) be able to understand English, 3) have lost a family member or close friend after a brief or extended period of illness or injury within the past two years, 4) have been involved in either discussions with health care providers concerning the patient's choice of treatments, helping the patient receive medical care (e.g., accompanying the patient to doctor's visits), or looking after the patient's day to day well-being. Existing panel members meeting these criteria were provided with details regarding the objective of the study, what is expected of them during the survey, privacy and confidentiality of research records, and given the option to participate.
      While there is no formal power calculation for DCEs, a sample size can be approximated following Orme (2010).
      • Orme B.
      Getting started with conjoint analysis: Strategies for product design and pricing research second edition.
      Based on this approach, the minimum sample size for our models would be about 83 respondents per country. To ensure adequate power, the survey was administered on-line to 250 panel participants in each of the five countries. We applied soft quotas to ensure obtaining at least 10% of respondents above age 65 and at least 30% female. All activities were reviewed and approved by the National University of Singapore Institutional Review Board (protocol reference code: NUS-IRB-2020-203).

      Survey Development

      Building on a recently published scoping review that identifies core domains and sub-domains of EOL care,

      Bhadelia A, Oldfield LE, Cruz JL, Singh R, Finkelstein EA. Identifying the core domains to assess heath system performance on the’ quality of death: a scoping review. 2021 Working paper.

      we developed a candidate list of EOL care indicators. These indicators were refined with the help of palliative-care experts. A final set of 13 indicators was used to developed a series of questions that captured quality of care delivery across relevant domains. Each indicator had five levels, ranging from strongly disagree to strongly agree (Table 1). Detailed explanations for each indicator are shown in Appendix A.
      Table 1Indicators
      No.Indicators of Patients’ EOL Experience Over Last 6 weeks of Life
      1Clear and timely information

      Health care providers gave patients clear and timely information so patient could make informed decisions
      2Treated kindly

      Health care providers treated patients kindly and sympathetically
      3Spiritual needs

      Health care providers supported patients’ spiritual, religious, and/or cultural needs
      4Contact with family

      Health care providers allowed patients to contact their friends and family
      5Asked enough questions

      Health care providers asked enough questions to understand patients’ needs
      6Quality of life extending treatments

      Health care providers provided appropriate level & quality of life-extending treatments
      7Managed pain and discomfort

      Health care providers controlled pain and discomfort as well as the patient wanted
      8Cope emotionally

      Health care providers gave patients support to help them cope emotionally
      9Clean and safe space

      The centre was clean, safe, and comfortable.
      10Care was well coordinated

      Health care providers provided care that was well coordinated.
      11Nonmedical concerns

      Health care providers helped with patients’ nonmedical concerns
      12Preferred place of death

      Health care providers made sure that patients were cared for and died at their place of choice.
      13Costs were not a barrier

      Costs were not a barrier to getting appropriate care.
      The questions evaluated key aspects of the patient experience during the last six weeks of life. Six weeks is a relatively short period of time which reduces the likelihood that respondents had to consider markedly different experiences across providers as they answered the questions.
      A DCE was created to measure the importance of each indicator relative to others and of improvements within indicators. Respondents were asked to suppose they were in the situation their loved one was in before dying and to consider what they would have preferred under such circumstances. In each DCE question, respondents had to consider a set of three hypothetical healthcare provider groups. These groups were rated by other caregivers using a 5-star system, with 1 star corresponding to strongly disagree, 3 stars to neutral and 5 stars to strongly agree (Fig. 1). Finally, respondents were asked to choose one among these provider groups based on the ratings provided.
      Fig 1
      Fig. 1Example choice task as it was shown to respondents.
      Country-specific versions of the survey instrument were tested during 40 individual interviews with a convenience sample of caregivers in all participating countries, including six in India, eight in Kenya, seven in Singapore, five in the United Kingdom, and 14 in the United States. The interviews were conducted individually through videoconferencing and followed a semistructured think-aloud protocol. Upon completion of the interviews, country-specific surveys were finalized. The surveys included questions about the respondents’ demographics, the demographics of the patient they cared for, context of the patients’ death and a rating of their own experience caring for the patient, in addition to the DCE questions. A final version of the US survey is included in Appendix B.

      Statistical Analyses

      Data from the DCE were evaluated based on commonly used internal-validity measures.
      • Johnson F.R.
      • Yang J.C.
      • Reed S.D.
      The internal validity of discrete choice experiment data: a testing tool for quantitative assessments.
      Respondents’ choices were analyzed using latent-class logit analysis (LCA) with the number of classes determined using Bayesian Information Criterion.
      • Hauber A.B.
      • González JM
      • Groothuis-Oudshoorn CG
      • Prior T
      • Marshall DA
      Statistical methods for the analysis of discrete choice experiments: a report of the ISPOR conjoint analysis good research practices task force.
      We evaluated the extent to which classes were meaningful and the overall model parsimonious. Respondent covariates were included to help explain changes in the probability of class membership. Categorical variables (dummy-coded) indicating the respondent country of origin (coded relative to the United States), indicators of patient/caregiver characteristics and beliefs, information on individual data quality (i.e., incorrect responses to comprehension questions, and missed validity checks), caregiver and patient characteristics, and indicators of internal validity were considered as predictors of class-membership probability. Covariates which were found to be statistically significant predictors of class membership (P < 0.05) were retained in the final model.
      After identifying a respondent class that was highly correlated with poor data-quality signals, we calculated respondent's probability of being assigned to that class. We used the complement to this probability (1 minus the probability of assignment to class with poor data quality) as sampling weights in separate country-specific models using a random-parameters logit (n = 250 per country). This meant that respondents who were more likely to be included in the problematic class (i.e., those whose responses were more suspect) would be given a lower weight in the country-specific mean preference estimates.
      Preference weights for each indicator and the corresponding 95% confidence intervals were calculated assuming profile-based normalization of the preference results for each country.
      • Gonzalez J.M.
      A guide to measuring and interpreting attribute importance.
      Weights were rescaled such that the sum of the weights across indicators totaled 100%. More details on the pretest interviews, experimental design, and analysis of the DCE data can be found in Appendix C.
      • Bose R.C.
      On the construction of balanced incomplete block designs.
      • Kuhfeld W.F.
      Marketing research methods in SAS: experimental design, choice, conjoint, and graphical techniques.
      • Kuhfeld WF
      • Tobias RD
      • MJJo MR Garratt

      Results

      Sample Characteristics

      A total of 10,918 electronic invites were sent out to the web panelists to reach our sample of 250 respondents per country. We were unable to determine a unique response rate because many of the individuals invited to participate are likely not eligible; privacy concerns did not allow for obtaining eligibility information from non-respondents. Table 2 summarizes characteristics of caregiver respondents and their care recipients. Almost half of the sample was female (47.4%). On average, caregivers responding to the survey were 42.9 years of age (SD = 15.3). Mean age of caregivers was lower in low-income countries (India and Kenya) relative to high-income countries (Singapore, UK and US). Close to half of respondents had a bachelor's degree or higher level of education in India (49.2%) and the US (53.6%), but less than a fifth had similar levels of education in Singapore (19.2%), Kenya (18.4%) and the UK (13.6%). In every country, the vast majority of caregivers were at least somewhat involved in helping their loved one get medical care and looking after day-to-day needs, but less than a fifth was involved in talking with doctors about treatment decisions.
      Table 2Summary of Patient and Caregiver Characteristics
      Mean (SD) / n (%)
      A. Caregiver characteristicsOverallIndiaKenyaSingaporeUKUSA
      (n = 1250)(n = 250)(n = 250)(n = 250)(n = 250)(n = 250)
      Age in years (Mean [SD])42.8515.3437.4915.0232.859.242.5911.7250.7415.3650.5815.68
      Female59347%11044%9438%11245%13755%14056%
      Marital status
       Single / never married29924%7128%9136%7229%4217%239%
       Married / living as a couple / civil partnership84868%17771%14859%17068%16867%18574%
       Other1038%21%114%83%4016%4217%
      Bachelor's degree or higher level of education**38531%12349%4618%4819%3414%13454%
      Relationship to the patient
       Spouse or partner625%125%31%94%156%239%
       Parent20316%3112%2711%4819%5723%4016%
       Grandparent19716%4217%3815%4719%3614%3414%
       Sibling816%166%125%104%156%2811%
       Child262%31%31%10%94%104%
       Close friend22318%3614%5221%4518%4719%4317%
       Colleague/co-worker948%2912%218%229%73%156%
       Other (Aunt/Uncle/Other)36429%8132%9438%6827%6426%5723%
      Caregiver was at least somewhat involved in…
       Talking with doctors about treatment decisions?15312%125%198%2711%5120%4418%
       Helping patient get medical care, such as going with them to doctor visits1,11990%23694%24096%22490%20984%21084%
       Looking after patient's day-to-day needs?1,07386%23694%23092%20381%19980%20582%
      Time since caregiver first learned of patient's terminal condition before patient's death
       < 6 months68054%14458%14156%12650%13554%13454%
       Between 6 months and 1 yr28122%5723%5622%5321%6325%5221%
       Between 1 and 3 yrs28923%4920%5321%7128%5221%6426%
      Locus of control for health and healthcare use (% who strongly agree/agree with statements)
       I prefer to leave all health care decisions to the doctor.65552%17771%12650%12148%10341%12851%
       I am able to help doctors understand what is important to me about my health care.1,08487%22490%22289%20080%21184%22791%
       My health depends mostly on luck.28723%8132%3012%5522%6124%6024%
       I can do things to improve my health other than what doctors tell me to do.97578%19980%17470%19377%20281%20783%
       I want as much information as possible to make decisions about my health care.1,11889%22690%23594%21084%21887%22992%
      Mean (SD) / n (%)
      B. Patient characteristicsOverallIndiaKenyaSingaporeUKUSA
      (n = 1250)(n = 250)(n = 250)(n = 250)(n = 250)(n = 250)
      Patients age at death (Mean, SD)62.4121.2755.58820.93853.40421.57366.5119.8970.79217.01565.7721.28
      Marital status
       Single / never married16813%3916%3614%4317%2510%2510%
       Married / living as a couple72858%17369%14257%15160%12952%13353%
       Other35428%3815%7229%5622%9638%9237%
      Bachelor's degree or higher level of education**52342%17068%9237%8132%8233%9839%
      Time since patient died
       < 6 months47338%10542%11044%8333%7530%10040%
       Between 6 months and 1 yr35428%8936%6526%7229%5924%6928%
       Between 1 and 2 yrs42334%5622%7530%9538%11646%8132%
      Care provided to patient during the last 6 weeks of life was mostly …
       Very good or good94576%18574%19277%18172%18273%20582%
       Neither good nor poor16613%3715%3313%4618%3715%135%
       Poor or very poor1119%2410%229%177%2410%2410%
       Don't know/not sure282%42%31%62%73%83%
      Professional services received by patient
       Nonmedical support33527%7530%6225%6225%6827%6827%
       At-home medical care61950%14156%10642%11747%12349%13253%
       In-patient medical care78062%15462%17570%14658%15662%14960%
       Outpatient medical care61049%11847%14357%12650%10442%11948%
       Palliative/hospice care35028%6225%4618%6626%9237%8434%
       Traditional or herbal medicine16813%4719%3514%3815%146%3414%
       Other131%00%10%31%52%42%
      Patient's ability to communicate during last 6 weeks of life
       Had a condition or treatments that made it difficult for them to communicate57546%14759%9438%12550%10341%10642%
       Had trouble getting what they needed because they did not speak the same language as their doctors or nurses32826%9839%5723%9638%2912%4819%
      Main reason for patient's death
      Additional details provided in Appendix B2.
       Cancer33527%3815%6024%7630%8233%7932%
       COVID-1915212%5120%2510%73%229%4719%
       Heart problems15112%3414%177%3313%3012%3715%
       Kidney diseases696%239%94%239%73%73%
       Natural causes/Old age685%156%94%239%125%94%
       Stroke675%135%146%177%177%62%
       Other40833%7630%11646%7128%8032%6526%
      **"Bachelor's degree or higher" is defined as a minimum of a three-year college degree (Singapore, India), or four-year college degree (USA), Degree level qualification or equivalent not including NVQ (UK), Higher diploma or degree (Kenya).
      a Additional details provided in Appendix B2.
      Almost half of care recipients (47.6%) were either close family members i.e., (parents, children, siblings, spouses or partners) or close friends of the caregiver. On average, care recipients died at the age of 62.4 years (SD = 21.3). Mean age at death was lower in India (55.5 years) and Kenya (53.4 years), relative to Singapore (66.5 years), US (65.8 years) and UK (70.8 years). COVID19-related deaths were more commonly reported in India (20.4%) and the US (18.8%), relative to other countries (less than 10% each).
      More than half of care recipients received in-patient medical care. Professional nonmedical support services were received by less than a third of care recipients in each country. Palliative/hospice care was more commonly received in the UK (36.8%) and US (33.6%), relative to Singapore (26.4%), India (24.8%) and Kenya (18.4%). In Singapore, India and Kenya about a fifth of care recipients received one or more healthcare services from a domestic helper. Over two thirds of caregivers reported that the care recipients overall end of life care during the last six weeks of life was mostly good or very good in each country. However, slightly over a quarter (26.2%) of the sample reported that care recipients had trouble getting what they needed because they did not speak the same language as their doctors or nurses. Language-related communication difficulties were most commonly reported in India (39.2%) and Singapore (38.4%). Appendix D1 and D2 provides additional details on other characteristics of caregivers and their care recipients.

      DCE Results

      Preference Estimates From Latent Class Models Using Pooled Data

      Results from the internal validity checks performed are available in Appendix E. A 2-class latent class (LC) model was selected as the best fit model, after considering LC models with two to five classes. The majority of respondents could be distinctly classified in one of the two classes; respondents had a class membership probability of at least 80% of being in one of the two classes. Estimates from the 2-class LC model are presented in Table 3.
      Table 3Parameter Estimates From Latent Class Model With Two Classes
      Class 1 (65%)Class 2 (35%)
      AttributeBetaSEBetaSE
      Clear and timely information1-star-1.4050.09-0.0170.056
      3-stars0.4010.0680.1040.052
      5-stars1.0040.058-0.0870.06
      Contact with family1-star-0.8080.081-0.080.055
      3-stars0.2080.0650.0520.052
      5-stars0.6010.0570.0270.052
      Spiritual needs1-star-0.7470.0750.020.054
      3-stars0.2190.0620.0170.055
      5-stars0.5280.053-0.0370.056
      Treated kindly1-star-1.4360.091-0.0290.055
      3-stars0.3330.0710.0620.052
      5-stars1.1030.06-0.0330.057
      Asked enough questions1-star-1.2080.082-0.1040.057
      3-stars0.3020.0640.1910.052
      5-stars0.9060.056-0.0870.059
      Quality of life extending treatments1-star-1.4430.088-0.1740.057
      3-stars0.3670.0660.1480.051
      5-stars1.0760.060.0270.058
      Managed pain and discomfort1-star-1.7310.098-0.1230.06
      3-stars0.5010.0730.1370.055
      5-stars1.2310.06-0.0150.061
      Cope emotionally1-star-1.1120.078-0.0850.058
      3-stars0.3550.0660.1840.052
      5-stars0.7570.055-0.0990.059
      Clean and safe space1-star-1.4690.089-0.1290.058
      3-stars0.3560.0680.2480.05
      5-stars1.1120.06-0.1190.059
      Care was well coordinated1-star-1.0450.078-0.0340.056
      3-stars0.2780.0640.1980.052
      5-stars0.7670.054-0.1640.059
      Nonmedical concerns1-star-0.6510.073-0.0890.056
      3-stars0.1550.0610.0950.053
      5-stars0.4960.053-0.0060.056
      Preferred place of death1-star-0.9320.082-0.1410.057
      3-stars0.2730.0680.1810.05
      5-stars0.6590.061-0.040.06
      Costs were not a barrier1-star-0.9590.082-0.0750.055
      3-stars0.330.0630.1350.051
      5-stars0.6290.056-0.060.057
      Class 1 (65%)
      CovariatesBetaSE
      Country indicators (Ref: USA)
       India-0.2530.126
       Kenya0.0860.138
       Singapore0.2570.131
       UK0.3710.133
      Monotonicity tests
      Failed 1st comprehension question-0.3440.096
      Failed 2nd comprehension question-1.0110.155
      Locus of control
      I prefer to leave all health care decisions to the doctor.-0.1650.087
      My health depends mostly on luck.-0.2840.098
      Time since patient died: less than 6 months-0.0980.041
      Overall good EOL experience for patient0.2980.092
      Communication challenges due to language-0.1540.046
      Respondents found choice tasks hard to answer-0.3060.105
      ≤ median survey completion time-0.5060.087
      Age > 50 yrs0.2330.102
      Intercept0.4950.157
      All attributes were effects-coded.
      SE = Standard Error.
      Preference weights and relative indicator importance are presented in Fig. 2, Fig. 3, respectively. The average probability of Class 1 membership was 64.7%. Class 1 preference weights were logically ordered and highly significant. For every indicator, preference estimates indicate caregivers value a quality-rating improvement from 1-star to 3-stars more than a quality-rating improvement from 3-stars to 5-stars.
      Fig 2
      Fig. 2Preference weights estimated from 2-class latent class model.
      Note: All attributes were effects-coded.
      95% Confidence intervals are shown.
      Fig 3
      Fig. 3Relative indicator importance for Class 1 (%).
      Note: 95% Confidence intervals are shown.
      For Class 1, preference weights indicated that providers’ ability to control patients' pain to desired levels was most important (11.5%), followed closely by clean, safe, and comfortable facilities (10.0%); being able to contact close family and friends (9.8%) and access to appropriate levels and quality of life extending treatments (9.8%). Providers’ support for spiritual needs (4.9%) and nonmedical concerns (4.4%) were of least importance.
      The average probability of Class 2 membership was 35.3%. In contrast to Class 1, Class 2 preference estimates were disordered within every indicator and had large variance. Due to disordering and other threats to validity as noted below, we did not compute relative indicator importance for Class 2.

      Predictors of Class Membership From Latent Class Models Using Pooled Data

      As shown in Table 2, Class 1 membership was significantly correlated with passing internal data-validity checks. Failing the second monotonicity test was the largest predictor of being in Class 2. Respondents who failed the first monotonicity test, completed the survey in less than the median survey completion time (median = 14.3 minutes), fully dominated on any one indicator, or reported finding the choice tasks “hard” or “very hard” to answer, were more likely to be classified in Class 2.
      Caregiver and patient characteristics were also found to predict class membership. Respondents who reported that they preferred “to leave all healthcare decisions to the doctor” or believed that their health “depends mostly on luck” were more likely to be in Class 2, suggesting that caregivers who perceived their decision-making role to be less important for their loved one's care were more likely to be in Class 2. Younger respondents who were aged 50 years or younger, and those who reported losing a loved one less than six months ago were more likely to be in Class 2. However, respondents reporting that patients they had cared for had a “good” or “very good” overall end of life experience were more likely to be in Class 1. Factors such as young age, recentness of death and lower quality of end of life experience, which may be correlated with greater emotional distress, are more likely to be associated with Class 2.
      Class membership probability also varied systematically by country. Relative to respondents in the US, those in Singapore or the UK were more likely to be in Class 1 whereas those in India were more likely to be in Class 2, this may suggest that data from India is less reliable. Respondents in Kenya were just as likely to be in Class 1 as those in the US.

      Country-Specific Preferences From Random-Parameters Logit Model

      Fig. 4 presents the relative indicator importance from country-specific random parameters logit models. The model estimates are available in Appendix F. As DCE data from respondents in Class 2 suggested poor internal validity each respondent was weighted using probability of belonging to Class 1. This implies down-weighting responses from individuals who exhibited large variance in their answers.
      Fig 4
      Fig. 4Country-specific relative attribute importance estimates.
      Note: 95% Confidence Intervals are shown.
      Results suggest some similarities and differences across countries. Preferences for changes in ratings were highly nonlinear across indicators and countries, revealing that a quality-rating improvement from 1-star to 3-stars is valued more than a quality-rating improvement from 3-stars to 5-stars. In all countries, pain control was estimated to be the most important or second most important indicator. Quality of life-extending treatments and being treated kindly were also consistently highly valued in all countries whereas the ability to contact family and nonmedical concerns were consistently valued among the least important indicators.
      Perhaps due to a lack of power, differences in indicator importance across countries were mostly not statistically significant. However, some differences in indicator importance are worth highlighting. First, relative importance of dying in the preferred patient setting was about twice as important in the US as in India (7.7% vs. 4.0%). Also, the importance that the UK assigned to spiritual needs was about half of the importance level estimated for the US, India and Kenya (3.1% vs. 5.7%–5.9%).

      Discussion

      To our knowledge, this is the first international preference study aiming to quantify the relative importance of EOL care indicators within and across countries. Thus, the results provide insights into EOL care that have never been reported. Our findings suggest that not all aspects of EOL care are equally valued. Highlighting the importance of managing pain and discomfort, providers’ ability to control patients' pain to desired levels was the most important indicator across the five countries. Given poor access to pain control in many countries, this finding provides a clear motivation for greater efforts to provide access to these medicines. Providing clean, safe, and comfortable facilities and being able to contact close family and friends ranked higher than access to appropriate levels and quality of life extending treatments. This finding is consistent with prior studies
      • Malhotra C
      • Farooqui MA
      • Kanesvaran R
      • Bilger M
      • Finkelstein E
      Comparison of preferences for end-of-life care among patients with advanced cancer and their caregivers: a discrete choice experiment.
      suggesting that for dying patients, or in this case their proxy respondents, moderately extending life is not the top priority at EOL. Providers’ support for spiritual needs and nonmedical concerns were of least relative importance, although it is unclear whether this is because they are not highly valued or because respondents felt these fall outside of the realm of healthcare providers.
      Also consistent across countries were the views that there are diminishing returns to investments in any one of these domains suggesting that, for a fixed budget, the greatest return in EOL care is likely to come from investments that ensure some minimum level of quality for any given domain or sub-domain as opposed to trying to deliver the highest quality levels for only a subset of domains.
      We found potential differences in indicator importance across countries. Further evaluation of these differences and potential correlations with other observables could identify subsets of individuals with different preferences than the average. These individuals might benefit from a different prioritization of EOL care. Exploring this hypothesis could be an area of future research.
      While we found that respondents with more recent experience with EOL care were likely to have different preferences, we do not have information to determine whether this is a result of recall effects, or simply a reflection of the dynamic nature of bereavement. Understanding that process was beyond the scope of this study.
      Several limitations of our study are worth mentioning. First, while the survey instrument was designed to increase the consequentiality of the hypothetical choices made by respondents, the decisions elicited here were not obtained from real-world choices by study participants and thus may not be reflective of actual choices. This is a limitation of all DCE surveys.
      We surveyed caregivers as proxies for those who were terminally ill, and within two years after the death of the care recipient. The perspective of caregivers is likely to differ from those of patients at EOL,
      • Malhotra C
      • Farooqui MA
      • Kanesvaran R
      • Bilger M
      • Finkelstein E
      Comparison of preferences for end-of-life care among patients with advanced cancer and their caregivers: a discrete choice experiment.
      ,
      • Ozdemir S
      • Ng S
      • Malhotra C
      • Teo I
      • Finkelstein EA
      Patient-caregiver treatment preference discordance and its association with caregiving burden and esteem.
      and surveying caregivers after they had time to reflect on the EOL experience, may generate biases in unknown directions. We also fielded the survey during the Covid-19 pandemic, which affected the death and dying experience for many people and perhaps also the bereavement experience. Future research should evaluate the importance of EOL care indicators directly from patients and caregivers during different time periods to evaluate the veracity of our results.
      Our respondents were all members of an on-line panel and may be systematically different from the subset of the population who lost a close friend/family member in the countries considered. Furthermore, we invited panel members without prior confirmation of eligibility. This recruitment approach provided no assurance that everyone who was invited was qualified to complete the survey. Thus, we have limited information on systematic participation from specific respondent groups and the potential biases that may arise from this recruitment approach. The fact that few elderly are likely to join web panels may explain why respondents were only 42.9 years of age on average and relatively elderly spouses were underrepresented in our sample. We also recruited participants from only five countries. While we included countries with variation in level of development, region, and cultural background, interpretation of the preference weight as globally representative should be done with caution. Yet, while we expected (and found) some differences in preference weights across countries, results suggest that EOL care concerns may be more universal than not. Regardless, future research should aim to overcome all of the above limitations.
      The goal of this study was to quantify preference weights of select EOL care indicators and of levels within indicators. Future efforts can apply these weights to comprehensively evaluate health system performance at the country, region, or facility level directly from patients/caregivers or indirectly via knowledgeable stakeholders.

      Disclosures and Acknowledgments

      The authors would like to thank Dr. Charles Muiruri, Dr. Sushma Bhatnagar, Dr. Cynthia Goh, Dr. Afsan Bhadelia, Dr. Stephen Connor, Dr. Hussein Elias, Ratna Singh and Waqas Ahmed for their feedback and support during pilot testing and survey development. This research received no specific funding/grant from any funding agency in the public, commercial, or not-for-profit sectors. The authors declare no conflicts of interest.

      Appendix. Supplementary materials

      References

        • Donabedian A.
        Evaluating the quality of medical care.
        Milbank Mem Fund Q. 1966; 44: 166-206
        • Stjernswärd J
        • Foley KM
        • Ferris FD
        The public health strategy for palliative care.
        J Pain Symptom Manage. 2007; 33: 486-493
      1. The economist intelligence unit and commissioned by lien foundation. The quality of death. Ranking end-of-life care across the world. 2010. Available at: http://www.lienfoundation.org/sites/default/files/qod_index_2.pdf. Accessed July 9, 2021.

      2. The economist intelligence unit and commissioned by lien foundation, the 2015 quality of death index: ranking palliative care across the world. 2015. 15.

        • Steinhauser KE
        • Clipp EC
        • McNeilly M
        • Christakis NA
        • McIntyre LM
        In search of a good death: Observations of patients, families, and providers.
        American College of Physicians, 2000
        • Finkelstein E.A.
        • Bilger M
        • Flynn TN
        • Malhotra C
        Preferences for end-of-life care among community-dwelling older adults and patients with advanced cancer: a discrete choice experiment.
        Health Policy. 2015; 119: 1482-1489
        • Steinhauser KE
        • Christakis NA
        • Clipp EC
        • McNeilly M
        • McIntyre L
        Factors considered important at the end of life by patients, family, physicians, and other care providers.
        JAMA. 2000; 284: 2476-2482
        • Lankarani-Fard A
        • Knapp H
        • Lorenz KA
        • Golden JF
        • Taylor A
        Feasibility of discussing end-of-life care goals with inpatients using a structured, conversational approach: the go wish card game.
        J Pain Symptom Manage. 2010; 39: 637-643
        • Orme B.
        Getting started with conjoint analysis: Strategies for product design and pricing research second edition.
        Research Publishers LLC, Madison2010
      3. Bhadelia A, Oldfield LE, Cruz JL, Singh R, Finkelstein EA. Identifying the core domains to assess heath system performance on the’ quality of death: a scoping review. 2021 Working paper.

        • Bose R.C.
        On the construction of balanced incomplete block designs.
        J A O E. 1939; 9: 353-399
        • Kuhfeld W.F.
        Marketing research methods in SAS: experimental design, choice, conjoint, and graphical techniques.
        SAS Document TS-694. Citeseer, 2007 (Available at:) (Accessed January 19, 2022)
        • Kuhfeld WF
        • Tobias RD
        • MJJo MR Garratt
        Efficient experimental design with marketing research applications. 1994; 31: 545-557
        • Johnson F.R.
        • Yang J.C.
        • Reed S.D.
        The internal validity of discrete choice experiment data: a testing tool for quantitative assessments.
        Value Health. 2019; 22: 157-160
        • Hauber A.B.
        • González JM
        • Groothuis-Oudshoorn CG
        • Prior T
        • Marshall DA
        Statistical methods for the analysis of discrete choice experiments: a report of the ISPOR conjoint analysis good research practices task force.
        Value Health. 2016; 19: 300-315
        • Gonzalez J.M.
        A guide to measuring and interpreting attribute importance.
        Patient. 2019; 12: 287-295
        • Malhotra C
        • Farooqui MA
        • Kanesvaran R
        • Bilger M
        • Finkelstein E
        Comparison of preferences for end-of-life care among patients with advanced cancer and their caregivers: a discrete choice experiment.
        Palliat Med. 2015; 29: 842-850
        • Ozdemir S
        • Ng S
        • Malhotra C
        • Teo I
        • Finkelstein EA
        Patient-caregiver treatment preference discordance and its association with caregiving burden and esteem.
        Innov Aging. 2021; 5: igab020