Journal of Hepatology
Volume 51, Issue 5 , Pages 949-959, November 2009

A review of quality of life instruments used in liver transplantation

  • Colleen L. Jay

      Affiliations

    • Division of Organ Transplantation, Department of Surgery, Feinberg School of Medicine, Northwestern University, 750 N. Lake Shore Drive, Chicago, IL 60611, USA
  • ,
  • Zeeshan Butt

      Affiliations

    • Division of Organ Transplantation, Department of Surgery, Feinberg School of Medicine, Northwestern University, 750 N. Lake Shore Drive, Chicago, IL 60611, USA
    • Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
    • Institute for Healthcare Studies, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
    • Corresponding Author InformationCorresponding author. Tel.: +1 312 5035519; fax: +1 312 5032777.
  • ,
  • Daniela P. Ladner

      Affiliations

    • Division of Organ Transplantation, Department of Surgery, Feinberg School of Medicine, Northwestern University, 750 N. Lake Shore Drive, Chicago, IL 60611, USA
  • ,
  • Anton I. Skaro

      Affiliations

    • Division of Organ Transplantation, Department of Surgery, Feinberg School of Medicine, Northwestern University, 750 N. Lake Shore Drive, Chicago, IL 60611, USA
  • ,
  • Michael M. Abecassis

      Affiliations

    • Division of Organ Transplantation, Department of Surgery, Feinberg School of Medicine, Northwestern University, 750 N. Lake Shore Drive, Chicago, IL 60611, USA

published online 29 July 2009.

Associate Editor: P.-A. Clavien

Article Outline

With improvements in patient and graft survival after liver transplantation, recipient quality of life (QOL) has become an important focus of patient care and clinical outcomes research. To provide a better understanding of the instruments used to assess QOL in the adult liver transplant population, we conducted a systematic review of the MEDLINE database and Cochrane library. Our review identified 128 relevant articles utilizing more than 50 different QOL instruments. Generic health status instruments are the most commonly used, and among them the Medical Outcomes Study Short Form-36 (SF-36), the Hospital Anxiety and Depression Scale (HADS), and the Beck Depression Inventory (BDI) are the most prevalent. Few studies (16%) included targeted, disease-specific instruments. The National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) Quality of Life questionnaire, the Liver Disease Quality of Life questionnaire, and the Chronic Liver Disease questionnaire are the most frequently employed targeted instruments; however, these instruments have been designed to assess QOL in patients with chronic liver disease rather than patients after liver transplantation. The present review focuses on the psychometric properties of the existing QOL instruments and discusses their individual strengths and limitations in evaluating liver transplantation recipients. The lack of a gold-standard QOL instrument for liver transplant recipients is an impediment to cross-study comparisons. We conclude that the development of a QOL instrument specifically for liver transplant recipients will improve QOL assessment in this population leading to a more nuanced understanding of the factors that influence transplant recipients’ well-being.

Abbreviations: QOL, quality of life, SF-36, short form-36, HADS, hospital anxiety and depression scale, BDI, beck depression inventory, NIDDK, National Institute of Diabetes and Digestive and Kidney Diseases, WHO, World Health Organization, MeSH, medical subject headings, HRQL/HRQOL, health-related quality of life, MELD, model for end-stage liver disease, EQ-5D, EuroQOL-5D, VAS, visual analog scale, SIP, sickness impact profile, LDQOL, liver disease quality of life questionnaire, CLDQ, chronic liver disease questionnaire, QALY, quality-adjusted life year

Keywords: Liver transplantation, Quality of life, Psychometrics, SF-36, LDQOL, Systematic review

 

Back to Article Outline

1. Background 

Liver transplantation is a life-saving intervention for an increasing number of patients with end-stage liver disease [1]. Steady improvements in graft and patient survival have been achieved over the past two decades. One year adjusted patient and graft survival rates were 87.9% and 82.3%, respectively, for deceased donor liver transplants in 2005 [1]. This represents an increase of approximately 25% for both patient and graft survival since 1987. With significant improvements in survival and a more recent plateau of these gains [1], the focus on outcomes measures has shifted towards inclusion of patient-reported quality of life (QOL). The concept of QOL complements the World Health Organization (WHO) definition of health as “a state of complete physical, mental and social well-being and not merely the absence of disease and infirmity” [2]. Hence, patient-reported outcomes are being increasingly emphasized in recent years and have become an integral component of many ongoing clinical trials [3], [4]. However, meaningful assessment of patient QOL relies on the ability to reliably and accurately assess well-being using psychometrically robust instruments.

Multiple studies have reported on QOL in patients with chronic liver disease, liver transplant candidates, and transplant recipients. However, the differences between the various QOL instruments in use and the degree to which these instruments capture the true impact of liver transplantation on QOL have not been rigorously assessed. In order to evaluate the currently available instruments, we have conducted a systematic review of the literature focusing on patient-reported QOL assessment in the context of liver transplantation. We critically evaluated the psychometric properties of these instruments and their ability to measure concerns specific to the liver transplant population. To date, more than 50 instruments have been used to assess QOL in liver transplant candidates or recipients. This is the first review to discuss the relevant merit of the most frequently-used instruments.

Back to Article Outline

2. Materials and methods 

A systematic search of the MEDLINE database (1969–2008) and the Cochrane library was performed to identify liver transplant articles that included a patient-reported QOL assessment. To capture any relevant articles, a search using the Medical Subject Headings (MeSH) terms “liver transplantation” and “quality of life” was constructed. Citations associated with the keywords “QOL”, “HRQL”, or “HRQOL” (health-related quality of life) were also included. The search was limited to original articles relevant to humans and available in English. Publications were included if they used a patient-reported QOL assessment in liver transplant candidates or recipients. Articles using ad hoc instruments or instruments that could not be identified were excluded. Studies were also excluded if they focused exclusively on pediatric patients or living donors. The full text was reviewed prior to exclusion. Furthermore, the bibliographies of review articles on this topic were reviewed for any relevant publications to verify the completeness of our search. This search was performed by a single reviewer (CJ). We reviewed the QOL instruments identified through this search according to psychometric criteria adapted from the Scientific Advisory Committee of the Medical Outcomes Trust criteria [5], [6] (Table 1).

Table 1. Psychometric properties of QOL instruments.
CriteriaaDescription
Conceptual and measurement modelSuch a model describes the rationale for and operationalization of the concepts to be measured.

ReliabilityReliability is an index describing the degree to which the instrument is free from random error. Two common types of reliability that are reported include:
a. Internal consistency is the degree to which items on a scale measure the same concept, reported in terms of Cronbach alpha coefficients (minimum suggested α=0.5–0.7 for group comparisons and ⩾0.85 for individual) [6], [76]
b. Test–retest reliability is the extent to which similar scores are obtained from the same individuals over short time periods, expressed as correlation coefficients (coefficients ⩾0.6 have been suggested as a measure of “good” or “substantial” reliability) [77], [78]

ValidityValidity is an index of the extent to which an instrument measures what it purports to measure. Two common types of validity include:
a. Criterion-related validity is demonstrated when an instrument is effective in predicting scores on another indicator of the concept.
b. Construct-related validity is the degree to which an instrument is predictive of a theoretical trait or concept [6].

ResponsivenessThis criterion assesses the ability to detect changes over time corresponding to changes in patients’ health status

BurdenThe time and effort demanded to complete the survey is a measure of the instrument’s burden

Cultural/language adaptationsInformation about translational process and evidence regarding conceptual and linguistic equivalence enable assessment of the quality of these adaptations

aAdapted from review criteria developed by the Scientific Advisory Committee of the Medical Outcomes Trust [5], [6].

Back to Article Outline

3. Results 

3.1. Identified studies 

We identified 468 citations in our original search. A total of 340 articles were eliminated after applying the exclusion criteria outlined above. One hundred and twenty-eight articles met final inclusion criteria. (Fig. 1 and Appendix A) The first assessment of QOL outcomes in liver transplantation was published in 1988, more than 20 years after the first successful liver transplant performed by Starzl [7]. In the last decade, interest in this area has increased significantly. This is illustrated by the fact that MEDLINE identified more publications using the terms of “liver transplantation” and “quality of life” since 2000 than in the preceding two decades.

This review evaluates both generic and targeted QOL instruments that have been utilized in liver transplant candidates or recipients. Generic instruments are comprised of questions broad enough to be applicable to a wide variety of populations and disease states. Generic instruments were used in the majority of studies with the Medical Outcomes Study Short-Form 36 (SF-36) being the most frequently utilized. The SF-36 was administered in 54 of the 128 selected studies, and an additional nine publications incorporated a related short form instrument, such as the SF-12. Other commonly used generic instruments include the Hospital Anxiety and Depression Scale (n=13), the Beck Depression Inventory (n=10), the EuroQOL-5D (n=8), and the Sickness Impact Profile (n=8). Table 2 summarizes the generic instruments evaluated in this study.

Table 2. Characteristics of generic health status measurements.
Medical outcomes study Short Form-36 (SF-36)Hospital Anxiety and Depression Scale (HADS)Beck Depression Inventory (BDI)EuroQOL 5D (EQ-5D)Sickness Impact Profile (SIP)
AuthorsWare, 1992 [79]Zigmond, 1993 [22]Beck, 1961 [30]EuroQol group, 1990 [36]Bergner, 1981 [45]
Burden: # items3614216136
Subscales821512
Domains (subscales)Physical functioningAnxietyDepressionMobilityAmbulation
Role-physicalDepression Self-careBody care/movement
Role-emotional Usual activitiesMobility
Mental health Pain/discomfortSocial interaction
Vitality Anxiety/depressionAlertness behavior
Bodily pain Emotional behavior
General health Communication
Social functioning Sleep/rest
Eating
Work
Home management
Recreation
Summary ScoresYes (2) (physical/mental)YesYes (2) (physical/psychosocial)
Internal Consistencya>0.73[8] (0.77–0.94)b>0.80 [80]0.86 [30]Not applicablec0.84–0.94 [45], [46]
Test-retest reliabilitya0.60–0.81[8]>0.84 [80]0.70–0.85 [81]0.85–0.92 [45], [46]
Utility measure (for QALY)YesNoNoYesNo
Cultural/language adaptationsYesYesYesYesYes

aValues are reported from original validation studies (not in liver disease or transplant population).

bIn chronic liver disease population being evaluated for transplant [13].

cNon-applicable due to one item per domain.

Targeted QOL instruments include items focused on disease- or treatment-specific topics which are of particular interest to the population being assessed. Only 16% of the articles (n=21) included a targeted instrument. The most frequently applied targeted instruments included the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) Quality of Life questionnaire (n=9), the Liver Disease Quality of Life questionnaire (n=7), and the Chronic Liver Disease questionnaire (n=4). Table 3 lists the characteristics of the targeted instruments reviewed.

Table 3. Characteristics of liver disease-targeted health status measurements.
NIDDK Liver Transplant Database QOL questionnaireLiver Disease Quality of Life questionnaire (LDQOL)Chronic Liver Disease questionnaire (CLDQ)
AuthorsBelle, 1995 [50]Gralnek, 2000 [13]Younossi, 1999 [56]
Burden: # items6311229
Subscales6206
Summary scoresYes (for 21 disease-specific items)Yes (3) (SF-36 PCS/MCS & disease-specific)Yes
Internal consistencya0.62–0.99 [52], [53]0.62–0.95 [13]>0.79 [56]
Test–retest reliabilitya0.87–0.94 [53]0.59 [13]
Domains (subscales)General health8 SF-36 domainsFatigue
Role functionSymptoms of liver diseaseActivity
Social functionEffects of liver diseaseEmotional function
Psychological statusConcentrationAbdominal symptoms
Personal functionMemorySystemic symptoms
Measures of liver diseaseSexual functioningWorry
Sexual problems
Sleep
Loneliness
Hopelessness
Quality of social interaction
Health distress
Stigma of liver disease
Cultural/language adaptationsYesYesYes

aFrom studies done in liver disease/liver transplant population.

Multiple cultural/language adaptations exist for both these generic and targeted instruments. A complete list of all QOL instruments used in adult liver transplant candidates or recipients is provided in Table 4.

Table 4. List of all quality of life instruments included in this review.
Anamnestic Comparative Self Assessment Scale (ASCA)
Austin Quality-of-Life Scale
Beck Anxiety Inventory (BAI)
Beck Depression Inventory (BDI)
Berlin Mood questionnaire
Berlin questionnaire of Current moods (BSF)
Billing and Moos Inventory of coping with illnesses
Brief Symptom Inventory (BSI)
Center for Epidemiologic Studies Depression Scale (CES-D)
Chronic Liver Disease questionnaire (CLDQ)
European Organization for Research and Treatment of Cancer QOL questionnaire (EORTC QLQ)
EuroQOL-5D (EQ-5D)
Everyday life abilities questionnaire (ALL)
Fatigue Severity Scale (FSS)
Ferrans and Powers questionnaire
Functional Assessment of Cancer Therapy (FACT-G)
Functional Living Index Cancer
General Condition questionnaire (GCQ)
General Quality of Life inventory (GQOLI-74)
Giessen Complaint questionnaire
Hospital Anxiety and Depression Scale (HADS)
Index of General Affect
Index of Well Being (IWB)
Interdisciplinary Group for Cancer Care Evaluation in Italy (GIVIO) questionnaire
Jalowiec Coping Scale (JCS-40)
Leeds Anxiety and Depression Scale
LEIPAD Quality of Life questionnaire
Life Orientation Test (LOT)
Linear Analogue Self-Assessment Scales (LASA)
Liver Disease QOL instrument (LDQOL)
Liver Disease Symptom index
Medical Outcomes Study Short Form-36 (SF-36)
MOS-20 (and other MOS short form versions)
Memphis survey
Mental Health Inventory
Multi-dimensional Fatigue Inventory (MFI)
NIDDK QOL questionnaire
Nottingham Health Profile (NHP)
PICAVIRES (profile of QOL related to health)
Profile of Mood Survey (POMS)
Psychological general well-being Index (PGWI)
Psychosocial Adjustment to Illness Scale (PAIS)
Quality of Life Index-Liver Transplant Version (QLI-LT)
Quality of Life Inventory
Questionnaire on Life Satisfaction
Questions on Life Satisfaction survey
Sense of Coherence Scale (SOC)
Sickness Impact Profile (SIP)
Social embedding questionnaire (SEB)
Social Reintegration questionnaire
STALX anxiety questionnaire
State Trait Anxiety Survey (STAI)
Symptoms Check List – 90 (SCL-90-R)
Transplant Effects questionnaire TxEQ-D
UCLA Loneliness Scale-Revised
Visual Analog Scale measuring QOL
Ways of Coping Scale (WOC)
World Health Organization QOL questionnaire (WHO-QOL)

3.2. Generic QOL instruments 

The Medical Outcomes Study Short Form-36 (SF-36): The SF-36 is comprised of 36 items, which are used to derive eight health subscales. These scales assess physical functioning, role physical (limitations due to physical health), bodily pain, general health, vitality, social functioning, role emotional (limitations related to emotional problems), and mental health. The eight subscales can also be summarized into a physical and mental component summary score. The SF-36 was first validated in healthy populations in the United States, Great Britain, and Sweden [8], [9], [10], [11], [12], and has since been used across many medical disciplines to assess health status [10], [11]. An advantage of the SF-36 is the comparability of scores with norms published for many different cultural and disease populations. The SF-36 was first used to assess QOL in liver transplant recipients in 1993 and remains the most popular instrument, appearing in 11 of 13 studies in 2008.

Internal consistency estimates (Cronbach’s α) of 0.77–0.94 were ascertained in a study of chronic liver disease patients referred for transplant evaluation [13]. In liver transplant recipients, SF-36 scores were significantly associated with rates of unemployment and disability post-transplant establishing construct validity [14]. Phillips et al. demonstrated predictive validity of the SF-36 in liver transplant recipients by showing a significant correlation between pre-transplant SF-36 scores and post-transplant morbidity, mortality, and resource utilization [15]. The number of longitudinal studies using the SF-36 is limited; however, several studies have demonstrated responsiveness of this instrument to changes in health over time, as demonstrated by improvements in scores following transplant [16], [17], [18], [19]. The ability of the SF-36 to detect the sizable differences in health between end-stage liver disease patients and transplant recipients still leaves questions about the sensitivity of the SF-36 to detect smaller changes over time. Moreover, measurement with the SF-36 did not identify significant differences in QOL in transplant recipients with prolonged intensive care stays or need for hemodialysis compared to those with uncomplicated recoveries [9]. Similarly, Saab et al. and Kanwal et al. both demonstrated a lack of correlation between QOL measured in patients awaiting transplantation and disease severity according to Model for End-stage Liver Disease (MELD) scores [20], [21]. These findings highlight potential shortcomings in the SF-36 to capture aspects of health relevant and specific to liver transplantation.

Hospital Anxiety and Depression Scale (HADS): The HADS [22] is a 14 item questionnaire designed to detect anxiety and depression [23], [24] Questions focus on mood, interest in activities, and anxiety and panic symptoms. Notably, the HADS does not include items addressing somatic symptoms to avoid over-estimation of psychological distress related to physical illness. The HADS was originally validated in general medical (non-psychiatric) and surgical patients [22], [25]. In support of the scale’s criterion validity, authors found strong correlations between psychiatrists’ ratings of disease severity and subscale scores (Spearman correlation, r=0.70 for depression and 0.74 for anxiety) [22]. The HADS has been shown to discriminate mild degrees of anxiety and depression [25].

Forsberg et al. observed correlations between HADS scores and SF-36 scores in liver, heart, and kidney transplant recipients [26]. Nickel et al. also demonstrated a correlation between scores on these two scales in liver transplant recipients. Furthermore, they found an association between HADS scores and employment and involvement in volunteer activities [27]. However, Hellgren et al. reported contradictory findings with no association between HADS scores and employment in liver transplant recipients [9]. In a longitudinal study of patients on the waiting list, HADS scores showed little change over time, but adequate information is not available to determine if this is due to a lack of responsiveness of the instrument or the stability of these symptoms [28]. HADS scores were sensitive to the changes that occur following transplant [16]. Furthermore, HADS has been utilized as a predictor of psychosocial outcomes after liver transplant [29]. Since its first use in liver transplant recipients in 1998, HADS continues to appear in one to two studies annually in this population.

Beck Depression Inventory (BDI): The BDI [30] was developed to measure depressive symptoms in adults and adolescents. It is a 21 item questionnaire including items assessing hopelessness, irritability, cognition, guilt, fatigue, weight loss, and sexual interest. Unlike the HADS, the BDI includes seven items that assess somatic symptoms, some of which are common in liver transplant recipients. The BDI was first validated in populations of hospitalized and outpatient psychiatric patients [30], [31]. Scores on this patient-reported inventory showed strong correlation with clinician-assessed depression severity establishing criterion validity.

Singh et al. found a strong association between BDI and Karnofsky performance status scores in a prospective study of patients being evaluated for liver transplantation. BDI scores were also noted to be a significant predictor of waitlist mortality [32]. Santos et al. demonstrated that depression according to BDI scores was associated with worse scores on seven of eight SF-36 domains in a study of liver transplant recipients [33]. Depressive symptoms according to the BDI were also associated with reports of inability to perform daily or professional activities [34]. The BDI was responsive to changes occurring following transplant in several studies of patients undergoing liver transplant including those with alcoholic cirrhosis and hepatitis C [32], [33], [35]. However, the BDI has become less popular in studies of liver transplant recipients in recent years and has been used in only two studies since 2000. This may be related to the recognition that common somatic complaints in liver disease patients may artificially inflate estimates of depressive symptoms in this population.

EuroQOL-5D (EQ-5D): The EQ-5D [36] assesses five single item concepts including mobility, self-care, usual activities, pain/discomfort, and anxiety/depression. It also includes a visual analog scale (VAS) asking patients to rate their health on a scale of 0–100 from worst possible to best possible health. The EQ-5D was developed as a preference-based index measure to enable cross-national comparisons, form a single index value, and to be applied to many different disease states [37], [38]. In a survey of the British general population, Brazier et al. validated the EQ-5D by demonstrating expected health trends according to age, gender, and socioeconomic status and a strong correlation with SF-36 scores [38]. Some authors have noted ceiling effects, suggesting the need for cautious usage in patients with minor morbidity [39]. The short length of this instrument reduces responder burden but may limit precision compared to longer questionnaires [40]. Given its short length, this scale was intended to be used in conjunction with other measures [6].

Bryan et al. established construct validity of the EQ-5D in liver transplant recipients by showing significant differences in scores according to disease severity and duration [41]. Ratcliffe et al. found comparable improvements in a prospective, multi-center study of transplant recipients between EQ-5D scores and the SF-36 as another measure of construct validity [18]. In another study by Ratcliffe, authors demonstrated responsiveness of EQ-5D scores to changes that occurred following transplant. No significant differences were identified in patients followed for three months on the waitlist, but unadjusted scores were responsive to changes occurring over the first two years post-transplant [42]. Over the past decade, the EQ-5D has remained a common method of estimating utilities for cost-effectiveness analyses of liver transplant recipients [43], [44].

Sickness Impact Profile (SIP): The SIP [45] assesses behaviors as a measure of the impact of a patient’s illness. It contains 136 items focusing on ambulation, mobility, body care, communication, alertness, emotional behavior, social interaction, sleep, eating, work, home management and recreation. Scores can be aggregated into a physical and a psychosocial dimension. Bergner et al. validated the SIP by comparing scores to a self and a clinician assessment of dysfunction and sickness. Authors also found an association between SIP scores and a disability index derived from the National Health Interview Survey [45]. SIP scores have also been shown to have moderate to high correlations with numerous other general health status measures [6], [46].

Tarter et al. utilized the SIP to measure QOL in liver transplant candidates and recipients [47], [48]. Self-reported SIP scores showed strong associations with Child’s class and caregivers’ perceptions of QOL obtained in interviews establishing construct validity. Reither et al. found correlations between scores for the SIP and the BDI and the State Trait Anxiety Inventory in liver transplant recipients [34]. Tarter et al. demonstrated responsiveness of the SIP to changes occurring in patients undergoing transplant [47]. Over time, the SIP has become less frequently used in studies of liver transplant populations, appearing in only two studies since 1998 [49]. The diminished use of the SIP may be a function of its length, which likely presents a significant burden to respondents.

3.3. Targeted QOL instruments 

National Institute of Diabetes and Digestive and Kidney Diseases Liver Transplant Database Quality of Life (NIDDK QOL) questionnaire: The NIDDK QOL questionnaire [50], [51] was developed for the seven year NIDDK multi-center study of liver transplant recipients. There are 63 items which are organized into the domains of general health, personal function, psychological status, social and role function, and measures of liver disease. Items were drawn from multiple established general health questionnaires and a few instruments previously used in other transplant populations including kidney and heart transplant recipients. Some items were modified from their original form, limiting comparison to previous studies. The questionnaire includes 21 disease-specific items assessing symptoms related to chronic liver disease. Several items also address side-effects related to immunosuppressant agents. Specifically, two items deal with distress related to overeating and changes in facial appearance addressing concerns associated with chronic corticosteroid use.

Belle et al. first reported results for the NIDDK QOL questionnaire in a longitudinal study of transplant recipients from three centers [50]. Internal consistency of subscales ranged from α=0.71 to 0.86 [51], [52]. These authors found that the greatest differences between recipients were related to disease-specific symptoms demonstrating a possible sensitivity to concerns particular to liver patients [51]. In a study of patients with cholestatic liver disease, strong test–retest reliability (r=0.82–0.99) and internal consistency estimates (α=0.87–0.94) were demonstrated [53]. Cowling et al. demonstrated significant improvements in scores at one year post-transplant establishing some degree of responsiveness [54]. There were no significant differences in second year and first year scores, but information is too limited to determine if this is due to a lack of responsiveness or stability of patients’ health state. This questionnaire was utilized consistently following the completion of the NIDDK study appearing in four studies published in 2003–2004.

Liver Disease QOL questionnaire (LDQOL): The LDQOL [13] is a targeted instrument which incorporates the SF-36 as well as 76 additional items comprising 12 multi-item scales. The 12 domains are symptoms of liver disease, effects of liver disease, concentration, memory, quality of social interaction, health distress, sleep, hopelessness, loneliness, stigma of liver disease, sexual functioning and sexual problems.

Gralnek et al. established the validity of this instrument for measuring QOL in patients with chronic liver disease in a multi-center study of patients referred for liver transplant evaluation [13]. They demonstrated strong internal consistency of the disease-specific scales (α=0.62–0.95). Significant associations were noted between self-reported disease severity and 11 of the 12 disease-specific scales. The number of disability days was also associated with scores on 10 of the 12 scales. In addition, Kanwal et al. reported associations between Child’s class and the effects of liver disease, sexual problems and sexual functioning domains [20]. More recently, a prospective validation of a short form version of the LDQOL including 36 targeted items representing nine domains in addition to the SF-36 has been published [55]. To date, no studies have included a longitudinal assessment of QOL with this instrument, so the instrument’s responsiveness to change remains unknown. Although it was introduced in 2000, the LDQOL has been more frequently utilized in recent years, appearing in three studies since 2007.

Chronic Liver Disease questionnaire (CLDQ): The CLDQ [56] is a 29 item questionnaire developed for measuring aspects of QOL in patients with chronic liver disease. It includes items representing six domains measuring fatigue, activity, emotional function, abdominal symptoms, systemic symptoms and worry. These items were selected based on responses from 60 chronic liver disease patients, 20 liver experts, and a review of the literature.

Younossi et al. established construct validity according to significant differences in CLDQ scores according to Child’s class [56]. They also demonstrated responsiveness of the instrument with worsening scores corresponding to increasing disease severity over time according to Child’s class. A correlation between Child’s class and CLDQ scores was again demonstrated in another study by Saab et al [21]. Younossi also established discriminant validity of the scale by comparing waitlisted patients to the general population as well as to other patient/disease populations [57]. They reported a strong association between CLDQ scores and resource utilization. This instrument was first introduced in 2000, and most recently appeared in a study of liver transplant recipients in 2005.

Back to Article Outline

4. Discussion 

Health care outcomes can be divided into three fundamental categories: survival (how long people live), cost (how much the intervention costs), and quality of life (how well people live). While QOL is an important and established health care outcome [58], [59] its measurement in liver transplant recipients has not been standardized or rigorously studied. However, QOL measurement has the capacity to obtain “a full appreciation of the impact of illness and treatment” [58] given its reliance on the patient’s perspective. The premise of organ transplantation in general and liver transplantation in particular is to return people to a state of health wherein they can return to a productive, fulfilling existence. This notion is at the heart of QOL measurement.

This paper is the first to critically evaluate the existing QOL instruments that have been used in liver transplantation. We believe that a thorough appreciation of the strengths and weaknesses of existing QOL questionnaires is necessary to advance further research in this area. Of note, Tome and colleagues recently conducted a systematic review of quality of life outcomes after liver transplantation [60]. They identified 44 longitudinal studies that used a validated QOL instrument, 19 of which used the SF-36. Using a sign test on common domains for the longitudinal studies, they concluded that there was significant post-transplant improvement in general QOL, social functioning, physical health, and psychological health. While the Tome et al review is illustrative in its summary of this literature, it also highlights the diversity of QOL instruments in current use. Importantly, the lion’s share of these instruments has not been designed to assess the key symptoms and issues facing liver transplant recipients. With so many QOL instruments in use and without a clear sense of their psychometric strengths and weaknesses, it will continue to be difficult to aggregate liver transplant QOL findings in a meaningful way.

To address this need, we reviewed the wide variety of instruments that have been used to assess QOL in the liver transplant population. Generic health assessment questionnaires were most common and included the SF-36, the HADS, the BDI, the EQ-5D, and the SIP. These generic instruments have enabled researchers to make comparisons between both patients with chronic liver disease and liver transplant recipients and the general public. Initial validation studies of the generic health status instruments reported strong psychometric properties. However, these instruments were not developed specifically for liver transplant recipients, and consequently there is limited data available to assess their consistency, reliability and validity in this patient population. One notable exception is a study by Gralnek et al. demonstrating good internal consistency and construct validity of the SF-36 in a group of patients referred for transplant evaluation.

In addition, a particular advantage of the SF-36 and the EQ-5D is the ability of these instruments to obtain a utility index score. Utility measures are important for the determination of quality-adjusted life years (QALYs) used in cost-effectiveness studies. Of note, the SF-6D has been developed as a utility measure from the SF-36 [61]. This score can be determined from individual patient responses [61] or reported population scores on the eight domains [62]. The EQ-5D has also been frequently used for the computation of QALYs [63], [64].

In contrast to the generic instruments, targeted instruments are used less frequently (16% of included studies). However, the targeted instruments were evaluated specifically in patients with chronic liver disease and in liver transplant recipients. As such, they include elements that focus on disease-specific items. Therefore, estimates of consistency and reliability are more accurate for the population of interest: liver transplant recipients. However, the targeted instruments developed thus far are associated with their own shortfalls. For instance, the CLDQ and LDQOL were both designed to measure symptoms specific to chronic liver disease patients, not patients undergoing liver transplantation. Although the NIDDK QOL questionnaire attempted to overcome such deficiencies by including items addressing symptoms related to corticosteroid use, immunosuppressive regimens have changed significantly over time making these questions considerably less relevant.

None of the current targeted instruments address several key aspects specific to transplant recipients including issues related to post-surgical complaints such as incisional pain, hernia formation, scarring and disfigurement. Moreover, surgical patients may experience stresses related to concerns about associated complications of general anesthesia, the procedure itself, as well as concerns about disease-transmission from the donor. Transplant recipients may also experience ongoing anxiety related to both acute and chronic graft failure. Cancer risks, opportunistic infections, other side effects of immunosuppressive agents (e.g. new onset diabetes mellitus), and the risk of recurrence of primary liver disease are other highly relevant concerns. As stated above, the NIDDK QOL questionnaire attempted to address some specific concerns by including items assessing changes in facial appearance and appetite related to chronic corticosteroid use, but these concerns have become less relevant in the current immunosuppression era as most liver transplant recipients are not maintained on high dose corticosteroids in the long term with few notable exceptions. In contrast, a more relevant concern is that of nephrotoxicity leading to chronic renal insufficiency and ultimately the need for dialysis as a result of the pervasive utilization of calcineurin inhibitors [65].

Additionally, the landscape of potential complications has changed over time due to the increasing use of expanded criteria livers. For instance, livers from living donors as well as those from donation after cardiac death donors are associated with increased rates of biliary complications, which may result in significant negative effects on QOL [66], [67], [68]. In a sense, liver transplantation has become a victim of its own success, resulting in higher demand in the context of a limited supply of suitable donor organs. As a consequence of this growing discrepancy, sicker recipients are receiving expanded criteria grafts defined by inferior intrinsic organ quality [69], [70]. Although this use of expanded criteria grafts among sicker patients may still achieve acceptable survival outcomes, many of these patients require re-transplantation or survive with chronic complications and therefore diminished QOL. In addition, risk predictors in transplant recipients including the etiology of liver disease, recipient age and associated co-morbidities have changed over the past two decades. As the field of transplantation continues to evolve, patient-reported QOL outcomes need to be responsive to the consequences of different graft types, technical and surgical factors, immunosuppressive regimens, and recipient characteristics that may impact survivorship.

In addition to patient and graft survival, metrics based on QOL measurement, capturing the more subtle short- and long-term implications of liver transplantation, will be essential for providing improved patient care and for informing improved organ allocation policies. The recent Institute of Medicine report on survivorship highlights the ongoing health care needs of patients who survive cancer [71]. Similarly, patients who survive otherwise fatal, end-stage liver disease through organ transplantation may face issues best addressed through a chronic illness model of care. Transplant survivorship elicits a need for studies to adequately address the long-term health-related QOL needs of transplant recipients. Careful collection of QOL outcomes will provide for a more accurate assessment of both donor and recipient variables, including the use of expanded criteria grafts in specific recipient populations. Moreover, several studies have demonstrated that physicians are typically inaccurate in their estimates of patient QOL [40], [72], [73], [74]. Thus, a better understanding of the QOL implications of these complex circumstances should result in enhanced physician-patient communication, which has been shown to translate into improved treatment adherence and greater patient satisfaction [40], [73], [75].

Some limitations of this review must be noted. Several important indices necessary to evaluate the psychometric properties of the various QOL measures are not reported in the literature. For example, there is scarce data on the responsiveness over time for many of the instruments reviewed. Additionally, reliability estimates, while available in initial validation studies in non-transplant populations, were often lacking when the scale was used for liver transplant patients. Reliability is a property of a scale in a population and should be re-estimated when used in a new population. These shortcomings are primarily a function of the current state of the transplant QOL literature. The major strength of this review is its expansive look at the most prominent instruments in use, with special consideration for their strengths and deficiencies for measuring QOL in liver transplant candidates and recipients.

Back to Article Outline

5. Conclusions 

Based on our review, we conclude that there are no available instruments that allow for the precise and reliable assessment of the full QOL impact of liver transplantation. We have pointed out both the strengths and weaknesses of the generic and targeted instruments that have been commonly used in liver transplant candidates and recipients. We believe that these instruments do not address important issues such as surgical concerns, the effects of immunosuppressant medications, and donor and recipient variables that may impact QOL in liver transplant recipients. The most direct approach to remedy this shortcoming is the development of a liver transplant specific QOL instrument that draws on aspects of existing instruments for end-stage liver disease with modifications and/or additions based on input from liver transplant recipients, surgeons, hepatologists, and the existing literature. The consistent application of validated, treatment-specific QOL instruments will allow for a more accurate assessment of the impact of different donor, recipient and treatment factors. A full understanding of not only survival benefit but of QOL benefit will guide us towards improved patient care and more judicious organ allocation decisions.

Back to Article Outline

Acknowledgements 

Research for this paper was done in part while the lead author was a National Research Service Award postdoctoral fellow with the Division of Organ Transplantation at Northwestern University, Feinberg School of Medicine under an institutional award from the National Institute of Diabetes and Digestive and Kidney Diseases, 5 T32 DK077662-02 (PI: Michael Abecassis, MD MBA).

Back to Article Outline

Appendix A. Supplementary data 

Back to Article Outline

References 

  1. 2007 Annual Report of the U.S. Organ Procurement and Transplantation Network and the Scientific Registry of Transplant Recipients: Transplant Data 1997–2006. Health Resources and Services Administration, Healthcare Systems Bureau, Division of Transplantation 2007.
  2. Constitution of World Health Organization. World Health Organization 1948.
  3. Atherton PJ, Sloan JA, Atherton PJ, Sloan JA. Rising importance of patient-reported outcomes. Lancet Oncol. 2006;7:883–884
  4. Leidy NK, Beusterien K, Sullivan E, Richner R, Muni NI. Integrating the patient’s perspective into device evaluation trials. Value Health. 2006;9:394–401
  5. Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB, et al. Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther. 1996;18:979–992
  6. Coons SJ, Rao S, Keininger DL, Hays RD. A comparative review of generic quality-of-life instruments. Pharmacoeconomics. 2000;17:13–35
  7. Colonna JO 2nd, Brems JJ, Hiatt JR, Millis JM, Ament ME, Baldrich-Quinones WJ, et al. The quality of survival after liver transplantation. Transplant Proc. 1988;20:594–597
  8. Brazier JE, Harper R, Jones NM, O’Cathain A, Thomas KJ, Usherwood T. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ. 1992;305:160–164
  9. Hellgren A, Berglund B, Gunnarsson U, Hansson K, Norberg U, Bäckman L. Health-related quality of life after liver transplantation. Liver Transplant Surg. 1998;4:215–221
  10. McHorney CA, Ware JE, Lu JF, Sherbourne CD. The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care. 1994;32:40–66
  11. McHorney CA, Ware JE, Raczek AE. The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care. 1993;31:247–263
  12. Stewart AL, Hays RD, Ware JE. The MOS short-form general health survey. Reliability and validity in a patient population. Med Care. 1988;26:724–735
  13. Gralnek IM, Hays RD, Kilbourne A, Rosen HR, Keeffe EB, Artinian L, et al. Development and evaluation of the Liver Disease Quality of Life instrument in persons with advanced, chronic liver disease – the LDQOL 1.0. Am J Gastroenterol. 2000;95:3552–3565
  14. Knechtle SJ, Fleming MF, Barry KL, Steen D, Pirsch JD, D’Alessandro AM, et al. Liver transplantation in alcoholics: assessment of psychological health and work activity. Transplant Proc. 1993;25:1916–1918
  15. Phillips AL, Walker EL, Martin JE, First MR, Hanto DW, Whiting JF. Quality of life as a predictor of morbidity, mortality, and resource utilization after solid-organ transplant. Transplant Proc. 2001;33:1886
  16. Goetzmann L, Klaghofer R, Wagner-Huber R, Halter J, Boehler A, Muellhaupt B, et al. Quality of life and psychosocial situation before and after a lung, liver or an allogeneic bone marrow transplant. Swiss Med Wkly. 2006;136:281–290
  17. Krasnoff JB, Vintro AQ, Ascher NL, Bass NM, Dodd MJ, Painter PL. Objective measures of health-related quality of life over 24 months post-liver transplantation. Clin Transplant. 2005;19:1–9
  18. Ratcliffe J, Longworth L, Young T, Bryan S, Burroughs A, Buxton M. Cost-effectiveness of liver transplantation team. Assessing health-related quality of life pre and post-liver transplantation: a prospective multicenter study. Liver Transpl. 2002;8:263–270
  19. Tolba RH, Wrigge B, Machein U, Minor T, Kalff JC, Hirner A, et al. Conversion to Neoral for tacrolimus-related adverse effects in liver transplant recipients and improvement in quality of life. Transplant Proc. 2001;33:3446–3447
  20. Kanwal F, Hays RD, Kilbourne AM, Dulai GS, Gralnek IM. Are physician-derived disease severity indices associated with health-related quality of life in patients with end-stage liver disease?. Am J Gastroenterol. 2004;99:1726–1732
  21. Saab S, Ibrahim AB, Shpaner A, Younossi ZM, Lee C, Durazo F, et al. MELD fails to measure quality of life in liver transplant candidates. Liver Transplant. 2005;11:218–223
  22. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67:361–370
  23. Moorey S, Greer S, Watson M, Gorman C, Rowden L, Tunmore R, et al. The factor structure and factor stability of the hospital anxiety and depression scale in patients with cancer. Br J Psychiatry. 1991;158:255–259
  24. Upadhyaya AK, Stanley I. Hospital anxiety depression scale. Br J Gen Pract. 1993;43:349–350
  25. Aylard PR, Gooding JH, McKenna PJ, Snaith RP. A validation study of three anxiety and depression self-assessment scales. J Psychosom Res. 1987;31:261–268
  26. Forsberg A, Lorenzon U, Nilsson F, Backmana L. Pain and health related quality of life after heart, kidney, and liver transplantation. Clin Transplant. 1999;13:453–460
  27. Nickel R, Wunsch A, Egle UT, Lohse AW, Otto G. The relevance of anxiety, depression, and coping in patients after liver transplantation. Liver Transplant. 2002;8:63–71
  28. Goetzmann L, Wagner-Huber R, Klaghofer R, Muellhaupt B, Clavien PA, Buddeberg C, et al. Waiting for a liver transplant: psychosocial well-being, spirituality, and need for counselling. Transplant Proc. 2006;38:2931–2936
  29. Goetzmann L, Klaghofer R, Wagner-Huber R, Halter J, Boehler A, Muellhaupt B, et al. Psychosocial vulnerability predicts psychosocial outcome after an organ transplant: results of a prospective study with lung, liver, and bone-marrow patients. J Psychosom Res. 2007;62:93–100
  30. Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4:561–571
  31. Metcalfe M, Goldman E. Validation of an inventory for measuring depression. Br J Psychiatry. 1965;111:240–242
  32. Singh N, Gayowski T, Wagener MM, Marino IR. Depression in patients with cirrhosis. Impact on outcome. Dig Dis Sci. 1997;42:1421–1427
  33. Santos Junior R, Miyazaki MC, Domingos NA, Valério NI, Silva RF, Silva RC. Patients undergoing liver transplantation: psychosocial characteristics, depressive symptoms, and quality of life. Transplant Proc. 2008;40:802–804
  34. Riether AM, Smith SL, Lewison BJ, Cotsonis GA, Epstein CM. Quality-of-life changes and psychiatric and neurocognitive outcome after heart and liver transplantation. Transplantation. 1992;54:444–450
  35. Mejı´as D, Ramı´rez P, Rı´os A, Munitiz V, Hernandez Q, Bueno F, et al. Recurrence of alcoholism and quality of life in patients with alcoholic cirrhosis following liver transplantation. Transplant Proc. 1999;31:2472–2474
  36. Anonymous . EuroQol – a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy. 1990;16:199–208
  37. Rabin R, de Charro F. EQ-5D: a measure of health status from the EuroQol group. Ann Med. 2001;33:337–343
  38. Brazier J, Jones N, Kind P. Testing the validity of the EuroQol and comparing it with the SF-36 health survey questionnaire. Qual Life Res. 1993;2:169–180
  39. Anderson RT, Aaronson NK, Wilkin D. Critical review of the international assessments of health-related quality of life. Qual Life Res. 1993;2:369–395
  40. Gutteling JJ, de Man RA, Busschbach JJ, Darlington AS. Overview of research on health-related quality of life in patients with chronic liver disease. Neth J Med. 2007;65:227–234
  41. Bryan S, Ratcliffe J, Neuberger JM, Burroughs AK, Gunson BK, Buxton MJ. Health-related quality of life following liver transplantation. Qual Life Res. 1998;7:115–120
  42. Ratcliffe J, Young T, Longworth L, Buxton M. An assessment of the impact of informative dropout and nonresponse in measuring health-related quality of life using the EuroQol (EQ-5D) descriptive system. Value Health. 2005;8:53–58
  43. Dobbels F, Vanhaecke J, Desmyttere A, Dupont L, Nevens F, De Geest S. Prevalence and correlates of self-reported pretransplant nonadherence with medication in heart, liver, and lung transplant candidates. Transplantation. 2005;79:1588–1595
  44. Ratcliffe J, Buxton M, Young T, Longworth L. Determining priority for liver transplantation: a comparison of cost per QALY and discrete choice experiment-generated public preferences. Appl Health Econ Health Policy. 2005;4:249–255
  45. Bergner M, Bobbitt RA, Carter WB, Gilson BS. The sickness impact profile: development and final revision of a health status measure. Med Care. 1981;19:787–805
  46. de Bruin AF, de Witte LP, Stevens F, Diederiks JP. Sickness impact profile: the state of the art of a generic functional status measure. Soc Sci Med. 1992;35:1003–1014
  47. Tarter RE, Switala J, Arria A, Plail J, Van Thiel D. Quality of life before and after orthotopic hepatic transplantation. Arch Int Med. 1991;151:1521–1526
  48. Tarter RE, Switala J, Arria A, Van Thiel DH. Impact of liver disease on daily living in transplantation candidates. J Clin Epidemiol. 1991;44:1079–1083
  49. Holzner B, Kemmler G, Kopp M, Dachs E, Kaserbacher R, Spechtenhauser B, et al. Preoperative expectations and postoperative quality of life in liver transplant survivors. Arch Phys Med Rehabil. 2001;82:73–79
  50. Belle SH, Porayko MK. Improvement in quality of life after transplantation for recipients in the NIDDK liver transplantation database. Transplant Proc. 1995;27:1230–1232
  51. Belle SH, Porayko MK, Hoofnagle JH, Lake JR, Zetterman RK. Changes in quality of life after liver transplantation among adults. National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) Liver Transplantation Database (LTD). Liver Transplant Surg. 1997;3:93–104
  52. Gross CR, Malinchoc M, Kim WR, Evans RW, Wiesner RH, Petz JL, et al. Quality of life before and after liver transplantation for cholestatic liver disease. Hepatology. 1999;29:356–364
  53. Kim WR, Lindor KD, Malinchoc M, Petz JL, Jorgensen R, Dickson ER. Reliability and validity of the NIDDK-QA instrument in the assessment of quality of life in ambulatory patients with cholestatic liver disease. Hepatology. 2000;32:924–929
  54. Cowling T, Jennings LW, Goldstein RM, Sanchez EQ, Chinnakotla S, Klintmalm GB, et al. Liver transplantation and health-related quality of life: scoring differences between men and women. Liver Transplant. 2004;10:88–96
  55. Kanwal F, Spiegel BM, Hays RD, Durazo F, Han SB, Saab S, et al. Prospective validation of the short form liver disease quality of life instrument. Aliment Pharmacol Ther. 2008;28:1088–1101
  56. Younossi ZM, Guyatt G, Kiwi M, Boparai N, King D. Development of a disease specific questionnaire to measure health related quality of life in patients with chronic liver disease. Gut. 1999;45:295–300
  57. Younossi ZM, McCormick M, Price LL, Boparai N, Farquhar L, Henderson JM, et al. Impact of liver transplantation on health-related quality of life. Liver Transplant. 2000;6:779–783
  58. Cella D, Nowinski CJ, Cella D, Nowinski CJ. Measuring quality of life in chronic illness: the functional assessment of chronic illness therapy measurement system. Arch Phys Med Rehabil. 2002;83:S10–S17
  59. Garratt A, Schmidt L, Mackintosh A, Fitzpatrick R. Quality of life measurement: bibliographic study of patient assessed health outcome measures. BMJ. 2002;324:1417
  60. Tome S, Wells JT, Said A, Lucey MR. Quality of life after liver transplantation. A systematic review. J Hepatol. 2008;48:567–577
  61. Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21:271–292
  62. Ara R, Brazier J. Predicting the Short Form-6D Preference-based index using the eight mean Short Form-36 health dimension scores: estimating preference-based health-related utilities when patient level data are not available. Value Health 2008 July 18 [Epub ahead of print].
  63. Günther OH, Roick C, Angermeyer MC, König HH. Responsiveness of EQ-5D utility indices in alcohol-dependent patients. Drug Alcohol Depend. 2008;92:291–295
  64. Scuffham PA, Whitty JA, Mitchell A, Viney R. The use of QALY weights for QALY calculations: a review of industry submissions requesting listing on the Australian Pharmaceutical Benefits Scheme 2002–4. Pharmacoeconomics 2008;26:297–310.
  65. Ojo AO, Held PJ, Port FK, Wolfe RA, Leichtman AB, Young EW, et al. Chronic renal failure after transplantation of a nonrenal organ. N Engl J Med. 2003;349:931–940
  66. Chan EY, Olson LC, Kisthard JA, Perkins JD, Bakthavatsalam R, Halldorson JB, et al. Ischemic cholangiopathy following liver transplantation from donation after cardiac death donors. Liver Transplant. 2008;14:604–610
  67. Foley DP, Fernandez LA, Leverson G, Chin LT, Krieger N, Cooper JT, et al. Donation after cardiac death: the University of Wisconsin experience with liver transplantation. Ann Surg. 2005;242:724–731
  68. Olthoff KM, Merion RM, Ghobrial RM, Abecassis MM, Fair JH, Fisher RA, et al. Outcomes of 385 adult-to-adult living donor liver transplant recipients: a report from the A2ALL Consortium. Ann Surg. 2008;242:314–323
  69. Feng S, Goodrich NP, Bragg-Gresham JL, Dykstra DM, Punch JD, DebRoy MA, et al. Characteristics associated with liver graft failure: the concept of a donor risk index. Am J Transplant. 2006;6:783–790
  70. Schaubel DE, Sima CS, Goodrich NP, Feng S, Merion RM. The survival benefit of deceased donor liver transplantation as a function of candidate disease severity and donor quality. Am J Transplant. 2008;8:419–425
  71. Institute of Medicine. Cancer care for the whole patient: Meeting psychosocial health needs. Washington, DC: The National Academy Press; 2007.
  72. Sprangers MA, Aaronson NK. The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease: a review. J Clin Epidemiol. 1992;45:743–760
  73. Fallowfield L, Ratcliffe D, Jenkins V, Saul J. Psychiatric morbidity and its recognition by doctors in patients with cancer. Br J Cancer. 2001;84:1011–1015
  74. Laine C, Davidoff F, Lewis CE, Nelson EC, Nelson E, Kessler RC, et al. Important elements of outpatient care: a comparison of patients’ and physicians’ opinions. Ann Int Med. 1996;125:640–645
  75. Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004;22:714–724
  76. Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed.. New York: McGraw-Hill; 1994;
  77. Fleiss JL. Statistical methods for rates and proportions. 2nd ed.. New York: Wiley; 1981;
  78. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174
  79. Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30:473–483
  80. Herrmann C. International experiences with the Hospital Anxiety and Depression Scale – a review of validation data and clinical results. J Psychosom Res. 1997;42:17–41
  81. Hurst NP, Kind P, Ruta D, Hunter M, Stubbings A. Measuring health-related quality of life in rheumatoid arthritis: validity, responsiveness and reliability of EuroQol (EQ-5D). Br J Rheumatol. 1997;36:551–559

 The authors who have taken part in this study declared that they do not have anything to disclose regarding funding from industry or conflict of interest with respect to this manuscript.

PII: S0168-8278(09)00472-3

doi:10.1016/j.jhep.2009.07.010

Journal of Hepatology
Volume 51, Issue 5 , Pages 949-959, November 2009