Journal of Pain and Symptom Management
Volume 39, Issue 2 , Pages 250-258 , February 2010

Evaluating Correlation and Interrater Reliability for Four Performance Scales in the Palliative Care Setting

  • Jeff Myers, MD, CCFP, MSEd

      Affiliations

    • Palliative Care Consult Team, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
    • Corresponding Author InformationAddress correspondence to: Jeff Myers, MD, CCFP, MSEd, Palliative Care Consult Team, Sunnybrook Health Sciences Centre, 2075 Bayview Avenue, Toronto, Ontario M4N 3M5, Canada.
    • ,
  • Kate Gardiner, BSc (C)

      Affiliations

    • Palliative Care Consult Team, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
    • ,
  • Kristin Harris, BSc (C)

      Affiliations

    • Rapid Response Radiotherapy, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
    • ,
  • Tammy Lilien, BA

      Affiliations

    • Palliative Care Consult Team, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
    • ,
  • Margaret Bennett, MD, CCFP

      Affiliations

    • Aging and Veteran's Program, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
    • ,
  • Edward Chow, MBBS, PhD, FRCPC

      Affiliations

    • Rapid Response Radiotherapy, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
    • ,
  • Debbie Selby, MD, FRCPC

      Affiliations

    • Palliative Care Consult Team, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
    • ,
  • Liying Zhang, PhD

      Affiliations

    • Palliative Care Consult Team, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada

,Accepted 13 July 2009.

References 

  1. Buccheri G, Ferrigno D, Tamburini M. Karnofsky and ECOG performance status scoring in lung cancer: a prospective, longitudinal study of 536 patients from a single institution. Eur J Cancer. 2002;32A:1135–1148
  2. Mor V, Laliberte L, Morris JN, Wiemann M. The Karnofsky Performance Status Scale. An examination of its reliability and validity in a research setting. Cancer. 1984;53:2002–2007
  3. Morita T, Tsunoda J, Inoue S, Chihara S. Improved accuracy of physicians' survival prediction for terminally ill cancer patients using the Palliative Prognostic Index. Palliat Med. 2001;15:419–424
  4. Taylor AE, Olver IN, Sivanthan T, Chi M, Purnell C. Observer error in grading performance status is cancer patients. Support Care Cancer. 1999;7:332–335
  5. Orr ST, Aisner J. Performance status assessment among oncology patients: a review. Cancer Treat Res. 1986;70:1423–1429
  6. Harrold J, Rickerson E, Carroll J, et al. Is the Palliative Performance Scale a useful predictor of mortality in a heterogeneous hospice population?. J Palliat Med. 2005;8:503–509
  7. Head B, Ritchie C, Smoot T. Prognostication in hospice care: can the Palliative Performance Scale help?. J Palliat Med. 2005;8:492–501
  8. Karnofsky DA, Abelmann WH, Craver LF, Burchenal JH. The use of nitrogen mustards in the palliative treatment of cancer. Cancer. 1948;1:634–656
  9. Zubrod CG, Schneiderman M, Frei E. Appraisal of methods for the study of chemotherapy of cancer in man: comparative therapeutic trial of nitrogen mustard and triethylene thiophosphoramide. J Chron Dis. 1960;11:7–33
  10. Abernethy AP, Shelby-James T, Fazekas BS, Woods D, Currow DC. The Australia-modified Karnofsky Performance Status (AKPS) scale: a revised scale for contemporary palliative care clinical practice. BMC Palliat Care. 2005;4:7
  11. Kassa T, Loomis J, Gillis K, Bruera E, Hanson J. The Edmonton Functional Assessment Tool: preliminary development and evaluation for use in palliative care. J Pain Symptom Manage. 1997;13:10–19
  12. Verger E, Salamero V, Conill C. Can Karnofsky Performance Status be transformed to the Eastern Cooperative Oncology Group scoring scale and vice versa?. Eur J Cancer. 1992;8:1328–1330
  13. Anderson F, Downing GM, Hill J, Casorso L, Lerch N. Palliative Performance Scale (PPS): a new tool. J Palliat Care. 1996;12:5–11
  14. Sorensen JB, Klee M, Palshof T, Hansen HH. Performance status assessment in cancer patients. An inter-observer variability study. Brit J Cancer. 1993;67:773–775
  15. Virik K, Glare P. Validation of the Palliative Performance Scale for inpatients admitted to a palliative care unit in Sydney, Australia. J Pain Symptom Manage. 2002;23:455–457
  16. Morita T, Tsunoda J, Inoue S, Chihara S. Survival prediction of terminally ill cancer patients by clinical symptoms: development of a simple indicator. Jpn J Clin Oncol. 1998;29:156–159
  17. Morita T, Tsunoda J, Inoue S, Chihara S. Validation of the Palliative Performance Scale from a survival perspective. J Pain Symptom Manage. 1999;18:2–3
  18. Ho F, Lau F, Downing MG, Lesperance M. A reliability and validity study of the Palliative Performance Scale. BMC Palliat Care. 2008;7:10
  19. Campos S, Zhang L, Sinclair E, et al. The Palliative Performance Scale: examining its inter-rater reliability in an outpatient palliative radiation oncology clinic. Support Care Cancer. 2009 Jun;17(6):685–690
  20. Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull. 1971;76:378–382
  21. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46
  22. Cicchetti DV, Allison T. A new procedure for assessing reliability of scoring EEG sleep recordings. Am J EEG Tech. 1971;11:101–109
  23. Brennan P, Silman A. Statistical methods for assessing observer variability in clinical measures. BMJ. 1992;304:1491–1494
  24. Conill C, Verger E, Salamero M. Performance status assessment in cancer patients. Cancer. 1990;65:1864–1866
  25. de Borja M, Chow E, Bovett G, Davis L, Gilles C. The correlation among patients and health care professionals in assessing functional status using the Karnofsky and Eastern Cooperative Oncology Group Performance Status scales. Support Cancer Ther. 2004;2:1–5
  26. Roila F, Lupatelli M, Sassi M, et al. Intra- and interobserver variability in cancer patients' performance status assessed according to Karnofsky and ECOG scales. Ann Oncol. 1991;2:437–439
  27. Yates JW, Chalmer B, McKegney FP. Evaluation of patients with advanced cancer using the Karnofsky Performance Status. Cancer. 1980;45:2220–2224
  28. Schag C, Heinruch R, Ganz P. Karnofsky Performance Status revisited: reliability, validity and guidelines. J Clin Oncol. 1994;2:187–193
  29. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174
  30. Graham P, Jackson R. The analysis of ordinal agreement data: beyond weighted kappa. J Clin Epidemiol. 1993;46:1055–1062
  31. Bloch DA, Kraemer HC. 2×2 kappa coefficients: measures of agreement or association. Biometrics. 1989;45:269–287
  32. Altman DG, Bland JM. Measurement in medicine: the analysis of method comparison studies. Statistician. 1983;32:307–317
  33. Nikoletti S, Porock D, Kristjanson LJ, et al. Performance status assessment in home hospice patients using a modified form of the Karnofsky Performance Status scale. J Palliat Med. 2000;3:301–311

PII: S0885-3924(09)01125-7

doi: 10.1016/j.jpainsymman.2009.06.013

Journal of Pain and Symptom Management
Volume 39, Issue 2 , Pages 250-258 , February 2010

Article Tools