PM&R
Volume 1, Issue 10 , Pages 941-950 , October 2009

Beyond the Evidence-Based Practice Paradigm to Achieve Best Practice in Rehabilitation Medicine: A Clinical Review

Presented as an instructional course at the: 2006 NRH RRTC on Secondary Conditions after SCI State of the Science Conference, 2007 Annual Meeting of the American Spinal Injury Association (ASIA)

  • Suzanne L. Groah, MD, MSPH

      Affiliations

    • Department of Physical Medicine and Rehabilitation, National Rehabilitation Hospital, 102 Irving Street, NW, Washington, DC 20010†
    • Corresponding Author InformationAddress correspondence to: S.L.G.
    • ,
  • Alexander Libin, PhD

      Affiliations

    • Medstar Research Institute and the NRH Neuroscience Research Center, National Rehabilitation Hospital, Washington, DC‡
    • ,
  • Manon Lauderdale, MSE

      Affiliations

    • Medstar Research Institute and the NRH Neuroscience Research Center, National Rehabilitation Hospital, Washington, DC§
    • ,
  • Thilo Kroll, PhD

      Affiliations

    • University of Dundee, Alliance for Self Care Research, Department of Nursing & Midwifery, Dundee, Scotland
    • ,
  • Gerben DeJong, PhD

      Affiliations

    • Center for Post-Acute Studies, National Rehabilitation Hospital, Washington, DC∥
    • ,
  • Jean Hsieh, PhD

      Affiliations

    • Center for Post-Acute Studies, National Rehabilitation Hospital, Washington, DC#

Received 30 December 2008 ,Accepted 1 June 2009.

References 

  1. Davis D, Evans M, Jadad A, et al. The case for knowledge translation: Shortening the journey from evidence to effect. Br Med J. 2003;327:33–35
  2. Grol R. Twenty years of implementation research. Fam Prac. 2000;17:S32–S35
  3. Grol R, Grimshaw J. From best evidence to best practice: Effective implementation of change in patients' care. Lancet. 2003;362:1225–1230
  4. The INFO Project Best Practices Signpost (Johns Hopkins Bloomberg School of Public Health Website). http://www.infoforhealth.org/practices.shtmlAccessed May 6, 2009.
  5. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: What it is and what it isn't. [Editorial] Br Med J. 1996;312:71–72
  6. US Department of Education, Office of Special Education and Rehabilitative Services, National Institute on Disability and Rehabilitation Research, NIDRR Long-Range Plan For Fiscal Years 2005-09: Executive Summary. Washington, DC, 2007.
  7. FOCUS Technical Brief No. 10. What is knowledge translation? (National Center for the Dissemination of Disability Research Website). http://www.ncddr.org/kt/products/focus/focus10/2005;Accessed May 6, 2009.
  8. Ketelaar M, Russell DJ, Gorter JW. The challenge of moving evidence-based measures into clinical practice: Lessons in knowledge translation. Phys Occ Ther Ped. 2009;28:191–206
  9. Grol R. Changing physicians' competence and performance: Finding the balance between the individual and the organization. J Cont Ed Health Prof. 2002;22:244–251
  10. Grol R, Wensing M. What drives change? (Barriers to and incentives for achieving evidence-based practice). Med J Austr. 2004;180:S57–S60
  11. Priority Areas for National Action: Transforming Health Care Quality (Institute of Medicine Website). http://www.machc.com/Documents/Public%20Forums/GLennda%20IOM%20Priority%20Areas%20_2_%20092105%20_2_.pdfJanuary 2003;Accessed March 4, 2009.
  12. Simon RI. Suicide risk assessment: What is the standard of care?. J Am Acad Psych Law. 2002;30:340–344
  13. Tator CH, Duncan EG, Edmonds VE, Lapczak LI, Andrews DF. Neurological recovery, mortality and length of stay after acute spinal cord injury associated with changes in management. Paraplegia. 1995;33:254–262
  14. Scivoletto G, Morganti B, Molinari M. Early versus delayed inpatient spinal cord injury rehabilitation: An Italian study. Arch Phys Med Rehabil. 2005;86:512–516
  15. Scivoletto G, Morganti B, Cosentino E, Molinari M. Utility of delayed spinal cord injury rehabilitation: An Italian study. Neurol Sci. 2006;27:86–90
  16. Nyein K, Thu A, Turner-Stokes L. Complex specialized rehabilitation following severe brain injury: A UK perspective. J Head Trauma Rehabil. 2007;22:239–247
  17. Goka RS, Arakaki AH. Brain injury rehabilitation; the continuum of care. J Insur Med. 1994;26:420–425
  18. Thomson TD, Taylor WJ. Evidence for inpatient rehabilitation as an effective intervention. Hosp Med. 2005;66:200–204
  19. Gray GE. The philosophy and methods of evidence-based medicine: An introduction for psychiatrists. Direct Psych. 2002;22:165–175
  20. Cochrane A. Effectiveness and Efficiency: Random Reflections on Health Services. London, UK: Royal Society of Medicine Press, Ltd; 1972;
  21. Rosenberg W, Donald A. Evidence based medicine: An approach to clinical problem solving. BMJ. 1995;310:1122–1126
  22. Sackett DL, Straus SE, Richardson WS, Rosenberg W, Haynes RB. Evidence-Based Medicine: How to Practice and Teach EBM. Toronto, Ontario: Churchill Livingstone; 2000;
  23. Cohen AM, Stavri PZ, Hersh WR. A categorization and analysis of the criticisms of evidence-based medicine. Int J Med Informatics. 2004;73:35–43
  24. Kohatsu ND, Robinson JG, Torner JC. Evidence-based public health. Am J Prev Med. 2004;27:417–421
  25. The Cochrane Collaboration. The Cochrane Collaboration Secretariat, Oxford, UK. http://www.cochrane.org/index.htmAccessed February 12, 2009.
  26. Sackett DL. Inference and decision at the bedside. J Clin Epidemiol. 1989;42:309–316
  27. Edlund W, Gronseth G, So Y, Franklin G. Clinical practice guidelines process manual – 2004 edition. St. Paul, MN: American Academy of Neurology; 2004;
  28. Centre for Reviews and Dissemination, University of York, York, UK. http://www.york.ac.uk/inst/crd/contact_general.htmAccessed December 18, 2008.
  29. The Grading of Recommendations Assessment, Development and Evaluation (short GRADE) Working Group Website. http://www.gradeworkinggroup.org/index.htmAccessed May 6, 2009.
  30. Estabrooks CA, Derksen L, Winther C, et al. The intellectual structure and substance of the knowledge utilization field: A longitudinal author co-citation analysis, 1945 to 2004. Implement Sci. 2008;13:49
  31. Rogers EM. Diffusion of Innovations. 5th ed.. New York: Free Press; 2003;
  32. Balas EA, Boren SA. Managing clinical knowledge for health care improvement. In:  Bemmel J,  McCray AT editor. Yearbook of Medical Informatics 2000: Patient-Centered Systems. Stuttgart, Germany: Schattauer Verlagsgesellschaft mbH; 2000;p. 65–70
  33. Shekelle PG, Ortiz E, Rhodes S, et al. Validity of the Agency for Healthcare Research and Quality Clinical Practice Guidelines: How quickly do guidelines become outdated?. JAMA. 2001;286:1461–1467
  34. Sudsawad P. Knowledge translation: Introduction to models, strategies, and measures. Austin, TX: Southwest Educational Development Laboratory, National Center for the Dissemination of Disability Research; 2002;
  35. Sudsawad P. Knowledge translation: Introduction to models, strategies, and measures. Austin, TX: Southwest Educational Development Laboratory, National Center for the Dissemination of Disability Research; 2007;
  36. Bennett S, Tooth L, McKenna K, et al. Perceptions of evidence based practice: A survey of Australian occupational therapists. Austr Occupat Ther J. 2003;50:13–22
  37. Meline T, Paradiso T. Evidence-based practice in schools: Evaluating research and reducing barriers. Lang Speech Hearing Serv Schools. 2003;34:273–283
  38. Metcalfe C, Lewin R, Wisher S, Perry S, Bannigan K, Moffett JK. Barriers to implementing the evidence based in for NHS therapies. Physiotherapy. 2001;11:433–441
  39. Nutley SM, Walter I, Davies HTO. Using evidence: How research can inform public services. Bristol, UK: The Policy Press; 2007;
  40. Canadian Institutes of Health Research. About knowledge translation: The KT Portfolio at CIHR (Canadian Institutes of Health Research, Ottawa, Ontario, Canada). http://www.cihr-irsc.gc.ca/e/29418.htmlAccessed February 12, 2009.
  41. Colantonio A, Knotos PC, Gilbert JE, Rossiter K, Gray J, Keightley ML. After the crash: Research-based theater for knowledge transfer. J Cont Educ Health Prof. 2008;28:180–185
  42. Gross DP, Lowe A. Evaluation of a knowledge translation initiative for physical therapists treating patients with work disability. Disabil Rehabil. 2008;26:1–9
  43. Hadouda S, Laroui HR, Lemay A, et al. Practice style traits of student occupational therapists and physical therapists. Can J Occup Ther. 2009;76:98–107
  44. Ketelaar M, Russell DJ, Gorter JW. The challenge of moving evidence-based measures into clinical practice: Lessons in knowledge translation. Phys Occup Ther Pediatr. 2008;28:191–206
  45. Kontos PC, Poland BD. Mapping new theoretical and methodological terrain for knowledge translation: Contributions from critical realism and the arts. Implement Sci. 2009;5:1
  46. Korner-Bitensky N, Menon-Nair A, Thomas A, Boutin E, Arafah AM. Practice style traits: Do they help explain practice behaviours of stroke rehabilitation professionals?. J Rehabil Med. 2007;39:685–692
  47. Lencucha R, Kothari A, Rouse M. The issue is – knowledge translation: A concept for occupational therapy?. Am J Occup Ther. 2007;61:593–596
  48. MacDermid JC, Solomon P, Law M, Russell D, Stratford P. Defining the effect and mediators of two knowledge translation strategies designed to alter knowledge, intent and clinical utilization of rehabilitation outcome measures: A study protocol. Implement Sci. 2006;4:1–14
  49. Thomas DC, Johnston B, Dunn K, et al. Continuing medical education, continuing professional development, and knowledge translation: Improving care of older patients by practicing physicians. J Am Geriatr Soc. 2006;54:1610
  50. Dobbins M, Robeson P, Ciliska D, et al. A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies. Implement Sci. 2009;4:23
  51. Grol R. Changing physicians' competence and performance: Finding the balance between the individual and the organization. J Cont Educ Health Prof. 2002;22:244–251
  52. Armstrong R, Waters E, Crockett B, Keleher H. The nature of evidence resources and knowledge translation for health promotion practitioners. Health Promot Int. 2007;22:254–260
  53. Spinal Cord Injury Rehabilitation Evidence: Version 2.0 (International Collaboration on Repair Discoveries Website). http://www.icord.org/scire/chapters.phpAccessed May 6, 2009.
  54. Cicerone KD. Evidence-based practice and the limits of rational rehabilitation. Arch Phys Med Rehabil. 2005;86:1073–1074
  55. Farkas M, Anthony WA. System transformation through best practices. Psych Rehabil J. 2006;30:87–88
  56. Ely JW, Osheroff JA, Ebell MH, et al. Obstacles to answering doctors' questions about patient care with evidence: qualitative study. Br Med J. 2002;324:710
  57. Wupperman R, Davis R, Obremskey WT. Level of evidence in spine compared to other orthopedic journals. Spine. 2007;32:388–393
  58. Norris SL, Atkins D. Challenges in using nonrandomized studies in systematic reviews of treatment interventions. Ann Intern Med. 2005;142:1112–1119
  59. Schlosser RW. Appraising the quality of systematic reviews (National Center for the Dissemination of Disability Research Website). http://www.ncddr.org/kt/products/focus/focus17/Focus17.pdfAccessed May 6, 2009.
  60. Shekelle PG, Morton SC, Suttorp MJ, Buscemi N, Friesen C. Challenges in systematic reviews of complementary and alternative medicine topics. Ann Intern Med. 2005;142:1042–1047
  61. Hartling L, McAlister FA, Rowe BH, Ezekowitz J, Friesen C, Klassen TP. Challenges in systematic reviews of therapeutic devices and procedures. Ann Intern Med. 2005;142:1100–1111
  62. Tatsioni A, Zarin DA, Aronson N, et al. Challenges in systematic reviews of diagnostic technologies. Ann Intern Med. 2005;142:1048–1055
  63. Dijkers M. When the best is the enemy of the good – The nature of research evidence used in systematic reviews and guidelines (National Center for the Dissemination of Disability Research Website). http://www.ncddr.org/webcasts/webcast13.htmlOctober 2008;Accessed May 6, 2009.
  64. Bracken MB. Pharmacological interventions for acute spinal cord injury. Cochrane Database Syst Rev. 2000;(2):CD001046.
  65. Bracken MB. Steroids for acute spinal cord injury. Cochrane Database Syst Rev. 2002;(3):CD001046.
  66. Bagnall AM, Jones L, Duffy S, Riemsma RP. Spinal fixation surgery for acute traumatic spinal cord injury. Cochrane Database Syst Rev. 2008 Jan 23;(1):CD004725.
  67. Chinnock P, Roberts I. Gangliosides for acute spinal cord injury. Cochrane Database Syst Rev. 2005;(2):CD004444.
  68. Taricco M, Adone R, Pagliacci C, Telaro E. Pharmacological interventions for spasticity following spinal cord injury. Cochrane Database Syst Rev. 2000;(2):CD001131.
  69. Mehrholz J, Kugler J, Pohl M. Locomotor training for walking after spinal cord injury. Cochrane Database Syst Rev. 2008;(2):CD006676.
  70. Wilt TJ, Carlson FK, Goldish GD, et al. Carbohydrate and lipid disorders and relevant considerations in persons with spinal cord injury. Evidence Report/Technology Assessment No. 163 (Prepared by the Minnesota Evidence-based Practice Center under Contract No. 290-02-0009.) AHRQ Publications No. 08-E0005. Rockville, MD: Agency for Healthcare Research and Quality; January 2008;
  71. Gassaway J, Horn SD, DeJong G, Smout RJ, Clark C, James R. Applying the clinical practice improvement approach to stroke rehabilitation: methods used and baseline results. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S16–S33
  72. Horn SD, DeJong G, Ryser DK, Veazie PJ, Teraoka J. Another look at observational studies in rehabilitation research: Going beyond the holy grail of the randomized controlled trial. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S8–S15
  73. DeJong G, Horn SD, Conroy B, Nichols D, Healton EB. Opening the black box of post-stroke rehabilitation: Stroke rehabilitation patients, processes, and outcomes. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S1–S7
  74. Horn SD, DeJong G, Smout RJ, Gassaway J, James R, Conroy B. Stroke rehabilitation patients, practice, and outcomes: Is earlier and more aggressive therapy better?. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S101–S114
  75. Maulden SA, Gassaway J, Horn SD, Smout RJ, DeJong G. Timing of initiation of rehabilitation after stroke. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S34–S40
  76. DeJong G, Horn SD, Smout RJ, Gassaway J, James R. The post-stroke rehabilitation project revisited. Arch Phys Med Rehabil. 2006;87:595–597
  77. Conroy B, Zorowitz R, Horn SD, Ryser DK, Teraoka J, Smout RJ. An exploration of central nervous system medication use and outcomes in stroke rehabilitation. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S73–S81
  78. Latham NK, Jette DU, Slavin M, et al. Physical therapy during stroke rehabilitation for people with different walking abilities. Arch Phys Med Rehabil. 2005;12(Suppl 2):S41–S50
  79. Richards LG, Latham NK, Jette DU, Rosenberg L, Smout RJ, DeJong G. Characterizing occupational therapy practice in stroke rehabilitation. Arch Phys Med Rehabil. 2005;12(Suppl 2):S51–S60
  80. Hatfield B, Millet D, Coles J, Gassaway J, Conroy B, Smout RJ. Characterizing speech and language pathology outcomes in stroke rehabilitation. Arch Phys Med Rehabil. 2005;12(Suppl 2):S61–S72
  81. Yin RK. Case Study Research (Design and Methods). 3rd edition. Applied social research method series. volume 5. Newbury Park, CA: Sage Publications; 2002;
  82. Flyvbjerg B. Five misunderstandings about case study research. Qualit Inq. 2006;12:219–245
  83. Baer DM, Wolf MM, Risley TR. Some current dimensions of applied behavior analysis. J Appl Behav Anal. 1968;1:91–97
  84. Hersen M, Barlow DH. Single Case Experimental Designs. New York: Pergamon Press; 1976;
  85. Libin A. Differential Psychology: Individual Approach in Education and Medicine. Moscow: Eksmo Educational; 2003;
  86. Center BA, Skiba RJ, Casey A. A methodology for the quantitative synthesis of intra-subject design research. J Spec Educ. 1986;19:387–400
  87. Huitema BA, McKean JW. Design specification issues in time-series intervention models. Educ Psychol Meas. 2000;60:38–58
  88. Van den Noortgarte W, Onghena P. Combining single-case experimental data using hierarchical linear models. School Psychol Q. 2003;18:325–346
  89. Van den Noortgarte W, Onghena P. Hierarchical linear models for the quantitative integration of effect sizes in single-case research. Behav Res Methods Instrum Comput. 2003;35:1–10
  90. Miller DW, Miller CG. On evidence, medical and legal. J Am Phys Surg. 2005;10:70–75
  91. Guidance for industry: good pharmacovigilance practices and pharmacoepidemiologic assessment (US Food and Drug Administration Center for Biologics Evaluation and Research). US Food and Drug Administration CBER Website, Rockville, MD http://www.fda.gov/cber/gdlns/pharmacovig.htmMarch 2005;Accessed February 12, 2009.
  92. Rust KL, Smith RO. Assistive technology in the measurement of rehabilitation and health outcomes: A review and analysis of instruments. Am J Phys Med Rehabil. 2005;84:780–793
  93. Walach H, Falkenberg T, Fonnebo V, Lewith G, Jonas WB. Circular instead of hierarchical: Methodological principles for the evaluation of complex interventions. BMC Med Res Methodol. 2006;6:29
  94. Daly J, Willis K, Small R, et al. A hierarchy of evidence for assessing qualitative health research. J Clin Epidemiol. 2007;60:43–49
  95. French J, Gronseth G. Lost in a jungle of evidence: We need a compass. Neurology. 2008;71:1634–1638
  96. Gross RA, Johnston KC. Levels of evidence: Taking Neurology to the next level. Neurology. 2009;72:8–10
  97. GRADE Working Group Website. http://www.gradeworkinggroup.org/Accessed October 29, 2008.
  98. Grade Working Group. Grading quality of evidence and strength of recommendations. Br Med J. 2004;328:1490
  99. National Center for the Dissemination of Disability Research. The NCDDR Website. http://www.ncddr.org/standards_over.htmlAccessed December 30, 2008.
  100. Nowotny H, Scott P, Gibbons M. Mode 2 revisited: The new production of knowledge. Minerva. 2003;42:179–194
  101. Estabrooks CA, Thompson DS, Lovely JJ, Hofmeyer A. A guide to knowledge translation theory. J Contin Educ Health Prof. 2006;26:25–36
  102. Upshur RE. Seven characteristics of medical evidence. J Eval Clin Pract. 2000;6:93–97
  103. Passo MH, Taylor J. Quality improvement in pediatric rheumatology: What do we need to do?. Curr Opin Rheum. 2008;20:625–630

 This project was funded by NIDRR grants #H133B031114, the NRH Rehabilitation Research and Training Center on SCI: Promoting Health and Preventing Complications through Exercise and #H133N060028, the National Capital Spinal Cord Injury Model System

 Disclosure Key can be found on the Table of Contents and at www.pmrjournal.org

PII: S1934-1482(09)00550-4

doi: 10.1016/j.pmrj.2009.06.001

PM&R
Volume 1, Issue 10 , Pages 941-950 , October 2009

Article Tools