Abstract
Introduction
Evidence-based practice (EBP) is an important aspect of healthcare work, but the clinical
implementation is complex. To be able to facilitate EBP implementation, valid measurement
of the “EBP status quo” is essential. Therefore, we aimed to identify valid tools
for EBP status assessment among occupational, physical and speech therapists in Germany.
Methods
The databases PubMed, Cochrane Library, PsycINFO, and CINAHL were systematically searched
from August 2011 until July 2022. Methodological quality and evidence level were scored
by two independent raters via: i) the COnsensus-based Standards for the selection
of health Measurement INstruments (COSMIN) checklist, ii) updated criteria for good
measurement properties, and iii) modified GRADE criteria.
Results
Overall, 57 reports describing the development or validation of 31 EBP questionnaires
were included. Six questionnaires showed “sufficient” evidence for content validity,
three questionnaires showed “sufficient” evidence for reliability, two questionnaires
showed “sufficient” evidence for structural validity as well as internal consistency,
and nine questionnaires showed “sufficient” evidence for construct validity. Most
questionnaires demonstrated moderate or low-quality evidence for the psychometric
properties tested.
Discussion
Overall, the present review found a lack of sufficient evidence on the psychometric
properties of most questionnaires. The Evidence-Based Practice Inventory (EBPI), the
Evidence-based Practice Confidence (EPIC) scale and the Health Sciences-Evidence-Based
Practice (HS-EBP) questionnaire were the only questionnaires with “sufficient” content
validity and, in addition, “sufficient” reliability or “sufficient” internal consistency.
Conclusion
Although a lack of high-quality psychometric properties of EBP tools became apparent,
the EBPI, the EPIC scale and the HS-EBP questionnaire currently appear to be the best
validated tools to assess EBP behavior/attitude and implementation in occupational,
physical and speech therapists.
Zusammenfassung
Hintergrund
Evidenzbasierte Praxis (EBP) ist ein wichtiger Aspekt der Arbeit im Gesundheitswesen.
Die Umsetzung im Bereich der Gesundheitsfachberufe unterliegt allerdings komplexen
Bedingungen. Um eine effiziente Implementierung in der Praxis zu erreichen, bedarf
es einer zuverlässigen Evaluation des „EBP-Status quo“. Eine Identifizierung valider
Instrumente zur Erfassung des EBP-Status für Ergo-, Physio- und Sprachtherapeut*innen
in Deutschland soll hierzu beitragen.
Methode
Die Datenbanken PubMed, Cochrane Library, PsycINFO und CINAHL wurden von August 2011
bis Juli 2022 systematisch durchsucht. Die methodologische Qualität sowie die Evidenzklasse
wurden von zwei unabhängigen Gutachtenden mittels der COSMIN-Checkliste (COnsensus-based
Standards for the selection of health Measurement Instruments), ii) den zugehörigen
aktualisierten Kriterien zur Bewertung von Messeigenschaften und iii) adaptierten
GRADE-Kriterien bewertet.
Ergebnisse
Es wurden insgesamt 57 Publikationen eingeschlossen, in denen die Entwicklung oder
Validierung von 31 EBP-Fragebögen beschrieben wurde. Sechs Fragebögen wiesen eine
„ausreichende“ Evidenz für die Inhaltsvalidität auf, drei Fragebögen wiesen eine „ausreichende“
Evidenz für die Reliabilität auf, zwei Fragebögen wiesen eine „ausreichende“ Evidenz
für die strukturelle Validität sowie die interne Konsistenz auf, und neun Fragebögen
wiesen eine „ausreichende“ Evidenz für die Konstruktvalidität auf. Die meisten Fragebögen
zeigten eine moderate bis geringe Qualität der Evidenz in Bezug auf die getesteten
psychometrischen Eigenschaften.
Diskussion
Insgesamt wurde in dem vorliegenden Review festgestellt, dass für die psychometrischen
Eigenschaften der meisten Fragebögen keine ausreichende Evidenz vorliegt. Das Evidence-Based
Practice Inventory (EBPI), die Evidence-Based Practice Confidence (EPIC)-Skala und
der Health-Sciences Evidence-Based Practice (HS-EBP) Questionnaire waren die einzigen
Fragebögen, die eine „ausreichende“ Inhaltsvalidität und darüber hinaus eine „ausreichende“
Reliabilität oder eine „ausreichende“ interne Konsistenz aufwiesen.
Schlussfolgerung
Obwohl ein Mangel an qualitativ hochwertigen psychometrischen Eigenschaften von EBP-Fragebögen
deutlich wurde, scheinen das EBPI, die EPIC-Skala und der HS-EBP derzeit die am besten
validierten Instrumente zur Bewertung von EBP-Verhalten/Einstellung und -Umsetzung
bei Ergo-, Physio- und Sprachtherapeut*innen zu sein.
Keywords
Schlüsselwörter
Abbreviations:
AFT (Adapted Fresno Test), COSMIN (COnsensus-based Standards for the selection of health Measurement Instruments), EBP (Evidence-based Practice), EBPAS (Evidence-based Practice Attitude Scale), EBPCBS (Evidence-based Practice Capabilities Beliefs Scale), EBPI (Evidence-based Practice Inventory), EBPIS (EBP Implementation Scale), EPIC (Evidence-based practice confidence scale), EROS (Edmonton Research Orientation Survey), GRADE (Grading of Recommendations Assessment Development and Evaluation), HS-EBP (Health-Sciences Evidence-Based Practice Questionnaire), OSF (Open Science Framework), PROMs (Patient-Reported Outcome Measures), RoB (Risk of Bias)To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Zeitschrift für Evidenz, Fortbildung und Qualität im GesundheitswesenAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Evidence-Based Medicine: How to Practice and Teach EBM.2nd ed. Churchill Livingstone, Edinburgh2000
- Evidence-based nursing practice-Opinions on the status quo.Z Evid Fortbild Qual Gesundhwes. 2013; 107: 30-35https://doi.org/10.1016/j.zefq.2012.12.001
- Tools to assess evidence-based practice behaviour among healthcare professionals.Evid Based Med. 2013; 18: 129-138https://doi.org/10.1136/eb-2012-100969
“Gesundheitsfachberufe Hochschulverbundes (HVG), Verbund für Ausbildung und Studium in den Therapieberufen, Notwendigkeit und Umsetzung einer vollständig hochschulischen Ausbildung in den Therapieberufen (Ergotherapie, Logopädie und Physiotherapie),” 2018.
- Evidenzbasierung in den Gesundheitsberufen.in: Springer Ref. Pfl. – Ther. – Gesundheit. Springer, Berlin Heidelberg2019: 1-7
“Studierende an Hochschulen, Sommersemester 2019, Statistisches Bundesamt,” 2020. https://www.statistischebibliothek.de/mir/receive/DEHeft_mods_00128348 (accessed Sep. 17, 2022).
“Berufliche Schulen, Schuljahr 2018/2019, Statistisches Bundesamt,” 2019. https://www.statistischebibliothek.de/mir/receive/DEHeft_mods_00128342 (accessed Sep. 17, 2022).
- COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study.Qual life Res an Int J Qual life Asp Treat care Rehabil. 2018; 27: 1159-1170https://doi.org/10.1007/s11136-018-1829-0
- Qualitative attributes and measurement properties of physical activity questionnaires: a checklist.Sports Med. 2010; 40: 525-537https://doi.org/10.2165/11531370-000000000-00000
- COSMIN guideline for systematic reviews of patient-reported outcome measures.Qual life Res an Int J Qual life Asp Treat care Rehabil. 2018; 27: 1147-1157https://doi.org/10.1007/s11136-018-1798-3
- The PRISMA 2020 statement: An updated guideline for reporting systematic reviews.BMJ. 2021; 372https://doi.org/10.1136/bmj.n71
- Evidence-Based Practice Attitude Scale EBPAS.Ment Health Serv Res. 2004; 6: 61-74
- The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content.BMC Med Res Methodol. 2010; 10: 22https://doi.org/10.1186/1471-2288-10-22
- COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures.Qual life Res an Int J Qual life Asp Treat care Rehabil. 2018; 27: 1171-1179https://doi.org/10.1007/s11136-017-1765-4
- The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument.Brazilian J Phys Ther. 2016; 20: 105-113https://doi.org/10.1590/bjpt-rbf.2014.0143
- Physiotherapists’ behaviour, attitudes, awareness, knowledge and barriers in relation to evidence-based practice implementation in Saudi Arabia: a cross-sectional study.Int J Evid Based Healthc. 2017; 15: 127-141https://doi.org/10.1097/XEB.0000000000000106
- Evidence-Based Practice Patterns Among Speech-Language Pathologists and Audiologists in Saudi Arabia.Commun Disord Q. 2019; 41: 242-249https://doi.org/10.1177/1525740119843681
- Occupational therapists’ involvement views, and training needs of evidence-based practice: a rural perspective.Int J Ther Rehabil. 2012; 19: 618-628https://doi.org/10.12968/ijtr.2012.19.11.618
- Evidence-based Practice (EBP): beliefs, knowledge and behavior of physiotherapists. A survey research.J Adv Heal Care. 2021; : 19-35https://doi.org/10.36017/jahc2105-005
- Evidenzbasierte Praxis: Einstellungen, Kompetenzen, Barrieren und Arbeitszufriedenheit österreichischer Ergotherapeuten - eine Umfrage.Ergoscience. 2015; 10: 97-107
- Reliability of the Swedish version of the Evidence-Based Practice Attitude Scale assessing physiotherapist’s attitudes to implementation of evidence-based practice.PLoS One. 2019; 14: e0225467
- Survey of Attitudes, Knowledge, and Barriers to Evidence-Based Practice Among Thai Physical Therapists.Internet J Allied Heal Sci Pract. 2020; 18: pphttps://doi.org/10.46743/1540-580x/2020.1878
- Translation of the evidence-based practice confidence (EPIC) scale into German and its cross-cultural adaption for Switzerland, Austria and Germany.Z Evid Fortbild Qual Gesundhwes. 2019; 149: 57-65https://doi.org/10.1016/j.zefq.2019.11.005
- Applying modern measurement approaches to constructs relevant to evidence-based practice among Canadian physical and occupational therapists.Implement Sci. 2018; 13: 152https://doi.org/10.1186/s13012-018-0844-4
- Determinants of guideline use in primary care physical therapy: a cross-sectional survey of attitudes, knowledge, and behavior.Phys Ther. 2014; 94: 343-354https://doi.org/10.2522/ptj.20130147
- Capability beliefs on, and use of evidence-based practice among four health professional and student groups in geriatric care: A cross sectional study.PLoS One. 2018; 13: e0192017
- Evidence-based physiotherapy clinical practice in the public health-care service in Ecuador.Physiother Res Int. 2019; 24: e1745
- Evidence-based practice by physiotherapists in UAE: Investigating behavior, attitudes, awareness, knowledge and barriers.PLoS One. 2021; 16: pphttps://doi.org/10.1371/journal.pone.0253215
- Assessment of Core Competencies of Physical Therapists Among Students and Professionals in Italy: A Cross-Sectional Study.J Allied Health. 2018; 47: 133-140
- A survey of evidence-based practise among Dutch occupational therapists.Occup Ther Int. 2012; 19: 17-27https://doi.org/10.1002/oti.324
- Information behaviour of French-speaking speech-language therapists in Belgium: results of a questionnaire survey.Health Info Libr J. 2016; 33: 61-76https://doi.org/10.1111/hir.12118
- Research evidence uptake in a developing country: a survey of attitudes, education and self-efficacy, engagement, and barriers among physical therapists in the Philippines.J Eval Clin Pract. 2013; 19: 782-790https://doi.org/10.1111/j.1365-2753.2012.01849.x
- New Zealand occupational therapists’ views on evidence-based practice: a replicated survey of attitudes, confidence and behaviours.Aust Occup Ther J. 2013; 60: 120-128https://doi.org/10.1111/1440-1630.12000
- Longitudinal evaluation of a knowledge translation role in occupational therapy.BMC Health Serv Res. 2019; 19: 154https://doi.org/10.1186/s12913-019-3971-y
- Attitudes of mental health occupational therapists toward evidence-based practice.Can J Occup Ther. 2016; 83: 27-32https://doi.org/10.1177/0008417415583108
- Perceptions of physiotherapists towards research: a mixed methods study.Physiotherapy. 2016; 102: 210-216https://doi.org/10.1016/j.physio.2015.04.007
- What are the primary influences on treatment decisions? How does this reflect on evidence-based practice? Indications from the discipline of speech and language therapy.J Eval Clin Pract. 2015; 21: 1178-1189https://doi.org/10.1111/jep.12385
- Reported use of evidence in clinical practice: a survey of rehabilitation practices in Norway.BMC Health Serv Res. 2018; 18: 379https://doi.org/10.1186/s12913-018-3193-8
- Twenty-five years after the introduction of Evidence-based Medicine: knowledge, use, attitudes and barriers among physiotherapists in Italy - a cross-sectional study.BMJ Open. 2020; 10https://doi.org/10.1136/bmjopen-2020-037133
- Increasing knowledge of best practices for occupational therapists treating post-stroke unilateral spatial neglect: results of a knowledge-translation intervention study.J Rehabil Med. 2012; 44: 118-124https://doi.org/10.2340/16501977-0910
- Evidence-based practice supports among Canadian occupational therapists: Enquête sur les mécanismes de soutien de la pratique fondée sur les données probantes offerts aux ergothérapeutes canadiens.Can J Occup Ther. 2014; 81: 79-92
- Exploring attitudes about evidence-based practice among speech-language pathologists: A survey of Japan and Malaysia.Int J Speech Lang Pathol. 2021; 23: 662-671https://doi.org/10.1080/17549507.2021.1877816
- Evidence-based practice in physical therapy in Austria: current state and factors associated with EBP engagement.J Eval Clin Pract. 2015; 21: 1219-1234https://doi.org/10.1111/jep.12415
- Physiotherapists’ Evidence-Based Practice profiles by HS-EBP questionnaire in Spain: A cross-sectional normative study.PLoS One. 2022; 17: e0269460
- Evidence-based practice and clinical reasoning in occupational therapy: A cross-sectional survey in Chile.Aust Occup Ther J. 2021; 68: 169-179https://doi.org/10.1111/1440-1630.12713
- Evidence-based practice in speech-language pathology: Where are we now?.Am J Speech-Language Pathol. 2021; 30: 186-198https://doi.org/10.1044/2020_AJSLP-20-00194
- Attitudes Toward Adoption of Evidence-Based Practice Among Physical Therapists and Social Workers: A Lesson for Interprofessional Continuing Education.J Contin Educ Health Prof. 2017; 37: 37-45https://doi.org/10.1097/CEH.0000000000000139
- Evidence-Based Practice in Primary Care Occupational Therapy: A Cross-Sectional Survey in Sweden.Occup Ther Int. 2018; 2018: 5376764https://doi.org/10.1155/2018/5376764
- Capability Beliefs Regarding Evidence-Based Practice are Associated with Application of EBP and Research Use: Validation of a New Measure.Worldviews Evidence-Based Nurs. 2012; 9: 139-148https://doi.org/10.1111/j.1741-6787.2012.00248.x
- Organizational Culture and Climate and Mental Health Provider Attitudes Toward Evidence-Based Practice.Psychol Serv. 2006; 3: 61-72https://doi.org/10.1037/1541-1559.3.1.61
- Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale in a geographically diverse sample of community mental health providers.Adm Policy Ment Health. 2007; 34: 465-469https://doi.org/10.1007/s10488-007-0127-x
- Reliability and validity of the Evidence-Based practice confidence (EPIC) scale.J Contin Educ Health Prof. 2013; vol. 33(1), no. 1: 33-40https://doi.org/10.1002/chp.21164
- Validation of the Evidence-Based Practice Confidence (EPIC) Scale With Occupational Therapists.Am J Occup Ther. 2016; 70https://doi.org/10.5014/ajot.2016.017061
- Evidence based practice beliefs and implementation among nurses: a cross-sectional study.BMC Nurs. 2014; 13: 8
- Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation.PLoS One. 2017; 12: e0177172
- Cross-cultural adaptation, internal consistency, test-retest reliability and feasibility of the German version of the evidence-based practice inventory.BMC Health Serv Res. 2019; 19: 455https://doi.org/10.1186/s12913-019-4273-0
- Measuring evidence-based practice in physical therapy: translation, adaptation, further development, validation, and reliability test of a questionnaire.Phys Ther. 2013; 93: 819-832https://doi.org/10.2522/ptj.20120270
- The evidence-based practice beliefs and implementation scales: psychometric properties of two new instruments.Worldviews evidence-based Nurs. 2008; 5: 208-216https://doi.org/10.1111/j.1741-6787.2008.00126.x
- Evidence-based practice among speech-language pathologists: attitudes, utilization, and barriers.Am J speech-language Pathol. 2005; 14: 208-220https://doi.org/10.1044/1058-0360(2005/021)
- Content validity of a health science evidence-based practice questionnaire (HS-EBP) with a web-based modified Delphi approach.J Int Soc Qual Heal Care. 2016; 28: 764-773https://doi.org/10.1093/intqhc/mzw106
- Evidence-Based Practice and Standardized Outcome Measures: Egyptian Physical Therapists’ Beliefs, Perceptions and Adoption.World Appl Sci J. 2012; 16: 1282-1291
- Evidence-Based Practice: a survey regarding behavior, knowledge, skills, resources, opinions and perceived barriers of Brazilian physical therapists from São Paulo state.Brazilian J Phys Ther. 2015; 19: 294-303https://doi.org/10.1590/bjpt-rbf.2014.0102
- Implementation of evidence-based practice across medical, nursing, pharmacological and allied healthcare professionals: a questionnaire survey in nationwide hospital settings.Implement Sci. 2013; 8: 112https://doi.org/10.1186/1748-5908-8-112
- The ‘evidence-based practice inventory’: reliability and validity was demonstrated for a novel instrument to identify barriers and facilitators for Evidence Based Practice in health care.J Clin Epidemiol. 2015; 68: 1261-1269https://doi.org/10.1016/j.jclinepi.2015.06.002
- Development of an instrument to evaluate the research orientation of clinical professionals.Can J Rehabil. 1996; : 93-100
- Registered nurses’ application of evidence-based practice: a national survey.J Eval Clin Pract. 2009; 15: 1159-1163https://doi.org/10.1111/j.1365-2753.2009.01316.x
- Adaptación al castellano y validación del cuestionario sobre práctica basada en la evidencia en fisioterapeutas.Fisioterapia. 2012; 34: 65-72https://doi.org/10.1016/j.ft.2011.10.003
- Evidence-based practice: beliefs, attitudes, knowledge, and behaviors of physical therapists.Phys Ther. 2003; 83: 786-805
- Information in practice based medicine : a questionnaire survey.EvidenceBased Med. 2009; 316: 361-367
- Practitioner and organizational barriers to evidence-based practice of physical therapists for people with stroke.Phys Ther. 2007; 87: 1284-1303https://doi.org/10.2522/ptj.20070040
- Creation and validation of the evidence-based practice confidence scale for health care professionals.J Eval Clin Pract. 2011; 17: 794-800https://doi.org/10.1111/j.1365-2753.2010.01478.x
- Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS).Ment Health Serv Res. 2004; 6: 61-74https://doi.org/10.1023/b:mhsr.0000024351.12294.65
- Evidence-based practice by physiotherapists in UAE: Investigating behavior, attitudes, awareness, knowledge and barriers.PLoS One. 2021; 16
- The Adapted Fresno Test of competence in evidence-based practice.J Contin Educ Health Prof. 2009; 29: 119-126https://doi.org/10.1002/chp.20021
- The organizational context of children’s mental health services.Clin Child Fam Psychol Rev. 2002; 5: 233-253https://doi.org/10.1023/a:1020972906177
D.E. Beaton, C. Bombardier, F. Guillemin, and M. B. Ferraz, “Recommendations for the Cross-Cultural Adaptation of the DASH \& QuickDASH Outcome Measures,” 2007.
- Current concepts in validity and reliability for psychometric instruments: theory and application.Am J Med. 2006; 119 (166.e7-16)https://doi.org/10.1016/j.amjmed.2005.10.036
- Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured.BMC Med Educ. 2018; 18: 177https://doi.org/10.1186/s12909-018-1284-1
- Survey Instruments for Knowledge, Skills, Attitudes and Behaviour Related to Evidence-based Practice in Occupational Therapy: A Systematic Review.Occup Ther Int. 2016; 23: 59-90https://doi.org/10.1002/oti.1398
- Measures of knowledge and skills for evidence-based practice: a systematic review.Can J Occup Ther. 2010; 77: 219-232https://doi.org/10.2182/cjot.2010.77.4.4
Article info
Publication history
Published online: January 24, 2023
Accepted:
November 11,
2022
Received in revised form:
October 27,
2022
Received:
April 12,
2022
Publication stage
In Press Corrected ProofIdentification
Copyright
© 2023 Published by Elsevier GmbH.
