The term evidence-based practice (EBP) refers to preferential use of mental and behavioral health interventions for which systematic empirical research has provided evidence of statistically significant effectiveness as treatments for specific problems. Alternate terms with the same meaning are evidence-based treatment (EBT) and empirically-supported treatment (EST). In recent years, EBP has been stressed by professional organizations such as the American Psychological Association and the American Occupational Therapy Association, which have also strongly encouraged their members to carry out investigations to provide evidence supporting or rejecting the use of specific interventions. Pressure toward EBP has also come from public and private health insurance providers, which have sometimes refused coverage of practices lacking in systematic evidence of usefulness.
Many areas of professional practice, such as medicine, psychology, psychiatry and so forth, have had periods in their pasts where practice was based on loose bodies of knowledge. Some of the knowledge was simply lore that drew upon the experiences of generations of practitioners, and much of it had no truly scientific evidence on which to justify various practices.
In the past this has often left the door open to quackery perpetrated by individuals who had no training at all in the domain, but who wished to convey the impression that they did for profit or other motives. As the scientific method became increasingly recognized as the means to provide sound validation for such methods, it became clear that there needed to be a way of excluding quack practitioners not only as a way of preserving the integrity of the field (particularly medicine), but also of protecting the public from the dangers of their "cures." Furthermore, even where overt quackery was not present, it was recognized that there was a value in identifying what actually does work so it could be improved and promoted.
Evidence based practice (EBP) is an approach which tries to specify the way in which professionals or other decision-makers should make decisions by identifying such evidence that there may be for a practice, and rating it according to how scientifically sound it may be. Its goal is to eliminate unsound or excessively risky practices in favour of those that have better outcomes.
EBP uses various methods (e.g. carefully summarizing research, putting out accessible research summaries, educating professionals in how to understand and apply research findings) to encourage, and in some instances to force, professionals and other decision-makers to pay more attention to evidence that can inform their decision-making. Where EBP is applied, it encourages professionals to use the best evidence possible, i.e. the most appropriate information available. For example, in medicine, it is used to make clinical decisions for individual patients. EBP promotes the collection, interpretation, and integration of valid, important and applicable patient-reported, clinician-observed, and research-derived evidence. The best available evidence, moderated by patient circumstances and preferences, is applied to improve the quality of clinical judgments and facilitate cost-effective care.
Best practices v. intuition
Evidence-based practice (EBP) involves complex and conscientious decision-making which is based not only on the available evidence but also on patient characteristics, situations, and preferences. It recognizes that care is individualized and ever changing and involves uncertainties and probabilities.
EBP develops individualized guidelines of best practices to inform the improvement of whatever professional task is at hand. Evidence-based practice is a philosophical approach that is in opposition to rules of thumb, folklore, and tradition. Examples of a reliance on "the way it was always done" can be found in almost every profession, even when those practices are contradicted by new and better information.
However, in spite of the enthusiasm for EBP evinced over the last decade or two, some authors have redefined EBP in ways that contradict, or at least add other factors to, the original emphasis on empirical research foundations. For example, EBP may be defined as treatment choices based not only on outcome research but also on practice wisdom (the experience of the clinician) and on family values (the preferences and assumptions of a client and his or her family or subculture) [ Buysse, V., & Wesley, P.W. (2006). Evidence-based practice: How did it emerge and what does it really mean for the early childhood field? Zero to Three, 27(2), 50-55. ] .
The theories of evidence based practice are becoming more commonplace in the nursing care. Nurses who are “baccalaureate prepared are expected to seek out and collaborate with other types of nurses to demonstrate the positives of a practice that is based on evidence. ”Looking at a few types of articles to examine how this type of practice has influenced the standard of care is important but rarely internally valid. None of the articles specify what their biases are. Evidence based practice has gotten its reputation by examining the reasons why any and all procedures, treatments, and medicines are given. This is important for refining practice so the goal of assuring patient safety is met. [cite journal |author=Duffy P, Fisher C, Munroe D |title=Nursing knowledge, skill, and attitudes related to evidenced based practice: Before or After Organizational Supports |journal=MEDSURG Nursing |month=Feb |year=2008 |volume=17 |issue=1 |pages=55-60] ]Research based evidence
Evidence-based design and development decisions are made after reviewing information from repeated rigorous data gathering instead of relying on rules, single observations, or custom.Fact|date=December 2007 Evidence-based medicine and evidence-based nursing practice are the two largest fields employing this approach. In psychiatry and community mental health, evidence-based practice guides have been created by such organizations as the Substance Abuse and Mental Health Services Administration and the Robert Wood Johnson Foundation, in conjunction with the National Alliance on Mental Illness. Evidence-based practice has now spread into a diverse range of areas outside of health where the same principles are known by names such as results-focused policy, managing for outcomes, evidence-informed practice etc.
This model of care has been studied for 30 years in universities and is gradually making its way into the public sector.Fact|date=December 2007 It effectively moves away from the old “medical model” (You have a disease, take this pill.) to a “evidence presented model” using the patient as the starting point in diagnosis. EBPs are being employed in the fields of health care, juvenile justice, mental health and social services among others. The theories of evidence based practice are becoming more commonplace in the nursing care. Nurses who are “baccalaureate prepared are expected to seek out and collaborate with other types of nurses to demonstrate the positives of a practice that is based on evidence.”
Key elements in using the best evidence to guide the practice of any professional include the development of questions using research-based evidence, the level and types of evidence to be used, and the assessment of effectiveness after completing the task or effort. One obvious problem with EBP in any field is the use of poor quality, contradictory, or incomplete evidence. Evidence-based practice continues to be a developing body of work for professions as diverse as education, psychology, economics, nursing, social work and architecture.
Psychology
According to Norcross et al. (2006) "the burgeoning evidence based practice movement in mental health attempts to identity, implement, and disseminate treatments that have been proven demonstrably effective according to the empirical evidence". However, Norcross et al. (2006) also state that perhaps it is more useful to identify what does not work. They conducted a survey rating experts opinions of "not at all discredited" to "certainly discredited" for a range of treatments. Examples of the range of discredited psychotherapies includes: angel therapy, the use of pyramid structures, orgone therapy, past lives therapy, chiropractic manipulation, neurolinguistic programming and Erhard Seminars Training. The limitation to the study was that some subjects may not have been discredited even though there was no evidence for efficacy. It was recommended that future polls take this into consideration, though the researchers concluded that the study does identify the dark side or "quack factor" of modern mental health practice.[Norcross, JC, Garofalo.A, Koocher.G. (2006) Discredited Psychological Treatments and Tests; A Delphi Poll. Professional Psychology; Research and Practice. vol37. No 5. 515-522 doi|10.1037/0735-7028.37.5.515] ]Levels of evidence and evaluation of research
Because conclusions about research results are made in a probabilistic manner, it is impossible to work with two simple categories of outcome research reports. Research evidence does not fall simply into "evidence-based" and "non-evidence-based" classes, but can be anywhere on a continuum from one to the other, depending on factors such as the way the study was designed and carried out. The existence of this continuum makes it necessary to think in terms of "levels of evidence", or categories of stronger or weaker evidence that a treatment is effective. To classify a research report as strong or weak evidence for a treatment, it is necessary to evaluate the quality of the research as well as the reported outcome [ Mercer, J., & Pignotti, M. (2007). Shortcuts cause errors in systematic research syntheses: Rethinking evaluation of mental health interventions. Scientific Review of Mental Health Practice, 5(2), 59-77. ] .
Evaluation of research quality can be a difficult task requiring meticulous reading of research reports and background information. It may not be appropriate simply to accept the conclusion reported by the researchers; for example, in one investigation of outcome studies, 70% were found to have stated conclusions unjustified by their research design [ Rubin, A., & Parrish, D. (2007). Problematic phrases in the conclusions of published outcome studies. Research on Social Work Practice, 17 (3), 334-347. ] .
Although early consideration of EBP issues by psychologists provided a stringent but simple definition of EBP, requiring two independent randomized controlled trials supporting the effectiveness of a treatment [ Chambless, D., & Hollon, S. (1998). Defining empirically supportable therapies. Journal of Consulting and Clinical Psychology, 66, 7-18. ] , it became clear that additional factors needed to be considered. These included both the need for lower but still useful levels of evidence, and the need to require even the "gold standard" randomized trials to meet further criteria.
A number of protocols for the evaluation of research reports have been suggested and will be summarized here. Some of these divide research evidence dichotomously into EBP and non-EBP categories, while others employ multiple levels of evidence. As the reader will see, although the criteria used by the various protocols overlap to some extent, they do not do so completely.
The Kaufman Best Practices Project approach did not use an EBP category per se, but instead provided a protocol for selecting the most acceptable treatment from a group of interventions intended to treat the same problems [ Kaufman Best Practices Project. (2004). Kaufman Best Practices Project Final Report: Closing the Quality Chasm in Child Abuse Treatment; Identifying and Disseminating Best Practices. Retrieved July 20, 2007, from http://academicdepartments.musc.edu/ncvc/resources_prof/reports_prof.thm.] . To be designated as "best practice", a treatment would need to have a sound theoretical base, general acceptance in clinical practice, and considerable anecdotal or clinical literature. This protocol also requires absence of evidence of harm,at least one randomized controlled study, descriptive publications, a reasonable amount of necessary training, and the possibility of being used in common settings. Missing from this protocol are the possibility of nonrandomized designs (in which clients or practitioners decide whether an individual will receive a certain treatment), the need to specify the type of comparison group used, the existence of confounding variables, the reliability or validity of outcome measures, the type of statistical analysis required, or a number of other factors required by some evaluation protocols [ Mercer, J., & Pignotti, M. (2007). Shortcuts cause errors in systematic research syntheses. Scientific Review of Mental Health Practice, 5(2), 59-77. ] .
A protocol suggested by Saunders et al. [ Saunders, B., Berliner, L., & Hanson, R. (2004). Child physical and sexual abuse: Guidelines for treatments. Retrieved September 15, 2006, from http://www.musc.edu/cvc.guidel.htm ] assigns research reports to six categories, on the basis of research design, theoretical background, evidence of possible harm,and general acceptance. To be classified under this protocol, there must be descriptive publications, including a manual or similar description of the intervention. This protocol does not consider the nature of any comparison group, the effect of confounding variables, the nature of the statistical analysis, or a number of other criteria. Interventions are assessed as belonging to Category 1, well-supported, efficacious treatments, if there are two or more randomized controlled outcome studies comparing the target treatment to an appropriate alternative treatment and showing a significant advantage to the target treatment. Interventions are assigned to Category 2, supported and probably efficacious treatment, based on positive outcomes of nonrandomized designs with some form of control, which may involve a non-treatment group. Category 3, supported and acceptable treatment, includes interventions supported by one controll ed or uncontrolled study, or by a series of single-subject studies, or by work with a different population than the one of interest. Category 4, promising and acceptable treatment, includes interventions that have no support except general acceptance and clinical anecdotal literature; however, any evidence of possible harm excludes treatments from this category. Category 5, innovative and novel treatment, includes interventions that are not thought to be harmful, but are not widely used or discussed in the literature. Category 6, concerning treatment, is the classification for treatments that have the possibility of doing harm, as well as having unknown or inappropriate theoretical foundations.
A protocol for evaluation of research quality was suggested by a report from the Centre for Reviews and Dissemination, prepared by Khan et al. and intended as a general method for assessing both medical and psychosocial interventions [ Khan, K.S., et al. (2001). CRD Report 4. Stage II. Conducting the review. phase 5. Study quality assessment. York, UK: Centre for Reviews and Dissemination, University of York. Retrieved July 20, 2007 from http://www.york.ac.uk/inst/crd/pdf/crd_4ph5.pdf ] . While strongly encouraging the use of randomized designs, this protocol noted that such designs were useful only if they met demanding criteria, such as true randomization and concealment of the assigned treatment group from the client and from others, including the individuals assessing the outome. The Khan et al. protocol emphasized the need to make comparisons on the basis of "intention to treat" in order to avoid problems related to greater attrition in one group. The Khan et al. protocol also presented demanding criteria for nonrandomized studies, including matching of groups on potential confounding variables and adequate descriptions of groups and treatments at every stage, and concealment of treatment choice from persons assessing the outcomes. This protocol did not provide a classification of levels of evidence, but included or excluded treatments from classification as evidence-based depending on whether the research met the stated standards.
An assessment protocol has been developed by the U.S. National Registry of Evidence-Based Practices and Programs (NREPP) [ National Registry of Evidence-Based Practices and Programs (2007). NREPP Review Criteria. Retrieved March 10, 2008 from http://www.nrepp.samsha.gov/review-criteria.htm ] . Evaluation under this protocol occurs only if an intervention has already had one or more positive outcomes, with a probability of less than .05, reported, if these have been published in a peer-reviewed journal or an evaluation report, and if documentation such as training materials has been made available. The NREPP evaluation, which assigns quality ratings from 1 to 4 to certain criteria, examines reliability and validity of outcome measures used in the research, evidence for intervention fidelity (predictable use of the treatment in the same way every time), levels of missing data and attrition, potential confounding variables, and the appropriateness of statistical handling, including sample size.
A protocol suggested by Mercer and Pignotti [ Mercer, J., & pignotti, M. (2007). Shortcuts cause errors in systematic research syntheses. Scientific Review of Mental Health Practice, 5(2), 59-77 ] uses a taxonomy intended to classify on both research quality and other criteria. In this protocol, evidence-based interventions are those supported by work with randomized designs employing comparisons to established treatments, independent replications of results, blind evaluation of outcomes, and the existence of a manual. Evidence-supported interventions are those supported by nonrandomized designs, including within-subjects designs, and meeting the criteria for the previous category. Evidence-informed treatments involve case studies or interventions tested on populations other than the targeted group, without independent replications; a manual exists, and there is no evidence of harm or potential for harm. Belief-based interventions have no published research reports or reports based on composite cases; they may be based on religious or ideological principles or may claim a basis in accepted theory without an acceptable rationale; there may or may not be a manual, and ther is no evidence of harm or potential for harm. Finally, the category of potentially harmful treatments includes interventions such that harmful mental or physical effects have been documented, or a manual or other source shows the potential for harm.
Protocols for evaluation of research quality are still in dvelopment. So far, the available protocols pay relatively little attention to whether outcome research is relevant to efficacy (the outcome of a treatment performed under ideal conditions) or to effectiveness (the outcome of the treatment performed under ordinary, expectable conditions).
Meta-analyses and systematic research syntheses
When there are many small or weak studies of an intervention, a statistical meta-analysis can be used to co-ordinate the studies' results and to draw a stronger conclusion about the outcome of the treatment. This can be an important contribution to the establishment of a foundation of evidence about an intervention.
In other situations, facts about a group of study outcomes may be gathered and discussed in the form of a systematic research synthesis (SRS) [ Cooper, H. (2003). Editorial. Psychological Bulletin, 129, 3-9. ] . A SRS can be more or less useful, depending on the evaluation protocol chosen, and errors in choice or use of a protocol have led to fallacious reports [ Pignotti, M., & Mercer, J. (2007). Holding Therapy and Dyadic Developmental Psychotherapy are not supported and acceptable social work interventions. Research on Social Work practice, 17(4), 513-519. ] . The meaningfulness of a SRS report on an intervention is limited by the quality of the research under consideration, but SRS reports can be helpful to readers seeking to understand EBP-related choices..
ocial Policy
There are increasing demands for the whole range of social policy and other decisions and programs run by government and the NGO sector to be based on sound evidence as to their effectiveness. This has seen an increased emphasis on the use of a wide range of Evaluation approaches directed at obtaining evidence about social programs of all types. A research collaboration called the [http://www.campbellcollaboration.org Campbell Collaboration] has been set up in the social policy area to provide evidence for evidence-based social policy decision-making. This collaboration follows the approach pioneered by the Cochrane Collaboration in the health sciences [http://www.cochrane.org] . Using an evidence-based approach to social policy has a number of advantages because it has the potential to decrease the tendency to run programs which are socially acceptable (e.g. drug education in schools) but which often prove to be ineffective when evaluated.
ee also
*Epidemiology
*Evidence-based design
*Evidence-based management
*Evidence-based medicine
*Evidence-based pharmacy in developing countries
References
*
* French, P. (2002). What is the evidence on evidence-based nursing? An epistemiological concern. "Journal of Advanced Nursing, 37"(3), 250-257.
* Mason, D. J., Leavitt, J. K., & Chaffee, M. W. (2002). "Policy and politics in nursing and health care" (4th ed.). St Louis, MO: Saunders/Elsevier.
Footnotes
External links
* [http://www.shef.ac.uk/scharr/ir/def.html Evidence Based Practice Definitions]
* [http://www.joannabriggs.edu.au/about/home.php The Joanna Briggs Institute] - International Collaborative on Evidence-based Practice in Nursing.
* [http://www.ebnp.org Indiana Center for Evidence Based Nursing Practice: A JBI Collaborating Center]
* [http://www.evidence.no/en Evidence] Communicate leading research in order to promote international cooperation and evidence-based treatments
* [http://www.rhrq.gov/clinic/epc Evidence based Practice clinic intitiatives]
* [http://library.umassmed.edu/ebpph Evidence Based Practice studies at the University of Massachusetts]
* [http://nursing.asu.edu/caep/index.htm Center for the Advancement of Evidence-Based Practice (CAEP)] at Arizona State University College of Nursing and Healthcare Innovation
* [http://nnpnetwork.org The National Nursing Practice Network]
