|
Sign In to gain access to subscriptions and/or personal tools.
|
Integrative Cancer Therapies, Vol. 5, No. 4,
282-286 (2006)
DOI: 10.1177/1534735406295564
Evidence Summaries and Synthesis: Necessary but Insufficient Approach for Determining Clinical Practice of Integrated Medicine?
Ian D. Coulter, PhD
Clinical Research and Integrative Medicine, Samueli Institute, 2101 East Coast Highway, Suite 300, Corona del Mar, CA 921625 Icoulter{at}siib.org
The heart of evidence-based practice is in fact to be found in the use of evidence gained from systematic reviews or more correctly in the synthesis of evidence from systematic reviews. But just as studies vary in the quality of the design so do systematic reviews, and it is therefore necessary for those wishing to make clinical decisions based on this evidence to evaluate the evidence summaries and synthesis themselves. This article examines the criteria available for evaluating the quality of the evidence summary and synthesis. It provides a set of questions for doing this: who did the review; w hat was the objective of the review; how was the review done? Together these questions allow us to determine the trustworthiness of the review. However, that by itself is insufficient for making clinical decisions. The article suggests that this occurs because the very studies that improve the quality of reviews, that is, the randomized controlled trials, deal with efficacy and not effectiveness. Because they tend to be conducted under ideal conditions, they seldom provide the type of information needed to make a decision vis-à-vis an individual patient. The article suggests that observation studies provide much better information in this regard. The challenge here, however, is to develop standards for judging quality observation studies. In conclusion, systematic reviews and syntheses of evidence are a necessary but an insufficient method for making clinical decisions.
Key Words: systematic reviews • evidence synthesis • clinical practic
References
- Sackett DL. Evidence-based medicine [Editorial]. Spine. 1998; 23(10): 1085-1086.[CrossRef][Medline]
[Order article via Infotrieve]
- Evidence-Based Medicine Working Group. Evidence-based medicine: a new approach to teaching the practice of medicine. JAMA. 1992;268:2420-2425.[Free Full Text]
- LeLorier J, Gregoire G, Benhaddad A, et al. Discrepancies between metaanalyses and subsequent large randomized, controlled trials. N Engl J Med. 1997;337(8):536-542.[Abstract/Free Full Text]
- Krimsky, S. The funding effect in science and its implications for the judiciary. J Law Policy. 2005;13(1):43-43,59-59.
- Participating AHRQ Evidence-based Practice Centers. February 2006. Rockville, MD: Agency for Healthcare Research and Quality. Available at: http://www.ahrq.gov/clinic/epc/epcenters.htm. Accessed September 18, 2006.
- The Cochrane Collaboration. Evidence Health Care. Available at: http://www.cochrane.org/docs/ebm.htm. Accessed September 18, 2006.
- Hardy M, Coulter I, Venuturupalli S, et al. Southern California Evidence-Based practice Center/RAND. Ayurvedic Interventions for Diabetes Mellitus: A Systematic Review. Evidence Report/Technology Assessment Number 41. AHRQ Publication No. 01-E040. Rockville, MD: Agency for Healthcare Research and Quality/DHHS. September 2001.
- Coulter ID. Efficacy and risks of chiropractic manipulation: what does the evidence suggest? Integrat Med. 1998;1(2):61-66.[CrossRef]
- Coulter ID. The NIH Consensus Conference on diagnosis, treatment and management of dental caries throughout life: process and outcome. J Evidence-Based Dental Pract. 2001;1(1): 58-63.
- Coulter ID, Hardy ML, Morton SC, et al. Antioxidants vitamin C and vitamin e for the prevention and treatment of cancer. J Gen Intern Med. 2006;21(7):735-744.[CrossRef][Medline]
[Order article via Infotrieve]
- Holmes D, Murray SJ, Perron A, Rail G. Deconstructing the evidence for evidence-based discourse in health sciences: truth, power and fascism. Int J Evidence-Based Healthcare. 2006;4: 180-186.[CrossRef]
- Egger M, Smith GD. Misleading meta-analysis [Editorial]. Br Med J. 1995;310:752-754.[Free Full Text]
- Smith R. Where is the wisdom? The poverty of medical evidence. BMJ. 1991;303:798-799.
- Niedrman R, Badovinac R. Tradition-based dental care and evidenced-based dental care [Editorial]. J Dent Res. 1999;78(7): 1288-1291.[Free Full Text]
- Shekelle P, Adams A, Chassin M, Hurwitz E, Phillips R, Brook R. The appropriateness of spinal manipulation for low-back pain: project overview and literature review. RAND Report R-4025/1-CCR/FCER; 1991.
- Coulter ID, Adams A, Shekelle P. Impact of varying panel membership on ratings of appropriateness in consensus panels: a comparison of a multi-and single-disciplinary panel. Health Services Res. 1995;30:577-591.
- Coulter ID. Evidence-based dentistry and health services research: is one possible without the other? J Dent Educ. 2001;65(8):714-724.[Abstract]
- Glasziou P, Guyatt GH, Dans AL, Dans LF, Straus S, Sackett DL. Applying the results of trials and systematic reviews to individual patients [Editorial]. ACP J Club. 1998;129(3):A15-A16.[Medline]
[Order article via Infotrieve]
- Radford MJ, Foody JM. How do observational studies expand the evidence base for therapy? JAMA. 2001;286(10):1228-1230.[Free Full Text]
- Feinstein AR, Horwitz RI. Problems in the "evidence" of "evidence-based medicine" Am J Med. 1997;103:529-535.[CrossRef][Medline]
[Order article via Infotrieve]
- Ray JG. Evidence in upheaval. Incorporating observational data into clinical practice. Arch Intern Med. 2002;162:249-254.[Free Full Text]
- Ioannidis JPA, Haidich A, Pappa M, et al. Comparison of evidence of treatment effects in randomized and nonrandomized studies. JAMA. 2001;286(7):821-830.[Abstract/Free Full Text]
- Benson K, Hartz A. A comparison of observational and randomized, controlled trials. N Engl J Med. 2000;342(25):1878-1886.[Abstract/Free Full Text]
- Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 2000;342(25):1887-1892.[Abstract/Free Full Text]
- Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology. A proposal for reporting. JAMA. 2000;283(15):2008-2012.[Abstract/Free Full Text]
 CiteULike  Connotea  Del.icio.us  Digg  Reddit  Technorati What's this?
This article has been cited by other articles:
|
|
|
|
 
J. Post-White, E. J. Ladas, and K. M. Kelly
Advances in the Use of Milk Thistle (Silybum marianum)
Integr Cancer Ther,
June 1, 2007;
6(2):
104 - 109.
[Abstract]
[PDF]
|
|
|
|
