Share

Framework for Determining Research Gaps During Systematic Review

Download Framework for Determining Research Gaps During Systematic Review PDF Online Free

Author :
Release : 2013-03-23
Genre : Medical
Kind : eBook
Book Rating : 296/5 ( reviews)

GET EBOOK


Book Synopsis Framework for Determining Research Gaps During Systematic Review by : U. S. Department of Health and Human Services

Download or read book Framework for Determining Research Gaps During Systematic Review written by U. S. Department of Health and Human Services. This book was released on 2013-03-23. Available in PDF, EPUB and Kindle. Book excerpt: The identification of gaps from systematic reviews is essential to the practice of ''evidence-based research.'' Health care research should begin and end with a systematic review. A comprehensive and explicit consideration of the existing evidence is necessary for the identification and development of an unanswered and answerable question, for the design of a study most likely to answer that question, and for the interpretation of the results of the study. In a systematic review, the consideration of existing evidence often highlights important areas where deficiencies in information limit our ability to make decisions. We define a research gap as a topic or area for which missing or inadequate information limits the ability of reviewers to reach a conclusion for a given question. A research gap may be further developed, such as through stakeholder engagement in prioritization, into research needs. Research needs are those areas where the gaps in the evidence limit decision making by patients, clinicians, and policy makers. A research gap may not be a research need if filling the gap would not be of use to stakeholders that make decisions in health care. The clear and explicit identification of research gaps is a necessary step in developing a research agenda. Evidence reports produced by Evidence-based Practice Centers (EPCs) have always included a future research section. However, in contrast to the explicit and transparent steps taken in the completion of a systematic review, there has not been a systematic process for the identification of research gaps. We developed a framework to systematically identify research gaps from systematic reviews. This framework facilitates the classification of where the current evidence falls short and why the evidence falls short. The framework included two elements: (1) the characterization the gaps and (2) the identification and classification of the reason(s) for the research gap. The PICOS structure (Population, Intervention, Comparison, Outcome and Setting) was used in this framework to describe questions or parts of questions inadequately addressed by the evidence synthesized in the systematic review. The issue of timing, sometimes included as PICOTS, was considered separately for Intervention, Comparison, and Outcome. The PICOS elements were the only sort of framework we had identified in an audit of existing methods for the identification of gaps used by EPCs and other related organizations (i.e., health technology assessment organizations). We chose to use this structure as it is one familiar to EPCs, and others, in developing questions. It is not only important to identify research gaps but also to determine how the evidence falls short, in order to maximally inform researchers, policy makers, and funders on the types of questions that need to be addressed and the types of studies needed to address these questions. Thus, the second element of the framework was the classification of the reasons for the existence of a research gap. For each research gap, the reason(s) that most preclude conclusions from being made in the systematic review is chosen by the review team completing the framework. To leverage work already being completed by review teams, we mapped the reasons for research gaps to concepts from commonly used evidence grading systems. Our objective in this project was to complete two types of further evaluation: (1) application of the framework across a larger sample of existing systematic reviews in different topic areas, and (2) implementation of the framework by EPCs. These two objectives were used to evaluate the framework and instructions for usability and to evaluate the application of the framework by others, outside of our EPC, including as part of the process of completing an EPC report. Our overall goal was to produce a revised framework with guidance that could be used by EPCs to explicitly identify research gaps from systematic reviews.

Frameworks for Determining Research Gaps During Systematic Reviews

Download Frameworks for Determining Research Gaps During Systematic Reviews PDF Online Free

Author :
Release : 2011
Genre :
Kind : eBook
Book Rating : /5 ( reviews)

GET EBOOK


Book Synopsis Frameworks for Determining Research Gaps During Systematic Reviews by : Karen A. Robinson

Download or read book Frameworks for Determining Research Gaps During Systematic Reviews written by Karen A. Robinson. This book was released on 2011. Available in PDF, EPUB and Kindle. Book excerpt: RESEARCH OBJECTIVE: Systematic reviews, in addition to summarizing the evidence, generally also discuss needs for future research. However, in contrast to the methods of the systematic review, future needs are not identified systematically. There is limited literature describing organizing principles or frameworks for determining research gaps. We developed and pilot-tested a framework for the identification of research gaps from systematic reviews. STUDY DESIGN: We reviewed the research gaps identification practices of organizations involved with evidence synthesis. We contacted: (i) evidence-based practice centers (EPCs) (n=12) associated with the Agency for Healthcare Research and Quality (AHRQ) in the US and Canada, and (ii) other organizations around the world (n=64) that conduct systematic reviews, cost-effectiveness analyses, or technology assessments. Based on the responses, we developed a framework for identifying research gaps. We obtained feedback from two technical experts at our institution and pilot-tested this framework on two randomly selected EPC evidence reports. We also developed a simple, user-friendly worksheet with instructions to facilitate the use of the framework by investigators during or after a systematic review. POPULATION STUDIED: Not Applicable. PRINCIPAL FINDINGS: Four (33.3%) EPCs and 3 (8.1%) of the other organizations reported currently using an explicit framework to determine research gaps. We did not identify one framework that captured all elements needed to determine and characterize research gaps. Variations of the PICO (population, intervention, comparison, outcomes) framework were most common. It is also important to classify the reason(s) for the gap to help determine how to address the gap. Therefore, we propose a framework that includes both the characterization of the gap using PICOS elements (also including setting) and the identification of the reason(s) why the gap exists. The framework allows investigators to classify reasons for the existence of a research gap as: (a) insufficient or imprecise information, (b) biased information; (c) inconsistency or unknown consistency, and (d) not the right information. We mapped each of these reasons to concepts from three commonly used evidence grading systems: the Grading of Recommendations Assessment, Development and Evaluation (GRADE); the United States Preventive Services Task Force (USPSTF); and the Strength of Evidence (SOE) used by EPCs. This allows leveraging of work already being completed during evidence grading. During pilot-testing, we identified challenges including difficulty in applying the framework for completed systematic reviews and differences in the specificity of research gaps abstracted by different users. These could be tackled with a priori discussions amongst investigators. Further testing should determine if these challenges are ameliorated if the framework is used during a systematic review. CONCLUSIONS: We developed a framework to identify and characterize research gaps from systematic reviews. The framework provides for the classification of where and why the current evidence falls short. IMPLICATIONS FOR POLICY, DELIVERY, OR PRACTICE: In synthesizing evidence, systematic reviews inform health-care decisions for patients, policymakers, and clinicians. Systematic reviews can also be invaluable for identifying research gaps, thus helping develop research agendas. This potential impact of systematic reviews has not been realized. Our framework provides for systematically identifying and characterizing research gaps from systematic reviews. This explicit identification of research gaps will help determine the type of research needed to address the goals of comparative effectiveness research.

Framework for Determining Research Gaps During Systematic Review

Download Framework for Determining Research Gaps During Systematic Review PDF Online Free

Author :
Release : 2013
Genre : Evidence-based medicine
Kind : eBook
Book Rating : /5 ( reviews)

GET EBOOK


Book Synopsis Framework for Determining Research Gaps During Systematic Review by : Karen A. Robinson

Download or read book Framework for Determining Research Gaps During Systematic Review written by Karen A. Robinson. This book was released on 2013. Available in PDF, EPUB and Kindle. Book excerpt: BACKGROUND: Research gaps prevent systematic reviewers from making conclusions and, ultimately, limit our ability to make informed health care decisions. While there are well-defined methods for conducting a systematic review, there has been no explicit process for the identification of research gaps from systematic reviews. In a prior project we developed a framework to facilitate the systematic identification and characterization of research gaps from systematic reviews. This framework uses elements of PICOS (Population, Intervention, Comparison, Outcomes, Setting) to describe the gaps and categorizes the reasons for the gaps as (A) insufficient or imprecise information, (B) biased information, (C) inconsistent or unknown consistency results, and/or (D) not the right information. OBJECTIVE: To further develop and evaluate a framework for the identification and characterization of research gaps from systematic reviews. METHODS: We conducted two types of evaluation: (1) We applied the framework to existing systematic reviews, and (2) Evidence-based Practice Centers (EPCs) applied the framework either during a systematic review or during a future research needs project (FRN). EPCs provided feedback on the framework using an evaluation form. RESULTS: Our application of the framework to 50 systematic reviews identified about 600 unique research gaps. Key issues emerging from this evaluation included the need to clarify instructions for dealing with multiple comparisons (lumping vs. splitting) and need for guidance on applying the framework retrospectively. We received evaluation forms from seven EPCs. EPCs applied the framework in 8 projects, five of which were FRNs. Challenges identified by the EPCs led to revisions in the instructions including guidance for teams to decide a priori whether to limit the use of the framework to questions for which strength of evidence has been assessed, and the level of detail needed for the characterization of the gaps. CONCLUSIONS: Our team evaluated a revised framework, and developed guidance for its application. A final version is provided that incorporates revisions based on use of the framework across existing systematic reviews and feedback from other EPCs on their use of the framework. Future research is needed to evaluate the relative costs and benefits of using the framework, for review authors and for users of the systematic reviews.

Frameworks for Determining Research Gaps During Systematic Reviews

Download Frameworks for Determining Research Gaps During Systematic Reviews PDF Online Free

Author :
Release :
Genre :
Kind : eBook
Book Rating : /5 ( reviews)

GET EBOOK


Book Synopsis Frameworks for Determining Research Gaps During Systematic Reviews by :

Download or read book Frameworks for Determining Research Gaps During Systematic Reviews written by . This book was released on . Available in PDF, EPUB and Kindle. Book excerpt:

Finding What Works in Health Care

Download Finding What Works in Health Care PDF Online Free

Author :
Release : 2011-07-20
Genre : Medical
Kind : eBook
Book Rating : 257/5 ( reviews)

GET EBOOK


Book Synopsis Finding What Works in Health Care by : Institute of Medicine

Download or read book Finding What Works in Health Care written by Institute of Medicine. This book was released on 2011-07-20. Available in PDF, EPUB and Kindle. Book excerpt: Healthcare decision makers in search of reliable information that compares health interventions increasingly turn to systematic reviews for the best summary of the evidence. Systematic reviews identify, select, assess, and synthesize the findings of similar but separate studies, and can help clarify what is known and not known about the potential benefits and harms of drugs, devices, and other healthcare services. Systematic reviews can be helpful for clinicians who want to integrate research findings into their daily practices, for patients to make well-informed choices about their own care, for professional medical societies and other organizations that develop clinical practice guidelines. Too often systematic reviews are of uncertain or poor quality. There are no universally accepted standards for developing systematic reviews leading to variability in how conflicts of interest and biases are handled, how evidence is appraised, and the overall scientific rigor of the process. In Finding What Works in Health Care the Institute of Medicine (IOM) recommends 21 standards for developing high-quality systematic reviews of comparative effectiveness research. The standards address the entire systematic review process from the initial steps of formulating the topic and building the review team to producing a detailed final report that synthesizes what the evidence shows and where knowledge gaps remain. Finding What Works in Health Care also proposes a framework for improving the quality of the science underpinning systematic reviews. This book will serve as a vital resource for both sponsors and producers of systematic reviews of comparative effectiveness research.

You may also like...