Guides: Evidence Synthesis: Evaluating

Evidence Synthesis Process: Evaluating

Evaluating: In evaluating your search results, you systematically reduce the thousands of citations you initially identified to dozens for closer examination. Often, some of these steps are done concurrently. For example, after 500 citations have been evaluated for relevancy, the studies chosen for inclusion can be evaluated for quality and bias, while the next 500 citations are evaluated for relevancy.
Evaluating Step	Explanation
The citations from the searches are de-duplicated	These are combined into a master list with the resulting number of citations documented.
Each article is evaluated for relevancy	At least two reviewers determine whether a citation meets the eligibility criteria for inclusion as set up in the protocol. Often inclusion/exclusion can be based on title and abstract but sometimes full-text is required for the determination. Tools are available that can help track the status of each citation. Some have AI which can speed up the process.
Full text is obtained	For those citations which inclusion cannot be determined by title and abstract alone. For all citations to be included in the synthesis.
Master list of studies is complied	Some studies may be written up in more than one article. Some articles may include more than one study.
Each study is evaluated for quality and bias (Critical Appraisal)	At least two reviewers determine the quality of each study. A valid quality assessment tool or checklist appropriate for the type of study should be used.
A list of studies to be included in the synthesis is compiled	If any studies are deemed to be of lower quality or biased, documentation of their inclusion or exclusion is necessary.

Covidence This link opens in a new window Provides a platform for conducting evidence synthesis (systematic review) projects. Import citations, use machine learning to screen for randomized controlled trials, screen titles and abstracts, upload references, review full text, extract data, conduct risk of bias, and export data.To get full use of this product, you need a Baylor affiliated account.  Go to here to sign up with your Baylor email.

Rayyan A free online tool from Qatar Computing Research Institute and Rayyan Systems that allows you to import lists of articles for tagging and selection.