Evidence Syntheses (Scoping, systematic, & other types of reviews)

Meta-Analyses

• Statistical technique for combining the findings from disparate quantitative studies.
• Uses statistical methods to objectively evaluate, synthesize, and summarize results.
• May be conducted independently or as part of a systematic review.

Methodological Guidance

• Cochrane Handbook, Ch 10: Analysing data and undertaking meta-analyses https://training.cochrane.org/handbook/current/chapter-10

Examples

• Bauer, M. E., Toledano, R. D., Houle, T., et al. (2020). Lumbar neuraxial procedures in thrombocytopenic patients across populations: A systematic review and meta-analysis. https://pubmed.ncbi.nlm.nih.gov/31810860/6
• Mailoa J, Lin GH, Khoshkam V, MacEachern M, et al. Long-Term Effect of Four Surgical Periodontal Therapies and One Non-Surgical Therapy: A Systematic Review and Meta-Analysis. https://pubmed.ncbi.nlm.nih.gov/26110453/

Umbrella Reviews

• Reviews other systematic reviews on a topic. 
• Often defines a broader question than is typical of a traditional systematic review.
• Most useful when there are competing interventions to consider.

Methodological Guidance

• Ioannidis JP. Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses. https://pubmed.ncbi.nlm.nih.gov/35081993
• Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P.  2015 Methodology for JBI Umbrella Reviews. https://ro.uow.edu.au/cgi/viewcontent.cgi?articl.

Examples

• Gastaldon, C., Solmi, M., Correll, C. U., et al. (2022). Risk factors of postpartum depression and depressive symptoms: umbrella review of current evidence from systematic reviews and meta-analyses of observational studies. https://pubmed.ncbi.nlm.nih.gov/35081993/
• Blodgett, T. J., & Blodgett, N. P. (2021). Melatonin and melatonin-receptor agonists to prevent delirium in hospitalized older adults: An umbrella review.  https://pubmed.ncbi.nlm.nih.gov/34749057/

Comparative effectiveness 

• Systematic reviews of existing research on the effectiveness, comparative effectiveness, and comparative harms of different health care interventions.
•  Intended to provide relevant evidence to inform real-world health care decisions for patients, providers, and policymakers.

Methodological Guidance

• “Methods Guide for Effectiveness and Comparative Effectiveness Reviews.” Methods Guide for Effectiveness and Comparative Effectiveness Reviews https://effectivehealthcare.ahrq.gov/products/collections/cer-methods-guide
• Main document of above guide: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/cer-methods-guide_overview.pdf.

Examples

• Tanni KA, Truong CB, Johnson BS, Qian J. Comparative effectiveness and safety of eribulin in advanced or metastatic breast cancer: a systematic review and meta-analysis. Crit Rev Oncol Hematol. 2021 Jul;163:103375. doi: 10.1016/j.critrevonc.2021.103375. Epub 2021 Jun 2. PMID: 34087344.
• Rice D, Corace K, Wolfe D, Esmaeilisaraji L, Michaud A, Grima A, Austin B, Douma R, Barbeau P, Butler C, Willows M, Poulin PA, Sproule BA, Porath A, Garber G, Taha S, Garner G, Skidmore B, Moher D, Thavorn K, Hutton B. Evaluating comparative effectiveness of psychosocial interventions adjunctive to opioid agonist therapy for opioid use disorder: A systematic review with network meta-analyses. PLoS One. 2020 Dec 28;15(12):e0244401. doi: 10.1371/journal.pone.0244401. PMID: 33370393; PMCID: PMC7769275.

​Scoping Review or Evidence Map

• Systematically and transparently collect and categorize existing evidence on a broad question of policy or management importance.
• Seeks to identify research gaps and opportunities for evidence synthesis rather than searching for the effect of an intervention. 
• May critically evaluate existing evidence, but does not attempt to synthesize the results in the way a systematic review would. (see EE Journal and CIFOR)
• May take longer than a systematic review.
• For useful guidance on whether to conduct a scoping review or not, see Figure 1 in this article. Pollock, D, Davies, EL, Peters, MDJ, et al. Undertaking a scoping review: A practical guide for nursing and midwifery students, clinicians, researchers, and academics. J Adv Nurs. 2021; 77: 2102– 2113. https://doi.org/10.1111/jan.14743For a helpful

Methodological Guidance

• Hilary Arksey & Lisa O'Malley (2005) Scoping studies: towards a methodological framework http://10.1080/1364557032000119616
• Aromataris E, Munn Z, eds. (2020). JBI Manual for Evidence Synthesis. JBI. Chapter 11: Scoping Reviews. https://jbi-global-wiki.refined.site/space/MANUAL/355862497/10.+Scoping+reviews
• Munn Z, Peters MD, Stern C, Tet al. (2018)  Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. https://pubmed.ncbi.nlm.nih.gov/30453902/
• Tricco AC, Lillie E, Zarin W, et al.. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018 Oct 2;169(7):467-473. doi: 10.7326/M18-0850. Epub 2018 Sep 4. PMID: 30178033.  https://www.acpjournals.org/doi/epdf/10.7326/M18-0850

Examples

• Bouldin E, Patel SR, Tey CS, et al. Bullying and Children who are Deaf or Hard-of-hearing: A Scoping Review. https://pubmed.ncbi.nlm.nih.gov/33438758
• Finn M, Gilmore B, Sheaf G, Vallières F. What do we mean by individual capacity strengthening for primary health care in low- and middle-income countries? A systematic scoping review to improve conceptual clarity. https://pubmed.ncbi.nlm.nih.gov/33407554/
• Hirt J, Nordhausen T, Meichlinger J, Braun V, Zeller A, Meyer G. Educational interventions to improve literature searching skills in the health sciences: a scoping review. https://pubmed.ncbi.nlm.nih.gov/33013210/

Rapid Review

• Useful for addressing issues needing timely decisions, such as developing policy recommendations. 
• Applies systematic review methodology within a time-constrained setting.
• Employs intentional, methodological "shortcuts" (limiting search terms for example) at the risk of introducing bias.
• Defining characteristic is the transparency of team methodological choices.

Methodological Guidance

• Garritty, Chantelle, Gerald Gartlehner, Barbara Nussbaumer-Streit, Valerie J. King, Candyce Hamel, Chris Kamel, Lisa Affengruber, and Adrienne Stevens. “Cochrane Rapid Reviews Methods Group Offers Evidence-Informed Guidance to Conduct Rapid Reviews.” Journal of Clinical Epidemiology 130 (February 2021): 13–22. https://doi.org/10.1016/j.jclinepi.2020.10.007.
• Klerings I, Robalino S, Booth A, et al. Rapid reviews methods series: Guidance on literature search.BMJ Evidence-Based Medicine. 19 April 2023. https://10.1136/bmjebm-2022-112079
• WHO. “WHO | Rapid Reviews to Strengthen Health Policy and Systems: A Practical Guide.” World Health Organization. Accessed February 11, 2022. https://iris.who.int/handle/10665/258698.
• Dobbins, Maureen. “Steps for Conducting a Rapid Review,” 2017, 25. https://www.nccmt.ca/uploads/media/media/0001/01/a816af720e4d587e13da6bb307df8c907a5dff9a.pdf

Examples

• Norris HC, Richardson HM, Benoit MC, et al. (2021) Utilization Impact of Cost-Sharing Elimination for Preventive Care Services: A Rapid Review.  https://pubmed.ncbi.nlm.nih.gov/34157906/
• Marcus N, Stergiopoulos V. Re-examining mental health crisis intervention: A rapid review comparing outcomes across police, co-responder and non-police models. Health Soc Care Community. 2022 Feb 1. doi: 10.1111/hsc.13731. Epub ahead of print. PMID: 35103364.

Narrative (Literature) Review

• A broad term referring to reviews with a wide scope and non-standardized methodology.
  • See Baethge 2019 below for a method to provide quality assessment,
• Search strategies, comprehensiveness, and time range covered will vary and do not follow an established protocol.
• It provides insight into a particular topic by critically examining sources, generally over a particular period of time.

Methodological Guidance

• Greenhalgh, T., Thorne, S., & Malterud, K. (2018). Time to challenge the spurious hierarchy of systematic over narrative reviews?. https://pubmed.ncbi.nlm.nih.gov/29578574/
• Baethge, C., Goldbeck-Wood, S. & Mertens, S. (2019). SANRA—a scale for the quality assessment of narrative review articles. https://doi.org/10.1186/s41073-019-0064-8  https://researchintegrityjournal.biomedcentral.com/articles/10.1186/s41073-019-0064-8

Examples

• Czypionka, T., Greenhalgh, T., Bassler, D., & Bryant, M. B. (2021). Masks and Face Coverings for the Lay Public : A Narrative Update. https://pubmed.ncbi.nlm.nih.gov/33370173/
• Gardiner, F. W., Nwose, E. U., Bwititi, P. T., et al.. (2017). Services aimed at achieving desirable clinical outcomes in patients with chronic kidney disease and diabetes mellitus: A narrative review. https://pubmed.ncbi.nlm.nih.gov/29201367/
•  Dickerson, S. S., Connors, L. M., Fayad, A., & Dean, G. E. (2014). Sleep-wake disturbances in cancer patients: narrative review of literature focusing on improving quality of life outcomes.  https://pubmed.ncbi.nlm.nih.gov/25050080/