What is an umbrella review?
An umbrella review — also called a review of reviews, an overview of reviews, or a meta-review — synthesizes the findings of multiple existing systematic reviews and meta-analyses on a broad topic. Instead of extracting data from primary studies, the umbrella review extracts data from reviews: their included studies, pooled effect estimates, heterogeneity statistics, certainty ratings, and conclusions. The result is a high-level synthesis that tells readers what the landscape of systematic reviews says, where they agree, where they diverge, and how trustworthy their conclusions are.
The canonical methodological reference is the Joanna Briggs Institute (JBI) umbrella review methodology, set out in Aromataris and colleagues ("Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach," International Journal of Evidence-Based Healthcare, 2015) and elaborated in the JBI Manual for Evidence Synthesis. The Cochrane Collaboration publishes parallel overviews-of-reviews methodology in Chapter V of the Cochrane Handbook.
Reporting now has a dedicated standard: PRIOR (Preferred Reporting Items for Overviews of Reviews), published by Gates and colleagues in BMJ in 2022. PRIOR is a 27-item checklist that extends PRISMA 2020 to the overview context, covering the special issues umbrella reviews face — overlap across included reviews, discordant conclusions, and the quality of the reviews themselves.
When to use an umbrella review
An umbrella review is the right choice when:
- Multiple systematic reviews already exist on your topic. The signal that an umbrella review is warranted is a crowded field of recent, overlapping systematic reviews or meta-analyses.
- You are informing guidelines or high-level policy. Decision-makers at the ministerial or guideline-panel level often want a synthesis one level up from primary studies.
- The evidence spans multiple interventions, populations, or outcomes. For example, "psychological interventions for chronic pain" may span a dozen intervention-specific systematic reviews; an umbrella review consolidates them.
- You need a map of where systematic reviews disagree. Umbrella reviews are especially useful for adjudicating discordant conclusions across prior reviews.
- A new systematic review would duplicate effort. If existing reviews cover your question adequately, synthesizing them is faster and more informative than redoing the primary-study work.
Contrast with a systematic review (primary studies), a meta-analysis (quantitative pooling of primary studies), a scoping review (broad mapping of primary and review literature), and a rapid review (accelerated primary-study synthesis). Where a narrative review interprets a field informally, an umbrella review formalizes the synthesis of its systematic reviews.
Step-by-step process
Map the umbrella review to the five-phase pipeline:
- Protocol and registration. Specify the research question, eligibility (which review types qualify — systematic reviews only, or also scoping reviews?), overlap-handling strategy, and quality-appraisal tool. Register on PROSPERO (which accepts umbrella review protocols).
- Search strategy for reviews. Search databases using review-specific filters: PubMed's "Systematic Review" filter, the Cochrane Database of Systematic Reviews, Epistemonikos, and JBI Evidence Synthesis. Supplement with PROSPERO (for recent and in-progress reviews) and targeted grey literature.
- Screening and selection. Dual-reviewer screening against pre-specified review-type criteria. Exclude primary studies, narrative reviews (typically), and reviews that do not report a reproducible method.
- Data extraction and quality appraisal. Extract review-level characteristics: scope, databases searched, included study count and designs, risk-of-bias tool used, pooled effects, heterogeneity, and certainty ratings. Appraise each review with AMSTAR 2 (Shea et al., BMJ 2017) or the JBI checklist for systematic reviews. Assess overlap of primary studies across reviews using the Corrected Covered Area (CCA) metric (Pieper et al., 2014).
- Synthesis and reporting. Present a structured summary — typically in a matrix — of each review's scope, quality, and headline findings. Discuss concordance, discordance, and the certainty of the overall picture. Report per PRIOR 2022.
Reporting standards
Report in full compliance with PRIOR (Gates et al., 2022) — the PRISMA extension for overviews of reviews. Include a PRISMA-style flow diagram adapted for reviews. Report overlap (typically via CCA) and quality appraisal (AMSTAR 2 or JBI). Where the JBI methodology is followed, cite the JBI Manual for Evidence Synthesis explicitly. See the reporting standards overview.
Common pitfalls
- Ignoring overlap. If three "separate" systematic reviews include mostly the same primary studies, treating their conclusions as independent evidence triples the apparent signal. Always quantify overlap (CCA) and interpret accordingly.
- Including low-quality reviews uncritically. An umbrella review is only as good as the reviews it synthesizes. AMSTAR 2 ratings should inform how much weight each review receives.
- Conflating with a meta-analysis of primary studies. Pooling effect sizes extracted from reviews risks double-counting and biased weights. If you want pooled effects, synthesize the primary studies directly.
- No discordance analysis. Reviews often disagree. Explain why — different inclusion criteria, different analytic models, different dates — rather than presenting a single averaged conclusion.
- Using only one database of reviews. Restricting to the Cochrane Database of Systematic Reviews misses JBI, Campbell, and non-Cochrane reviews indexed in MEDLINE and Epistemonikos. Use multiple sources.
Tools & templates
Use the Literature Review Matrix with columns for AMSTAR 2 rating, included-study overlap, pooled effects, and certainty. The Data Extraction Form Template can be reconfigured for review-level extraction. The PRISMA Flow Diagram Template adapts to PRIOR. All are available in the templates library.
Next steps
Umbrella reviews reward careful matrix design more than any other type. Once you have captured each review's scope, methods, quality, overlap, and headline findings in a consistent structure, the synthesis writes itself. Bake AMSTAR 2 ratings and CCA overlap metrics into your matrix from day one. The Subthesis Literature Matrix gives you structured columns that handle review-level extraction as cleanly as primary-study extraction.