Skip to main content

Education: research guide: Systematic literature searching

Terminology

Review: An article that summarises a number of different primary studies and may draw conclusions about the effectiveness of a particular intervention. A review may or may not be systematic.
Systematic review (systematic overview): A review of the evidence on a clearly formulated question that uses systematic and explicit methods to identify, select and critically appraise relevant primary research, and to extract and analyse data from the studies that are included in the review. Statistical methods (meta-analysis) may or may not be used.
Meta-analysis: The use of statistical techniques to combine the results of studies addressing the same question into a summary measure.

from: Undertaking systematic reviews of research on effectiveness: CRD's guidance for those carrying out or commissioning reviews. CRD Report 4 (2nd edition). March 2001. http://www.york.ac.uk/inst/crd/report4.htm

Systematic review

A systematic review is a summary of research that uses explicit methods to perform a thorough literature search and critical appraisal of individual studies to identify the valid and applicable evidence. An example which also explains what systematic reviews are, alternative terminology and desirable characteristics is:
Rose, H., Briggs, J. G., Boggs, J., Sergio, L., & Ivanova-Slavianskaia, N. (2017). A systematic review of language learner strategy research in the face of self-regulation. System, 72, 151–163.

 

A systematic review should include the preferred reporting items for systematic reviews and meta-analyses (http://www.prisma-statement.org/PRISMAStatement/PRISMAStatement)

A systematic review is a research method, just as interviews or surveys are research methods. The key difference is whether you are collecting and analysing your own primary data, or performing a review of already published research and grey literature.

Recommended resources

An excellent guide to systematic reviews is provided by our healthcare librarians

http://ox.libguides.com/systematic-reviews

Recommended resources

For systematic reviewing in the field of education, EPPI-Centre is the place to start: 

The EPPI-Centre is based in the Department of Social Science, UCL Institute of Education.

The Campbell Collaboration shares the commitment of The Cochrane Collaboration (healthcare) to high standards for the conduct of systematic reviews. You can search for examples in the field of education in their free online library.

Examples of systematic reviews in education

Take a look at the Cambell Collaboration's library of systematic reviews in the social sciences: https://www.campbellcollaboration.org/library.html

 

Recent reviews by members of the Department of Education include:

Macaro, E., Handley, Z. & Walter, C. (2012) A systematic review of CALL in English as a second language: Focus on primary and secondary education. Language Teaching 45(1) p.1-43

 

Other examples:

Freeman, J. & Brandi, S. (2015) Examining the impact of policy and practice interventions on high shool dropout and school completion rates: A systematic review of the literature. Review of Educational Research, 85(2) p.205-248

Tutorials with a librarian

Please contact us if you would like any help with your research. We offer help with:

  • searching the education databases
  • saving and managing your references
  • setting new publication alerts
  • citation tracking
  • ...and much more

To book an appointment, please contact us on education.library@bodleian.ox.ac.uk 

Systematic review software

It is common practice to use Excel and Reference Management Software to manage systematic reviews.

The EPPI Centre have created specific software for systematic reviewing which individuals can subscribe to (the cost is not prohibitive).

There is also free alternative: Rayyan http://rayyan.qcri.org/

Covidence is an alternative online software you can pay for: Covidence

Take a look at the Systematic Review Toolbox for other ideas, including tools to use to critically analyse the studies you find e.g. this quality assessment tool.