Quality (philosophy)

Quantum mechanics

Philosophy

Critical appraisal

Medical physics

Data extraction

Economics

Power (physics)

Computer science

Management science

Systematic review

Alternative medicine

Physics

Political science

Epistemology

Meta-analysis

Sociology

Data science

Reliability (semiconductor)

MEDLINE

Medicine

Cochrane Library

Research design

Pathology

Social science

Journal of Clinical Epidemiology

Objectives The aim of the article was to identify and summarize studies assessing methodologies for study selection, data abstraction, or quality appraisal in systematic reviews. Study Design and Setting A systematic review was conducted, searching MEDLINE, EMBASE, and the Cochrane Library from inception to September 1, 2016. Quality appraisal of included studies was undertaken using a modified Quality Assessment of Diagnostic Accuracy Studies 2, and key results on accuracy, reliability, efficiency of a methodology, or impact on results and conclusions were extracted. Results After screening 5,600 titles and abstracts and 245 full-text articles, 37 studies were included. For screening, studies supported the involvement of two independent experienced reviewers and the use of Google Translate when screening non-English articles. For data abstraction, studies supported involvement of experienced reviewers (especially for continuous outcomes) and two independent reviewers, use of dual monitors, graphical data extraction software, and contacting authors. For quality appraisal, studies supported intensive training, piloting quality assessment tools, providing decision rules for poorly reported studies, contacting authors, and using structured tools if different study designs are included. Conclusion Few studies exist documenting common systematic review practices. Included studies support several systematic review practices. These results provide an updated evidence-base for current knowledge synthesis guidelines and methods requiring further research.

Few studies exist examining methods for selecting studies, abstracting data, and appraising quality in a systematic review