Methodological index for non-randomized studies (minors): development and validation of a new instrument.

Published on Sep 1, 2003in Anz Journal of Surgery1.355
· DOI :10.1046/J.1445-2197.2003.02748.X
Karem Slim33
Estimated H-index: 33
,
Karem Slim22
Estimated H-index: 22
+ 3 AuthorsJacques Chipponi21
Estimated H-index: 21
Sources
Abstract
Background:  Because of specific methodological difficulties in conducting randomized trials, surgical research remains dependent predominantly on observational or non-randomized studies. Few validated instruments are available to determine the methodological quality of such studies either from the reader's perspective or for the purpose of meta-analysis. The aim of the present study was to develop and validate such an instrument. Methods:  After an initial conceptualization phase of a methodological index for non-randomized studies (MINORS), a list of 12 potential items was sent to 100 experts from different surgical specialities for evaluation and was also assessed by 10 clinical methodologists. Subsequent testing involved the assessment of inter-reviewer agreement, test-retest reliability at 2 months, internal consistency reliability and external validity. Results:  The final version of MINORS contained 12 items, the first eight being specifically for non-comparative studies. Reliability was established on the basis of good inter-reviewer agreement, high test-retest reliability by the κ-coefficient and good internal consistency by a high Cronbach's α-coefficient. External validity was established in terms of the ability of MINORS to identify excellent trials. Conclusions:  MINORS is a valid instrument designed to assess the methodological quality of non-randomized surgical studies, whether comparative or non-comparative. The next step will be to determine its external validity when used in a large number of studies and to compare it with other existing instruments.
Figures & Tables
Download
📖 Papers frequently viewed together
11.6k Citations
200045.54JAMA
14.4k Citations
3,875 Citations
References14
Newest
#1Peter McCulloch (University of Liverpool)H-Index: 41
#2Irving TaylorH-Index: 2
Last. Damian R. GriffinH-Index: 30
view all 5 authors...
The quality and quantity of randomised trials of surgical techniques is acknowledged to be limited. According to Peter McCulloch and colleagues, however, some aspects of surgery present special difficulties for randomised trials. In this article they analyse what these difficulties are and propose some solutions for improving the standards of clinical research in surgery.
813 CitationsSource
#1J M Bland (St George's Hospital)H-Index: 76
#2Douglas G. AltmanH-Index: 225
An index of quality is a measurement like any other, whether it is assessing a website, as in today's BMJ ,1 a clinical trial used in a meta-analysis,2 or the quality of a life experienced by a patient.3 As with all measurements, we have to decide whether it measures what we want it to measure, and how well. The simplest measurements, such as length and distance, can be validated by an objective criterion. The earliest criteria must have been biological: the length of a pace, a foot, a thumb. Th...
250 CitationsSource
#1Tonya S. King (PSU: Pennsylvania State University)H-Index: 30
#2Vernon M. Chinchilli (PSU: Pennsylvania State University)H-Index: 68
This paper discusses a generalized version of the concordance correlation coefficient for agreement data. The concordance correlation coefficient evaluates the accuracy and precision between two measures, and is based on the expected value of the squared function of distance. We have generalized this coefficient by applying alternative functions of distance to produce more robust versions of the concordance correlation coefficient. In this paper we extend the application of this class of estimat...
189 CitationsSource
#1David Moher (U of O: University of Ottawa)H-Index: 109
#2Kenneth F. Schulz (UNC: University of North Carolina at Chapel Hill)H-Index: 84
Last. Douglas G. AltmanH-Index: 225
view all 3 authors...
Summary To comprehend the results of a randomised controlled trial (RCT), readers must understand its design, conduct, analysis, and interpretation. That goal can be achieved only through total transparency from authors. Despite several decades of educational efforts, the reporting of RCTs needs improvement. Investigators and editors developed the original CONSORT (Consolidated Standards of Reporting Trials) statement to help authors improve reporting by use of a checklist and flow diagram. The ...
4,479 CitationsSource
#1Mohit Bhandari (McMaster University)H-Index: 86
#2Gordon H. Guyatt (McMaster University)H-Index: 206
Last. Emil H. Schemitsch (St. Michael's Hospital)H-Index: 9
view all 4 authors...
We have systematically reviewed the effect of alternative methods of stabilisation of open tibial fractures on the rates of reoperation, and the secondary outcomes of nonunion, deep and superficial infection, failure of the implant and malunion by the analysis of 799 citations on the subject, identified from computerised databases. Although 68 proved to be potentially eligible, only eight met all criteria for inclusion. Three investigators independently graded the quality of each study and extra...
379 CitationsSource
Background: The number and quality of well-designed scientific studies in the orthopaedic literature are limited. The purpose of this review was to determine the methodological qualities of published meta-analyses on orthopaedic-surgery-related topics. Methods: A systematic review of meta-analyses was conducted. A search of the Medline database provided lists of meta-analyses in orthopaedics published from 1969 to 1999. Extensive manual searches of major orthopaedic journals, bibliographies of m...
229 CitationsSource
#1Karem SlimH-Index: 33
#1Karem SlimH-Index: 22
Last. Jacques ChipponiH-Index: 21
view all 5 authors...
13 CitationsSource
#1Donna F. Stroup (CDC: Centers for Disease Control and Prevention)H-Index: 35
#2Jesse A. BerlinH-Index: 91
Last. Stephen B. ThackerH-Index: 46
view all 10 authors...
ObjectiveBecause of the pressure for timely, informed decisions in public health and clinical practice and the explosion of information in the scientific literature, research results must be synthesized. Meta-analyses are increasingly used to address this problem, and they often evaluate observational studies. A workshop was held in Atlanta, Ga, in April 1997, to examine the reporting of meta-analyses of observational studies and to make recommendations to aid authors, reviewers, editors, and re...
14.4k CitationsSource
#1Peter JüniH-Index: 105
#2Anne WitschiH-Index: 2
Last. Matthias EggerH-Index: 140
view all 4 authors...
Results Pooled relative risks from high-quality trials ranged from 0.63 (95% confidence interval [CI], 0.44-0.90) to 0.90 (95% CI, 0.67-1.21) vs 0.52 (95% CI, 0.241.09) to 1.13 (95% CI, 0.70-1.82) for low-quality trials. For 6 scales, relative risks of high-quality trials were close to unity, indicating that LMWH was not significantly superior to standard heparin, whereas low-quality trials showed better protection with LMWH (P,.05). Seven scales showed the opposite: high quality trials showed a...
1,590 CitationsSource
OBJECTIVE: To test the feasibility of creating a valid and reliable checklist with the following features: appropriate for assessing both randomised and non-randomised studies; provision of both an overall score for study quality and a profile of scores not only for the quality of reporting, internal validity (bias and confounding) and power, but also for external validity. DESIGN: A pilot version was first developed, based on epidemiological principles, reviews, and existing checklists for rand...
3,875 CitationsSource
Cited By1809
Newest
#1Bo Li (Sichuan University)
#2Lingyun Zhou (Sichuan University)
Last. Jian Zou (Sichuan University)H-Index: 7
view all 5 authors...
Abstract Objective Endoscopic ear surgery (EES) is minimally invasive and increasingly used to treat middle ear disease. In this meta-analysis, we compared the efficacies of EES and microscopic ear surgery (MES) in patients with middle ear cholesteatoma. Methods The PubMed, Embase, Cochrane Library, and Web of Science databases were searched for studies that reported the comparative surgical outcomes of EES and MES in patients with middle ear cholesteatoma. We followed the Preferred Reporting It...
Source
#1Kanwaljeet Garg (AIIMS: All India Institute of Medical Sciences)H-Index: 9
#2Ankita Aggarwal (Safdarjang Hospital)H-Index: 1
Abstract Introduction Facet tropism (FT) refers to the difference in the orientation of facet joints with respect to each other in the sagittal plane. Facet tropism leads to unequal biomechanical forces on facet joint and intervertebral disc during rotation and other physiological movements. Most of the studies have reported the incidence of FT in the lumbar spine to vary between 40% and 70% with L4-5 level being the most commonly afflicted level. The objective of this study was to find the asso...
Source
#1Hongyang Ma (Katholieke Universiteit Leuven)
#1Hongyang Ma (Katholieke Universiteit Leuven)
Last. Reinhilde Jacobs (KI: Karolinska Institutet)H-Index: 65
view all 8 authors...
Summary Introduction To date, there is a lack of evidence related to the long-term evaluation of recipient-site functional outcomes following mandibular reconstruction with vascularized bone grafts. Therefore, the aim of this systematic review and meta-analysis was to evaluate the long-term recipient-site functional outcomes in oral oncology patients who require mandibular reconstruction with either vascularized fibular flap (VFF) or vascularized iliac flap (VIF). Methods An extensive electronic...
Source
#1Cassandra Smith (VU: Victoria University, Australia)H-Index: 2
#2Alexander Tacey (VU: Victoria University, Australia)H-Index: 4
Last. Itamar Levinger (VU: Victoria University, Australia)H-Index: 23
view all 9 authors...
Abstract Background Bone turnover is the cellular machinery responsible for bone integrity and strength and, in the clinical setting, it is assessed using bone turnover markers (BTMs). Acute exercise can induce mechanical stress on bone which is needed for bone remodelling, but to date, there are conflicting results in regards to the effects of varying mechanical stimuli on BTMs. Objectives This systematic review examines the effects of acute aerobic, resistance and impact exercises on BTMs in m...
1 CitationsSource
#2Luigi Della Corte (University of Naples Federico II)H-Index: 7
Last. Giovanni Scambia (UCSC: Catholic University of the Sacred Heart)H-Index: 80
view all 7 authors...
Introduction Endometriosis is a very common disease that affects up to 10% of the female population. The use of indocyanine green (ICG) dye has been proposed to allow the proper localization of endometriotic lesions during surgery. Our purpose is to offer an overview of near-infrared (NIR)-ICG in the surgical treatment of superficial peritoneal endometriosis and deep infiltrating endometriosis. Material and methods Electronic databases were searched, including MEDLINE, Embase, Web of Science, Sc...
Source
Source
#1Sabrina A. N. Doelare (VU: VU University Amsterdam)
#2Stefan P.M. Smorenburg (VU: VU University Amsterdam)
Last. Kak K. Yeung (VU: VU University Amsterdam)H-Index: 3
view all 9 authors...
Purpose:To determine if image fusion will reduce contrast volume, radiation dose, and fluoroscopy and procedure times in standard and complex (fenestrated/branched) endovascular aneurysm repair (EV...
Source
#1Alexandre Tran (U of O: University of Ottawa)H-Index: 9
#2Jordan Heuser (U of O: University of Ottawa)H-Index: 1
Last. Guillaume Martel (Ottawa Hospital Research Institute)H-Index: 20
view all 5 authors...
Estimated blood loss (EBL) is an important tool in clinical decision-making and surgical outcomes research. It guides perioperative transfusion practice and serves as a key predictor of short-term perioperative risks and long-term oncologic outcomes. Despite its widespread clinical and research use, there is no gold standard for blood loss estimation. We sought to systematically review and compare techniques for intraoperative blood loss estimation in major non-cardiac surgery with the objective...
1 CitationsSource