Validated System for Centralized Grading of Retinopathy of Prematurity: Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity (e-ROP) Study

Published on Jun 1, 2015in JAMA Ophthalmology7.389
· DOI :10.1001/JAMAOPHTHALMOL.2015.0460
Ebenezer Daniel39
Estimated H-index: 39
(UPenn: University of Pennsylvania),
Antonio Capone9
Estimated H-index: 9
(Oakland University)
Sources
Abstract
Importance Measurable competence derived from comprehensive and advanced training in grading digital images is critical in studies using a reading center to evaluate retinal fundus images from infants at risk for retinopathy of prematurity (ROP). Details of certification for nonphysician trained readers (TRs) have not yet been described. Objective To describe a centralized system for grading ROP digital images by TRs in the Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity (e-ROP) Study. Design, Setting, and Participants Multicenter observational cohort study conducted from July 1, 2010, to June 30, 2014. The TRs were trained by experienced ROP specialists and certified to detect ROP morphology in digital retinal images under supervision of an ophthalmologist reading center director. An ROP reading center was developed with standard hardware, secure Internet access, and customized image viewing software with an electronic grading form. A detailed protocol for grading was developed. Based on results of TR gradings, a computerized algorithm determined whether referral-warranted ROP (RW-ROP; defined as presence of plus disease, zone I ROP, and stage 3 or worse ROP) was present in digital images from infants with birth weight less than 1251 g enrolled from May 25, 2011, through October 31, 2013. Independent double grading was done by the TRs with adjudication of discrepant fields performed by the reading center director. Exposure Digital retinal images. Main Outcomes and Measures Intragrader and intergrader variability and monitoring for temporal drift. Results Four TRs underwent rigorous training and certification. A total of 5520 image sets were double graded, with 24.5% requiring adjudication for at least 1 component of RW-ROP. For individual RW-ROP components, the adjudication rate was 3.9% for plus disease, 12.4% for zone I ROP, and 16.9% for stage 3 or worse ROP. The weighted κ for intergrader agreement (n = 80 image sets) was 0.72 (95% CI, 0.52-0.93) for RW-ROP, 0.57 (95% CI, 0.37-0.77) for plus disease, 0.43 (95% CI, 0.24-0.63) for zone I ROP, and 0.67 (95% CI, 0.47-0.88) for stage 3 or worse ROP. The weighted κ for grade-regrade agreement was 0.77 (95% CI, 0.57-0.97) for RW-ROP, 0.87 (95% CI, 0.67-1.00) for plus disease, 0.70 (95% CI, 0.51-0.90) for zone I ROP, and 0.77 (95% CI, 0.57-0.97) for stage 3 or worse ROP. Conclusions and Relevance These data suggest that the e-ROP system for training and certifying nonphysicians to grade ROP images under the supervision of a reading center director reliably detects potentially serious ROP with good intragrader and intergrader consistency and minimal temporal drift.
Download
📖 Papers frequently viewed together
19977.13Pediatrics
References19
Newest
#1Graham E. Quinn (Children's Hospital of Philadelphia)H-Index: 70
#2Gui-Shuang Ying (UPenn: University of Pennsylvania)H-Index: 67
Last. Kelly C. Wade (Children's Hospital of Philadelphia)H-Index: 21
view all 9 authors...
Importance The present strategy to identify infants needing treatment for retinopathy of prematurity (ROP) requires repeated examinations of at-risk infants by physicians. However, less than 10% ultimately require treatment. Retinal imaging by nonphysicians with remote image interpretation by nonphysicians may provide a more efficient strategy. Objective To evaluate the validity of a telemedicine system to identify infants who have sufficiently severe ROP to require evaluation by an ophthalmolog...
Source
Purpose: Detecting sight-threatening retinopathy of prematurity (ROP) relies on a diagnostic examination (DE) performed by an experienced ophthalmologist. An alternative may be a telemedicine system where retinal images of at-risk infants are graded by readers to determine features of ROP indicating the need for a DE. Methods: The multicenter Telemedicine Approaches to Evaluating Acute-phase ROP (e-ROP) Study is a cohort study of 2000 infants with birth weights 51251 g. At each visit, ophthalmol...
Source
#1Natalia FijalkowskiH-Index: 10
#2Luo Luo ZhengH-Index: 6
Last. Darius M. MoshfeghiH-Index: 41
view all 7 authors...
BACKGROUND AND OBJECTIVE: To report the 5-year results of the Stanford University Network for Diagnosis of Retinopathy of Prematurity (SUNDROP) telemedicine initiative. PATIENTS AND METHODS: Infants requiring retinopathy of prematurity (ROP) screening at six neonatal intensive care units from December 1, 2005, to November 30, 2010, were evaluated with remote retinal photography by an ROP specialist. Every infant received outpatient binocular indirect ophthalmoscope examinations until termination...
Source
#1Anand VinekarH-Index: 18
#2Clare Gilbert (Lond: University of London)H-Index: 71
Last. Noël J.C. Bauer (UM: Maastricht University)H-Index: 20
view all 7 authors...
Aim: To report the Karnataka Internet Assisted Diagnosis of Retinopathy of Prematurity (KIDROP) program for retinopathy of prematurity (ROP) screening in underserved rural areas using an indigenously developed tele-ROP model. Materials and Methods: KIDROP currently provides ROP screening and treatment services in three zones and 81 neonatal units in Karnataka, India. Technicians were trained to use a portable Retcam Shuttle (Clarity, USA) and validated against ROP experts performing indirect oph...
Source
#1Nina J. Hewing (Charité)H-Index: 4
#2David R. Kaufman (Columbia University)H-Index: 32
Last. Michael F. Chiang (OHSU: Oregon Health & Science University)H-Index: 52
view all 4 authors...
Importance Plus disease is the most important parameter that characterizes severe treatment-requiring retinopathy of prematurity, yet diagnostic agreement among experts is imperfect and the precise factors involved in clinical diagnosis are unclear. This study is designed to address these gaps in knowledge by analyzing cognitive aspects of the plus disease diagnostic process by experts. Objective To examine the diagnostic reasoning process of experts for plus disease in retinopathy of prematurit...
Source
#1Krishna R Murthy (International Institute of Minnesota)H-Index: 16
#2Praveen R Murthy (International Institute of Minnesota)H-Index: 8
Last. Naveen BenakappaH-Index: 1
view all 6 authors...
Purpose To identify and compare the profile of retinopathy of prematurity (ROP) in premature babies in urban and semiurban neonatal intensive care units (NICUs). Methods A prospective study of babies admitted to NICUs of two urban and seven semiurban centres. They were Results 500 babies were screened (243, urban group; 257, semiurban group). Incidence of ROP in the urban and semiurban groups was 16.5% (40) and 14.8% (38) respectively. Mean gestational age was 30.90 weeks and 31.53 weeks respect...
Source
#1Lingkun Kong (BCM: Baylor College of Medicine)H-Index: 9
#2Melinda Fry (BCM: Baylor College of Medicine)H-Index: 1
Last. Paul G. Steinkuller (BCM: Baylor College of Medicine)H-Index: 16
view all 5 authors...
Purpose To summarize the available data on pediatric blinding disease worldwide and to present current information on childhood blindness in the United States. Methods A systematic search of world literature published since 1999 was conducted. Data also were solicited from each state school for the blind in the United States. Results In developing countries, 7% to 31% of childhood blindness and visual impairment is avoidable, 10% to 58% is treatable, and 3% to 28% is preventable. Corneal opacifi...
Source
#1Michael F. Chiang (Columbia University)H-Index: 52
#2Preeti J. Thyparampil (Columbia University)H-Index: 7
Last. Daniel Rabinowitz (Columbia University)H-Index: 29
view all 3 authors...
Objective To characterize variability in the identification of the macular center among retinopathy of prematurity (ROP) experts. Methods A printed set of 25 wide-angle retinal images was compiled from infants at risk for ROP using a commercially available camera. Ten recognized ROP experts were asked to mark the macular center on each image. For each image, we measured the distance from the optic disc center to the marked macular center. Distances were standardized by normalizing the horizontal...
Source
#1Steven L. Williams (Columbia University)H-Index: 7
#2Lu Wang (Columbia University)H-Index: 6
Last. Michael F. Chiang (Columbia University)H-Index: 52
view all 10 authors...
Background/aims To assess accuracy of telemedical retinopathy of prematurity (ROP) diagnosis by trained non-expert graders compared with expert graders. Methods Eye examinations (n=248) from 67 consecutive infants were captured using wide-angle retinal photography (RetCam-II, Clarity Medical Systems, Pleasanton, California, USA). Non-expert graders attended two 1-h training sessions on image-based ROP diagnosis. Using a web-based telemedicine system, 14 non-expert and three expert graders provid...
Source
#1David K. Wallace (Duke University)H-Index: 51
#2Graham E. Quinn (Children's Hospital of Philadelphia)H-Index: 70
Last. Michael F. Chiang (Columbia University)H-Index: 52
view all 4 authors...
Purpose Plus disease has become the major criterion for laser treatment in infants with retinopathy of prematurity (ROP), but its assessment is subjective. Our purpose was to compare quadrant-level and eye-level assessment of plus disease and pre-plus disease among 3 experienced ROP examiners and to report their rate of agreement. Methods One hundred eighty-one high-quality RetCam images from premature infants were graded by 3 of the authors. Dilation and tortuosity were judged separately using ...
Source
Cited By45
Newest
#1Abeer Azzuqa (University of Pittsburgh)H-Index: 4
#2Abhishek MakkarH-Index: 4
Last. Kerri Z. MachutH-Index: 2
view all 3 authors...
The regionalization of neonatal care was implemented with an overarching goal to improve neonatal outcomes.1 This led to centralized neonatal care in urban settings that jeopardized the sustainability of the community level 2 and level 3 Neonatal Intensive Care Units (NICU) in medically underserved areas.2 Coupled with pediatric subspecialist and allied health professional workforce shortages, regionalization resulted in disparate and limited access to subspecialty care.3-6 Innovative telemedici...
Source
#1Tatiana R. Rosenblatt (Stanford University)H-Index: 3
#2Marco H. Ji (Stanford University)H-Index: 3
Last. Darius M. Moshfeghi (Stanford University)H-Index: 41
view all 9 authors...
To describe a database of longitudinally graded telemedicine retinal images to be used as a comparator for future studies assessing grader recall bias and ability to detect typical progression (e.g. International Classification of Retinopathy of Prematurity (ICROP) stages) as well as incremental changes in retinopathy of prematurity (ROP). Cohort comprised of retinal images from 84 eyes of 42 patients who were sequentially screened for ROP over 6 consecutive weeks in a telemedicine program and t...
Source
#1Farshid Khorasani (Tehran University of Medical Sciences)
#2Ramak Roohi poor (UT: University of Tehran)
Last. Mohammad Reza Zarkesh (Tehran University of Medical Sciences)H-Index: 3
view all 5 authors...
Background: Nowadays with advanced improvement in NICUs, more preterm infants are surviving with more risks related to ROP. Objectives: The aim of the present study was to collect ROP risk factors and design data mining techniques to suggest a predictive ROP treatment-requiring model. Methods: A cross-sectional study was carried out in an Iranian hospital (2014 - 2018). The population study consisted of 76 preterm neonates with ROP diagnosis. Of all, retinopathy was treated in 35 cases and other...
Source
Last. Varis RuamviboonsukH-Index: 1
view all 4 authors...
Source
#1Leah A. Owen (UofU: University of Utah)H-Index: 13
#2Kinsey Shirer (MUSC: Medical University of South Carolina)
Last. Margaret M. DeAngelis (UofU: University of Utah)H-Index: 34
view all 11 authors...
Retinopathy of prematurity (ROP) is a blinding aberrancy of retinal vascular maturation in preterm infants. Despite delayed onset after preterm birth, representing a window for therapeutic intervention, we cannot prevent or cure ROP blindness. A natural form of ROP protection exists in the setting of early-onset maternal preeclampsia, though is not well characterized. As ischemia is a central feature in both ROP and preeclampsia, we hypothesized that angiogenesis mediators may underlie this prot...
Source
#1Qianqian Ellie Cheng (Florida State University College of Arts and Sciences)H-Index: 1
#2Graham E. Quinn (UPenn: University of Pennsylvania)H-Index: 70
Last. Gui-Shuang Ying (UPenn: University of Pennsylvania)H-Index: 67
view all 6 authors...
PURPOSE To determine the incidence of and timing and predictors for progression from pre-plus to plus disease, based on evaluation of images. METHODS Two trained readers independently evaluated posterior pole images of infants from 13 North American centers for pre-plus/plus disease, stage, and zone of retinopathy of prematurity (ROP). Discrepancies between readers were adjudicated. To be eligible for analysis, eyes had to have at least two imaging sessions, the earlier one with pre-plus disease...
Source
#1Alejandra Daruich (University of Paris)H-Index: 16
#3Francine Behar-Cohen (University of Paris)H-Index: 63
Last. Elsa Kermorvant (University of Paris)H-Index: 1
view all 4 authors...
Retinopathy of prematurity (ROP) is one of the leading cause of preventable blindness in children. Its incidence increases with increasing survival of extremely preterm babies. ROP results from a multifactorial impairment of retinal development, the retinal vascular network, involving both oxygen-dependent and nutritional factors. The numerous factors involved in ROP development suggest that preventive strategies should be synergistic and complementary, including tight control of oxygen therapy,...
Source
#1John D. Melville (MUSC: Medical University of South Carolina)H-Index: 6
#2Natalie Laub (UCSD: University of California, San Diego)H-Index: 1
Last. Vincent J. Palusci (NYU: New York University)H-Index: 21
view all 3 authors...
Abstract Child abuse is a common and morbid condition that is frequently identified in the emergency department, but emergency departments far outnumber specialized child abuse pediatricians. The small size and slow growth of child abuse as a specialty requires innovative approaches to ensure that specialized services are available to all children who may have been abused. This review covers the history and core concepts of telemedicine in child abuse pediatrics, highlighting services including ...
Source
#1Mark B. Horton (Indian Health Service)H-Index: 13
#2Christopher J. Brady (UVM: University of Vermont)H-Index: 17
Last. Ingrid Zimmer-Galler (Johns Hopkins University)H-Index: 22
view all 16 authors...
Contributors The following document and appendices represent the third edition of the Practice Guidelines for Ocular Telehealth-Diabetic Retinopathy. These guidelines were developed by the Diabetic...
Source
#1Jui-Yen Lin (Memorial Hospital of South Bend)H-Index: 3
#2Eugene Yu-Chuan Kang (Memorial Hospital of South Bend)H-Index: 5
Last. Wei-Chi Wu (CGU: Chang Gung University)H-Index: 25
view all 9 authors...
PURPOSE: Although Taiwan was one of the first countries to develop coronavirus disease 2019 (COVID-19), with effective antiepidemic measures, Taiwan has effectively controlled the spread of the disease. The purpose of this article is to provide useful safety strategies for ophthalmologists in daily practice during the COVID-19 pandemic. MATERIALS AND METHODS: Infection control strategies in the hospital and Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou, are discussed. RESULTS...
Source
This website uses cookies.
We use cookies to improve your online experience. By continuing to use our website we assume you agree to the placement of these cookies.
To learn more, you can find in our Privacy Policy.