Quality (philosophy)

Control (management)

Philosophy

Statistics

Accounting

Psychiatry

Economics

Data mining

Computer science

Business

Outlier

Variance (accounting)

Quality Score

Segmentation

Psychology

Pattern recognition (psychology)

Mathematics

Epistemology

Operations management

Artificial intelligence

Medicine

Metric (unit)

Gold standard (test)

Machine learning

Neuroimaging

NeuroImage

Quality control of brain segmentation is a fundamental step to ensure data quality. Manual quality control strategies are the current gold standard, although these may be unfeasible for large neuroimaging samples. Several options for automated quality control have been proposed, providing potential time efficient and reproducible alternatives. However, those have never been compared side to side, which prevents consensus in the appropriate quality control strategy to use. This study aimed to elucidate the changes manual editing of brain segmentations produce in morphological estimates, and to analyze and compare the effects of different quality control strategies on the reduction of the measurement error. Structural brain MRI from 259 participants of The Maastricht Study were used. Morphological estimates were automatically extracted using FreeSurfer 6.0. Segmentations with inaccuracies were manually edited, and morphological estimates were compared before and after editing. In parallel, 12 quality control strategies were applied to the full sample. Those included: two manual strategies, in which images were visually inspected and either excluded or manually edited; five automated strategies, where outliers were excluded based on the tools “MRIQC” and “Qoala-T”, and the metrics “morphological global measures”, “Euler numbers” and “Contrast-to-Noise ratio”; and five semi-automated strategies, where the outliers detected through the mentioned tools and metrics were not excluded, but visually inspected and manually edited. In order to quantify the effects of each quality control strategy, the proportion of unexplained variance relative to the total variance was extracted after the application of each strategy, and the resulting differences compared. Manually editing brain surfaces produced particularly large changes in subcortical brain volumes and moderate changes in cortical surface area, thickness and hippocampal volumes. The performance of the quality control strategies depended on the morphological measure of interest. Overall, manual quality control strategies yielded the largest reduction in relative unexplained variance. The best performing automated alternatives were those based on Euler numbers and MRIQC scores. The exclusion of outliers based on global morphological measures produced an increase of relative unexplained variance. Manual quality control strategies are the most reliable solution for quality control of brain segmentation and parcellation. However, measures must be taken to prevent the subjectivity associated with these strategies. The detection of inaccurate segmentations based on Euler numbers or MRIQC provides a time efficient and reproducible alternative. The exclusion of outliers based on global morphological estimates must be avoided.

Quality control strategies for brain MRI segmentation and parcellation: Practical approaches and recommendations - insights from the Maastricht study