RimNet: A deep 3D multimodal MRI architecture for paramagnetic rim lesion assessment in multiple sclerosis

Objectives In multiple sclerosis (MS), the presence of a paramagnetic rim at the edge of non-gadolinium-enhancing lesions indicates perilesional chronic inflammation. Patients featuring a higher paramagnetic rim lesion burden tend to have more aggressive disease. The objective of this study was to develop and evaluate a convolutional neural network (CNN) architecture (RimNet) for automated detection of paramagnetic rim lesions in MS employing multiple magnetic resonance (MR) imaging contrasts. Materials and methods Imaging data were acquired at 3 Tesla on three different scanners from two different centers, totaling 124 MS patients, and studied retrospectively. Paramagnetic rim lesion detection was independently assessed by two expert raters on T2*-phase images, yielding 462 rim-positive (rim+) and 4857 rim-negative (rim-) lesions. RimNet was designed using 3D patches centered on candidate lesions in 3D-EPI phase and 3D FLAIR as input to two network branches. The interconnection of branches at both the first network blocks and the last fully connected layers favors the extraction of low and high-level multimodal features, respectively. RimNet’s performance was quantitatively evaluated against experts’ evaluation from both lesion-wise and patient-wise perspectives. For the latter, patients were categorized based on a clinically relevant threshold of 4 rim+ lesions per patient. The individual prediction capabilities of the images were also explored and compared (DeLong test) by testing a CNN trained with one image as input (unimodal). Results The unimodal exploration showed the superior performance of 3D-EPI phase and 3D-EPI magnitude images in the rim+/- classification task (AUC = 0.913 and 0.901), compared to the 3D FLAIR (AUC = 0.855, Ps < 0.0001). The proposed multimodal RimNet prototype clearly outperformed the best unimodal approach (AUC = 0.943, P < 0.0001). The sensitivity and specificity achieved by RimNet (70.6% and 94.9%, respectively) are comparable to those of experts at the lesion level. In the patient-wise analysis, RimNet performed with an accuracy of 89.5% and a Dice coefficient (or F1 score) of 83.5%. Conclusions The proposed prototype showed promising performance, supporting the usage of RimNet for speeding up and standardizing the paramagnetic rim lesions analysis in MS.

Multicontrast MRI Quantification of Focal Inflammation and Degeneration in Multiple Sclerosis

Guillaume Bonnier, Cristina Granziera, Ying-Chia Lin, Gloria Menegaz, Djalel Eddine Meskaldji, Alexis Roche, David Paul Roger Romascano, Jean-Philippe Thiran

Introduction. Local microstructural pathology in multiple sclerosis patients might influence their clinical performance. This study applied multicontrast MRI to quantify inflammation and neurodegeneration in MS lesions. We explored the impact of MRI-based lesion pathology in cognition and disability. Methods. 36 relapsing-remitting MS subjects and 18 healthy controls underwent neurological, cognitive, behavioural examinations and 3 T MRI including (i) fluid attenuated inversion recovery, double inversion recovery, and magnetization-prepared gradient echo for lesion count; (ii) T1, T2, and T2(*) relaxometry and magnetisation transfer imaging for lesion tissue characterization. Lesions were classified according to the extent of inflammation/neurodegeneration. A generalized linear model assessed the contribution of lesion groups to clinical performances. Results. Four lesion groups were identified and characterized by (1) absence of significant alterations, (2) prevalent inflammation, (3) concomitant inflammation and microdegeneration, and (4) prevalent tissue loss. Groups 1, 3, 4 correlated with general disability (Adj-R (2) = 0.6; P = 0.0005), executive function (Adj-R (2) = 0.5; P = 0.004), verbal memory (Adj-R (2) = 0.4; P = 0.02), and attention (Adj-R (2) = 0.5; P = 0.002). Conclusion. Multicontrast MRI provides a new approach to infer in vivo histopathology of plaques. Our results support evidence that neurodegeneration is the major determinant of patients' disability and cognitive dysfunction.

Hindawi Publishing Corporation2015

Automated Detection and Segmentation of Multiple Sclerosis Lesions Using Ultra-High-Field MP2RAGE

Meritxell Bach Cuadra, Mario Joao Fartaria de Oliveira, Cristina Granziera, Tobias Kober

Objectives The aim of this study was to develop a new automated segmentation method of white matter (WM) and cortical multiple sclerosis (MS) lesions visible on magnetization-prepared 2 inversion-contrast rapid gradient echo (MP2RAGE) images acquired at 7 T MRI. Materials and Methods The proposed prototype (MSLAST [Multiple Sclerosis Lesion Analysis at Seven Tesla]) takes as input a single image contrast derived from the 7T MP2RAGE prototype sequence and is based on partial volume estimation and topological constraints. First, MSLAST performs a skull-strip of MP2RAGE images and computes tissue concentration maps for WM, gray matter (GM), and cerebrospinal fluid (CSF) using a partial volume model of tissues within each voxel. Second, MSLAST performs (1) connected-component analysis to GM and CSF concentration maps to classify small isolated components as MS lesions; (2) hole-filling in the WM concentration map to classify areas with low WM concentration surrounded by WM (ie, MS lesions); and (3) outlier rejection to the WM mask to improve the classification of small WM lesions. Third, MSLAST unifies the 3 maps obtained from 1, 2, and 3 processing steps to generate a global lesion mask. Results Quantitative and qualitative assessments were performed using MSLAST in 25 MS patients from 2 research centers. Overall, MSLAST detected a median of 71% of MS lesions, specifically 74% of WM and 58% of cortical lesions, when a minimum lesion size of 6 mu L was considered. The median false-positive rate was 40%. When a 15 mu L minimal lesions size was applied, which is the approximation of the minimal size recommended for 1.5/3 T images, the median detection rate was 80% for WM and 63% for cortical lesions, respectively, and the median false-positive rate was 33%. We observed high correlation between MSLAST and manual segmentations (Spearman rank correlation coefficient, rho = 0.91), although MSLAST underestimated the total lesion volume (average difference of 1.1 mL), especially in patients with high lesion loads. MSLAST also showed good scan-rescan repeatability within the same session with an average absolute volume difference and F1 score of 0.38 +/- 0.32 mL and 84%, respectively. Conclusions We propose a new methodology to facilitate the segmentation of WM and cortical MS lesions at 7 T MRI, our approach uses a single MP2RAGE scan and may be of special interest to clinicians and researchers.

LIPPINCOTT WILLIAMS & WILKINS2019

CVSnet: A machine learning approach for automated central vein sign assessment in multiple sclerosis

Meritxell Bach Cuadra, Mario Joao Fartaria de Oliveira, João Pedro Forjaco Jorge, Cristina Granziera, Tobias Kober, Francesco La Rosa, Reto Meuli, Jonas Richiardi

The central vein sign (CVS) is an efficient imaging biomarker for multiple sclerosis (MS) diagnosis, but its application in clinical routine is limited by inter-rater variability and the expenditure of time associated with manual assessment. We describe a deep learning-based prototype for automated assessment of the CVS in white matter MS lesions using data from three different imaging centers. We retrospectively analyzed data from 3 T magnetic resonance images acquired on four scanners from two different vendors, including adults with MS (n = 42), MS mimics (n = 33, encompassing 12 distinct neurological diseases mimicking MS) and uncertain diagnosis (n = 5). Brain white matter lesions were manually segmented on FLAIR* images. Perivenular assessment was performed according to consensus guidelines and used as ground truth, yielding 539 CVS-positive (CVS+) and 448 CVS-negative (CVS-) lesions. A 3D convolutional neural network ("CVSnet") was designed and trained on 47 datasets, keeping 33 for testing. FLAIR* lesion patches of CVS+/CVS- lesions were used for training and validation (n = 375/298) and for testing (n = 164/150). Performance was evaluated lesion-wise and subject-wise and compared with a state-of-the-art vesselness filtering approach through McNemar's test. The proposed CVSnet approached human performance, with lesion-wise median balanced accuracy of 81%, and subject-wise balanced accuracy of 89% on the validation set, and 91% on the test set. The process of CVS assessment, in previously manually segmented lesions, was similar to 600-fold faster using the proposed CVSnet compared with human visual assessment (test set: 4 seconds vs. 40 minutes). On the validation and test sets, the lesion-wise performance outperformed the vesselness filter method (P < 0.001). The proposed deep learning prototype shows promising performance in differentiating MS from its mimics. Our approach was evaluated using data from different hospitals, enabling larger multicenter trials to evaluate the benefit of introducing the CVS marker into MS diagnostic criteria.