Share
Embed
OpenTalks.AI - Сергей Кастрюлин, Ускорение МРТ с помощью нейронных сетей
OpenTalks.AI
February 21, 2020
Transcript
30 slides
-
© Philips - Confidential Nicola Pezzotti1, Elwin de Weerdt2, Sahar
Yousefi3, Mohamed S. Elmahdy3, Jeroen van Gemert2, Christophe Schülke1, Mariya Doneva1, Tim Nielsen1, Sergey Kastryulin1, Boudewijn P.F. Lelieveldt3, Matthias J.P. van Osch3, Marius Staring3 1 Philips Research 2 Philips Healthcare 3 Leiden University Medical Center FastMRI with Adaptive Intelligence Best performer in the FastMRI challenge (NeurIPS 2019) multi-coil 4x and 8x -
© Philips - Confidential MRIs give a wealth of information…
… but are slow (~20 min up to an hour) -
© Philips - Confidential The more data desire, the more
data required Image reconstruction Raw data Image MRI scanner -
© Philips - Confidential The more data desire, the more
data required Image reconstruction Raw data Image -
© Philips - Confidential Three different challenges Single-Coil 4x Easier
to experiment, simulated single coil measurement. Not used clinilcally. Multi-Coil 4x Clinically relevant, multiple coil measurements. ~2x faster than parallel imaging. Multi-Coil 8x Clinically relevant, multiple coil measurements. ~4x faster than parallel imaging. -
© Philips - Confidential Realistic scenario vs ease of experimentation
Almost all MRI scanners use technique called “parallel imaging” that uses multiple Receiver coils in order to capture information from different spatial locations. This can speed up scanning process by ~2x. -
© Philips - Confidential Evaluation Stage 1 SSIM (Structural Similarity
Index Metric) measures the perceived change in structural information between two images. As with other quantitative metrics, may not capture qualitative differences perceived by radiologists. Stage 2 Top 4 entries as scored by SSIM are ranked by 7 radiologists. Winners determined by the best average radiologist ranking. -
© Philips - Confidential Adaptive CS-Network A Deep Learning solution
that integrates Compressed-Sensing theory -
© Philips - Confidential Compressed Sensing for MR reconstruction 18
Iteration n Iteration n+1 Initial Image Intermediate Final Image F(): Sparsifying transform F-1(): Invert Sparsification Thresholding Function Thresholding Function Wavelet decomposition Wavelet decomposition -
© Philips - Confidential Adaptive CS-Network Combination of Compressed-Sensing theory
and Deep-Learning Iterative AI-Based Compressed-Sensing approach + + + + + Iterative – Multiscale – MR Physics • -
© Philips - Confidential Adaptive CS-Network " . $ "
. " . Filtered-UNet • UNet-like design • Each feature map is filtered • Only basic DL operations to retain control • Convolution 2D without bias term • Leaky ReLU • Max pooling • Interpolation 2D • 2.5D Convolutions • Loss applied to the central slice only " . $ " . " . -
© Philips - Confidential Adaptive CS-Network ' ( ) "*(
" ' . ( . " . " . $ " . " . " "*( Deep-Learning Based -
© Philips - Confidential Adaptive CS-Network ' ( ) "*(
" ' . ( . " . -," / -0 - (" , ) / (" ) -0 (" ) " . $ " . " . " "*( + Deep-Learning Based MR-Specific Knowledge -
© Philips - Confidential Loss function definition Multiscale-SSIM We adopted
a mixed approach Loss =0.86 * MSSSIM + 0.14 * L1 • Better results reported in literature • Higher SSIM metric • Less artifacts in the image -
© Philips - Confidential Loss function definition Panels of diverse
reconstructions were shown to radiologists and clinical scientists -
© Philips - Confidential Winners Single-coil 4x University of Amsterdam
Multi-coil 4x United Imaging Intelligence/John Hopkins University Philips Multi-coil 8x Philips -
© Philips - Confidential Zero Filled Reconstruction Ground-truth Volume: 1000108
– Effective acceleration: 3.64x – SSIM: 0.9885 -
© Philips - Confidential Zero Filled Reconstruction Ground-truth Volume: 1002340
– Effective acceleration: 9.68x – SSIM: 0.8254 -
© Philips - Confidential Conclusion • Improvement over compressed-sensing is
within reach • Importance to involve Radiologist and Clinical Scientist • To design loss functions • To evaluate results • Importance of combining prior-knowledge in Deep- Learning solutions • Compressed sensing • MR Physics Paper from NeurIPS’19: https://arxiv.org/abs/1912.12259 -
© Philips - Confidential Nicola Pezzotti1, Elwin de Weerdt2, Sahar
Yousefi3, Mohamed S. Elmahdy3, Jeroen van Gemert2, Christophe Schülke1, Mariya Doneva1, Tim Nielsen1, Sergey Kastryulin1, Boudewijn P.F. Lelieveldt3, Matthias J.P. van Osch3, Marius Staring3 1 Philips Research 2 Philips Healthcare 3 Leiden University Medical Center Q&A