IronTract Challenge - Round I results

93db9b0e0345ae07590524726fec5e95?s=47 Paulo
October 09, 2020

IronTract Challenge - Round I results

93db9b0e0345ae07590524726fec5e95?s=128

Paulo

October 09, 2020
Tweet

Transcript

  1. The IronTract challenge: Validation and optimal tractography methods for the

    HCP diffusion acquisition scheme C. Maffei , G. Girard , K. G. Schilling , N. Adluru , D. B. Aydogan , A. Hamamci , F. Yeh , M. Mancini , Y. Wu , A. Sarica , A. Teillac , S. H. Baete , D. Karimi , Y. Lin , F. Boada , N. Richard , B. Hiba , A. Quattrone , Y. Hong , D. Shen , P. Yap , T. Boshkovski , J. S. W. Campbell , N. Stikov , G. B. Pike , B. B. Bendlin , A. L. Alexander , V. Prabhakaran , A. Anderson , B. A. Landman , E. J.Z. Canales-Rodrígue , M. Barakovic , J. Rafael-Patino , T. Yu , G. Rensonnet , S. Schiavi , A. Daducci , M. Pizzolato , E. Fischi- Gomez , J. Thiran , G. Dai , G. Grisot , N. Lazovski , A. Puente , M. Rowe , I. Sanchez , V. Prchkovska , R. Jones , J. Lehman , S. Haber , A. Yendiki RESULTS FROM ROUND I
  2. Kissing Fibres Fanning Fibres Crossing Fibres Courtesy of Hui Wang

    Introduction: Tractography limitations Previous challenges: • Limited angular or spatial resolution • Single acquisition scheme • Comparison using different brains IronTract challenge goals: • Understand which methods/processing strategies lead to optimal tractography accuracy for the two-shell HCP scheme • Investigate whether those methods could achieve even higher accuracy with a different acquisition scheme.
  3. Training + Validation Case Anatomical Specificity Anatomical Complexity Methods Consistency

    DSI + Multishell diffusion schemes DSI Grid Multishel l Evaluate wider range of methods Compare different sampling schemes Test methods for HCP sampling scheme True Positive Rate False Positive Rate Tractography results at different thresholds Investigate the Sensitivity-Specificity Tradeoff Compare different methods at the same FPR ROC Analysis Introduction: Why is this challenge unique?
  4. HCP Scheme Ex-vivo diffusion MRI NU-IFFT DSI Grid Training Case

    Validation Case Resampled Methods: The challenge timeline 4.7T Bruker 3D EPI 0.7 mm iso DSI HCP 0.0 0.1 0.2 0.3 AUC Score Parameter Optimization Fessler & Sutton ‘03 bmax =40000s/mm2 515 Volumes bmax =6000,12000s/mm2 186 Volumes
  5. Registered Teams = 30 Final Submissions = 17 Teams: 12

    Total Submissions = 226 Training = 187 Validation = 39 H D H D Results: Submission Details
  6. Results: ROC analysis TrackMcTrackface TwoPathsDverged Accesschallenge X-link Team7 Tractogram SpaghettiBeans

    HAFT SimiaInuus TractographyValidationTeam TheUpsideDown BGKK
  7. Results: ROC analysis TrackMcTrackface Accesschallenge X-link SimiaInuus HAFT

  8. Results: ROC analysis TrackMcTrackface Accesschallenge X-link SimiaInuus HAFT TrackMcTrackface TwoPathsDverged

    Accesschallenge X-link Team7 Tractogram SpaghettiBeans HAFT SimiaInuus TractographyValidationTeam TheUpsideDown BGKK
  9. Results: ROC analysis TrackMcTrackface Accesschallenge X-link SimiaInuus HAFT TrackMcTrackface Accesschallenge

    X-link SimiaInuus HAFT
  10. Training Data Validation Data HCP DSI HCP DSI Results: Accuracy

    Comparison
  11. Results: True Positives/False Negatives Localization

  12. HCP DSI Results: True Positives/False Negatives Localization TPR TPR

  13. • Better performance in training: tuning improves sensitivity Optimizing analysis

    for one injection site does not guarantee optimality for another Some methods showed consistently high performance in both datasets Conclusions
  14. • Better performance in training: tuning improves sensitivity Optimizing analysis

    for one injection site does not guarantee optimality for another Some methods showed consistently high performance in both datasets • Higher sensitivity for DSI than multishell HCP acquisition scheme When analysis methods are optimized, the HCP scheme may achieve similar accuracy Conclusions
  15. • Better performance in training: tuning improves sensitivity Optimizing analysis

    for one injection site does not guarantee optimality for another Some methods showed consistently high performance in both datasets • Higher sensitivity for DSI than multishell HCP When analysis methods are optimized, the HCP scheme may achieve similar accuracy • Probabilistic tractography + CSD model + use of constraining masks = increased sensitivity Best method for HCP acquisition scheme Conclusions
  16. • Better performance in training: tuning improves sensitivity Optimizing analysis

    for one injection site does not guarantee optimality for another Some methods showed consistently high performance in both datasets • Higher sensitivity for DSI than multishell HCP When analysis methods are optimized, the HCP scheme may achieve similar accuracy • Probabilistic tractography + CSD model + use of constraining masks = increased sensitivity Best method for HCP acquisition scheme • False negative mainly found far from injections site and at splitting regions Conclusions
  17. • What if all the participants applied some steps of

    the winner method? 2 winning strategies: post-processing filtering Use of constraining ROIs based on known anatomy Next Steps:
  18. • What if all the participants applied some steps of

    the winner method? 2 winning strategies: post-processing filtering Use of constraining ROIs based on known anatomy Next Steps: IronTract ROUND II
  19. • What if all the participants applied some steps of

    the winner method? 2 winning strategies: post-processing filtering Use of constraining ROIs based on known anatomy Next Steps: IronTract ROUND II • We are asking participants to: Run their tractography method on harmonized preprocessed data Post-process their data using the two winning post-processing strategies
  20. • What if all the participants applied some steps of

    the winner method? 2 winning strategies: post-processing filtering Use of constraining ROIs based on known anatomy Next Steps: IronTract ROUND II • We are asking participants to: Run their tractography method on harmonized preprocessed data Post-process their data using the two winning strategies Monetary Prizes for winners! New Deadline: November 8th