Skip to main navigation Skip to search Skip to main content

MSRepaint: Multiple Sclerosis Repaint with conditional denoising diffusion implicit model for bidirectional lesion filling and synthesis

  • Jinwei Zhang
  • , Lianrui Zuo
  • , Yihao Liu
  • , Hang Zhang
  • , Samuel W Remedios
  • , Bennett A Landman
  • , Peter A Calabresi
  • , Shiv Saidha
  • , Scott D Newsome
  • , Dzung L Pham
  • , Jerry L Prince
  • , Ellen M Mowry
  • , Aaron Carass

Research output: Contribution to journal › Article › peer-review

Abstract

In multiple sclerosis (MS), lesions interfere with automated magnetic resonance imaging (MRI) analyses such as brain parcellation and deformable registration, while lesion segmentation models are hindered by the limited availability of annotated training data. To address both issues, we propose MSRepaint, a unified diffusion-based generative model for bidirectional lesion filling and synthesis that restores anatomical continuity for downstream analyses and augments segmentation through realistic data generation. MSRepaint conditions on spatial lesion masks for voxel-level control, incorporates contrast dropout to handle missing inputs, integrates a repainting mechanism to preserve surrounding anatomy during lesion filling and synthesis, and employs a multi-view DDIM inversion and fusion pipeline for 3D consistency with fast inference. Extensive evaluations demonstrate the effectiveness of MSRepaint across multiple tasks. For lesion filling, we evaluate both the accuracy within the filled regions and the impact on downstream tasks including brain parcellation and deformable registration. MSRepaint outperforms the FSL and NiftySeg lesion filling methods, and achieves accuracy on par with FastSurfer-LIT, a recent diffusion model-based lesion filling method, while offering over 20×faster inference. For lesion synthesis, state-of-the-art MS lesion segmentation models trained on MSRepaint-synthesized data outperform those trained on CarveMix-synthesized data or real ISBI challenge training data across multiple benchmarks, including the MICCAI 2016 and UMCL datasets. Additionally, we demonstrate that MSRepaint's unified bidirectional filling and synthesis capability, with full spatial control over lesion appearance, enables high-fidelity mask-conditioned voxel-wise control of lesion appearance within a unified framework. Our code is available at https://github.com/Jinwei1209/msrepaint.

Original languageEnglish
Pages (from-to)104338
JournalMedical Image Analysis
Volume115
DOIs
StatePublished - Jan 2027

Keywords

  • Humans
  • Multiple Sclerosis/diagnostic imaging
  • Image Interpretation, Computer-Assisted/methods
  • Algorithms
  • Generative Artificial Intelligence
  • Magnetic Resonance Imaging/methods
  • Diffusion Magnetic Resonance Imaging/methods
  • Brain/diagnostic imaging
  • Image Processing, Computer-Assisted/methods

Fingerprint

Dive into the research topics of 'MSRepaint: Multiple Sclerosis Repaint with conditional denoising diffusion implicit model for bidirectional lesion filling and synthesis'. Together they form a unique fingerprint.

Cite this