Entry Date:
May 1, 2020

QTIM@MGH: The Quantitative Translational Imaging in Medicine Lab at the Martinos Center

Principal Investigator Bruce Rosen

Project Website https://qtim-lab.github.io/

Project Start Date October 2020


The lab focuses on developing quantitative imaging biomarkers for cancer and other diseases using advanced imaging techniques and machine learning methods. We are comprised of computer science researchers, medical physicists, neuro-oncologists, and MRI technicians, and we are always looking to collaborate with experts outside of our field. We have recently worked to apply deep learning methods to a variety of diseases, and our goal is to unite the cutting edges of machine learning, medical oncology, and image analysis into practical clinical applications. Research topics include:

Brain Lesion Segmentation -- We are developing deep learning algorithms to perform lesion segmentation from multi-sequence MRI for various diseases including glioma, brain metastases, adrenoleukodystrophy and stroke.

Radiogenomics -- Identification of tumor mutation status can improve prognostication and guide patient management, but requires a highly invasive biopsy. We are developing a “virtual biopsy” technique based on deep learning that may be applied to multi-sequence MRI to accurately predict isocitrate dehydrogenase (IDH) mutations and 1p19q co-deletions in glioma.

Retinopathy of Prematurity -- Retinopathy of prematurity (ROP) is a disease that affects the retinal vasculature of preterm and low birthweight infants. We are developing algorithms for retinal vessel segmentation and automated diagnosis from fundus photographs based on deep learning, as well as risk models to predict treatment-requiring disease.

Open-Source Imaging Software -- The goal is to provide readily-usable software applications for the clinical and research community in neuroimaging. We develop software for 3D Slicer, an open-source analysis and visualization platform for medical images, and develop user-friendly Python packages for machine learning algorithms. Most recently, we are developing DeepNeuro, a deep learning neuroimaging package that uses Docker containers to ensure easy, repeatable implementation of neural network architectures.

Distributed Learning -- Training deep neural networks typically requires centrally-hosted data, which presents challenges for multi-institutional collaborations both in terms of logistics and HIPAA compliance. We are developing a platform that allows distribution of neural network models that serves as an effective alternative to sharing patient data.

Therapeutic Clinical Trials -- Using advanced MRI or PET acquisition and analysis approaches, we are focused on better understanding why (or why not) novel drugs are working in patients with primary or metastatic brain tumors. These noninvasive tools are critical to improving care for patients with these challenging diseases by understanding drug mechanism of action and the biological impact of new drugs on the tumor.

Dynamic MRI Analysis -- We are developing novel methods for analyzing dynamic MRI, including dynamic susceptibility (DSC) MRI and dynamic contrast-enhanced MRI (DCE). We evaluate the accuracy and repeatability of common dynamic MRI modeling schemes under clinically-relevant scanning conditions, and create digital reference objects and noise correction algorithms to address errors in these schemes. Recently, we have been applying recurrent neural networks to dynamic MR data to predict patient outcomes and tease out relationships with other imaging modalities, such as PET imaging.

Image Visualization -- We develop interactive data visualizations for medical imaging data, and research novel algorithms for practically visualizing features generated by machine learning algorithms. Using generative adversarial networks and filter activation visualizations, we isolate and characterize the most informative features in both 2D and 3D neural networks. We collaborate with researchers at the Harvard-Smithsonian Center for Astrophysics to develop Glue, an open-source data visualization platform.