Currently, medical images require a physician to extract clinically relevant information. This talk will explore current work towards making images part of the quantitative medical history and to enable large-scale image-based studies of disease. Although large databases of clinical images contain a wealth of information, medical acquisition constraints result in sparse scans that miss much of the anatomy. These characteristics often render computational analysis impractical as standard processing algorithms tend to fail when applied to such images. Our goal is to enable application of existing algorithms that were originally developed for high resolution research scans to severely undersampled images. Application of the method is illustrated in the context of neurodegeneration and white matter disease studies in stroke patients.