Deep Generative Model for Longitudinal Analysis
Project Management and Software Development
for Medical Applications
General Info
Project Title: Predictive Image Generation for
Longitudinal Analysis
Contact Person: Seong Tae Kim
Contact Email: seongtae.kim@tum.de
Project Abstract
The longitudinal analysis of a disease is important
issue to understand its progression as well as to
design prognosis and early diagnostic tools. From
longitudinal sample series where data is collected
from multiple time points, both the spatial
structural abnormalities and the longitudinal
variations are captured. Therefore, the temporal
dynamic of a disease is more informative than static
observations of the symptoms, in particular for
neuro-degenerative diseases whose progression
span over years with early subtle changes. In this
project, the student will develop a software which
could model the lesion progression using deep
generative model. Weekly meetings will be
organized to advise the student including discussing
direction, answering questions, addressing issues.
Background and Motivation
Since the last decade, longitudinal medical images
are increasingly available for developing disease
progression models. Recent advances and success
in deep learning (CNN, RNN, GAN, etc.) provide a
new opportunity to study longitudinal image
analysis. Although a large amount of research
efforts has been devoted to developing new
strategies in video frame prediction, longitudinal
analysis is different because it deals with the data
collected at different time points with varying time
Please send the completed proposal to beatrice.demiray@tum.de, javier.esteban@tum.de and hendrik.burwinkel@tum.de.
Please note that this proposal will be evaluated by the BMC coordinators and will be assigned to a student only in case of acceptance.
intervals. Moreover, there are often missing data at
some time points which does not often exist in
video prediction problem. In this project, the
student will investigate the deep generative model
for predicting follow-up image scans for the given
baseline scan of the subject.
Student’s Tasks Description
The student’s tasks in this project are as following:
 Literature review on generative model and
longitudinal analysis in medical applications
 Implement a new generative model to predict
follow up scans
 Setting experimental protocol using public
longitudinal dataset for validating the method
 Analyze the results of the predictive model
 (optional) Writing scientific paper
Technical Prerequisites
 Good understanding of statistics and machine
learning methods.
 Very good programming skills in Python &
TensorFlow / PyTorch
References
[1] S. Pathan et al. “Predictive Image Regression for
Longitudinal Studies with Missing Data,”
International Conference on. Medical Imaging with
Deep Learning 2018.
[2] M. Louis et al. “Riemannian geometry learning
for disease progression modelling,” International
Conference on. Medical Imaging with Deep
Learning 2019.
[3] J. Lee et al. “Feature2Mass: Visual feature
processing in latent space for realistic labeled mass
generation,” ECCVW 2018.
[4] C. Bowles et al. "Modelling the progression of
Alzheimer's disease in MRI using generative
adversarial networks," SPIE Medical Imaging 2018.