COR-GAN: Correlation-Capturing Convolutional Neural Networks for Generating Synthetic Healthcare Records
This repository contains an implementation of "COR-GAN: Correlation-Capturing Convolutional Neural Networks for Generating Synthetic Healthcare Records". This is not an officially supported Google product.
For the following reason, this implementation does not contain the full implementation
of the code:
For a detailed description of the architecture please read our paper. Using the code of this repository is allowed with proper attribution: Please cite the paper if you use the code from this repository in your work.
@article{torfi2020cor,
title={COR-GAN: Correlation-Capturing Convolutional Neural Networks for Generating Synthetic Healthcare Records},
author={Torfi, Amirsina and Fox, Edward A},
journal={arXiv preprint arXiv:2001.09346},
year={2020}
}
Deep learning models have demonstrated high-quality performance in areas such as image classification and speech processing. However, creating a deep learning model using electronic health record (EHR) data, requires addressing particular privacy challenges that are unique to researchers in this domain. This matter focuses attention on generating realistic synthetic data while ensuring privacy. In this paper, we propose a novel framework called correlation-capturing Generative Adversarial Network (corGAN), to generate synthetic healthcare records. In corGAN we utilize Convolutional Neural Networks to capture the correlations between adjacent medical features in the data representation space by combining Convolutional Generative Adversarial Networks and Convolutional Autoencoders. To demonstrate the model fidelity, we show that corGAN generates synthetic data with performance similar to that of real data in various Machine Learning settings such as classification and prediction. We also give a privacy assessment and report on statistical analysis regarding realistic characteristics of the synthetic data.
corGAN
. We demonstrate that corGAN can effectively generate both discrete and continuous synthetic records.The discrete input X represents the source EHR data; z is the random distribution for the generator G; G is the employed neural network architecture; Dec(G(z))} refers to the decoding function which is used to transform the generator G continuous output to their equivalent discrete values. The discriminator D attempts to distinguish real input X from the discrete synthetic output Dec(G(z))}. For the generator and the discriminator, a 1-Dimensional Convolutional GAN architecture is utilized.
We utilize the Membership Inference (MI) attack as an approach to measure the privacy. Membership Inference~(MI) refers to determining whether a given record generated by a known machine learning model was used as part of the training data. The membership inference problem is basically the well-known problem of presence disclosure of an individual. If the adversary has complete access to the records of a particular patient and can recognize their employment in the model training, that is an indication of information leakage, as it can jeopardize the whole dataset privacy or at least the particular patient's private information. Here, we will assume the adversary has the synthetically generated data as well as a portion of the compromised real data.
Binary Classification: We use this metric for our experiments with continuous data. To empirically verify the quality of the synthetic data, we consider two different settings. (A)
Train and test the predictive models on the real data. (B)
train the predictive model on synthetic data and test it on the real data. If the model evaluated in setting B, represents competitive results with the same model performed in setting (A), we can conclude the synthetic data has good predictive modeling similar to the real data.
1.4
NOTE: PyTorch does a pretty good job in installing required packages but you should have installed CUDA according to PyTorch requirements. Please refer to this link for further information.
You need to download and process the following datasets as due to privacy restrictions we cannot provide the data here.
One good source code for processing MIMIC-III can be found here.
To check the implementation refer to the folder Generative
and you will see the following implementations:
PyTorch
as we could not fully reproduce their results with their code. Furthermore, PyTorch is more flexible compare to TensorFlow for research!
Amirsina Torfi | Mohammadreza Beyki |
---|