Getting access to administrative health data for research is difficult and time-consuming due to privacy regulations. This paper assessed the feasibility of generating and sharing synthetic administrative health data using a recurrent deep learning model. The privacy assessment concluded that attribution disclosure risk was substantially less than the typical acceptable risk threshold. Results also show that the synthetic dataset was suitably similar to the real data.