Surgical simulation is an increasingly important element of surgical education. Using
simulation can be a means to address some of the significant challenges in developing
surgical skills with limited time and resources. The photo-realistic fidelity of simulations
is a key feature that can improve the experience and transfer ratio of trainees. In this
paper, we demonstrate how we can enhance the visual fidelity of existing surgical simulation by performing style transfer of multi-class labels from real surgical video onto
synthetic content. We demonstrate our approach on simulations of cataract surgery using
real data labels from an existing public dataset. Our results highlight the feasibility of
the approach and also the powerful possibility to extend this technique to incorporate
additional temporal constraints and to different applications
