Cytomegalovirus (CMV) is a herpesvirus that establishes a persistent, but generally asymptomatic, infection in most people in the world. However, CMV drives and sustains extremely large numbers of antigen-specific T cells and is, therefore, emerging as an exciting platform for vaccines against infectious diseases and cancer. Indeed, pre-clinical data strongly suggest that CMV-based vaccines can sustain protective CD8+ T cell and antibody responses. In the context of vaccines for infectious diseases, substantial pre-clinical studies have elucidated the effcacy and protective mechanisms of CMV-based vaccines, including in non-human primate models of various infections. In the context of cancer vaccines, however, much less is known and only very early studies in mice have been conducted. To develop CMV-based cancer vaccines further, it will be critical to better understand the complex interaction of CMV and cancer. An array of evidence suggests that naturally-acquired human (H)CMV can be detected in cancers, and it has been proposed that HCMV may promote tumor growth. This would obviously be a concern for any therapeutic cancer vaccines. In experimental models, CMV has been shown to play both positive and negative roles in tumor progression, depending on the model studied. However, the mechanisms are still largely unknown. Thus, more studies assessing the interaction of CMV with the tumor microenvironment are needed. This review will summarize the existing literature and major open questions about CMV-based vaccines for cancer, and discuss our hypothesis that the balance between pro-tumor and anti-tumor effects driven by CMV depends on the location and the activity of the virus in the lesion