In 2012 and 2013, Child Relief International (CRI) partnered with Haiti Philanthropy to install “Chlorinators” in 79 gravity-fed water distribution systems in Southeast Haiti as an emergency response project, followed by a sustainability plan. We carried out an independent evaluation to assess the extent to which Chlorinators were operational and providing safe water approximately two years after installation. We completed 18 randomly selected site assessments, 180 household surveys, water quality testing for Free Chlorine Residual (FCR) and Escherichia coli on water samples from reservoirs, taps, and household stored water, and 24 key informant interviews. None of the systems were functioning 2 years after installation, 3% of household respondents had received information about the Chlorinators, and no community or household water samples had detectable FCR from Chlorinators. However, key informants were largely supportive of the systems. Reasons for non-operation and challenges associated with achieving sustainability are discussed