We demonstrate how terahertz time-domain spectroscopy (THz-TDS) operating in reflection geometry can be used for quantitative conductivity mapping of large area chemical vapour deposited graphene films on sapphire, silicon dioxide/silicon and germanium. We validate the technique against measurements performed with previously established conventional transmission based THz-TDS and are able to resolve conductivity changes in response to induced back-gate voltages. Compared to the transmission geometry, measurement in reflection mode requires careful alignment and complex analysis, but circumvents the need of a terahertz transparent substrate, potentially enabling fast, contactless, in-line characterisation of graphene films on non-insulating substrates such as germanium.H.L. and J.A.Z. acknowledge financial support from the EPSRC (Grant No. EP/L019922/1). P.B.W. acknowledges EPSRC Cambridge NanoDTC EP/G037221/1. R.D., H.E.B. and D. R. acknowledge financial support from the EPSRC (Grant No. EP/J017671/1, Coherent Terahertz Systems). S.H. acknowledges funding from the EPSRC (Grant No. EP/K016636/1, GRAPHTED)