The paper considers the "GR-desideratum", that is, the way general relativity implements general covariance, diffeomorphism invariance, and background independence. Two cases are discussed where 5-dimensional generalizations of general relativity run into interpretational troubles when the GR-desideratum is forced upon them. It is shown how the conceptual problems dissolve when such a desideratum is relaxed. In the end, it is suggested that a similar strategy might mitigate some major issues such as the problem of time or the embedding of quantum non-locality into relativistic spacetimes
