This paper provides a theoretical model which highlights the role of heterogeneity of information in the emergence of temporal aggregation (clustering) of defaults in a leveraged economy. We show that the degree of heterogeneity plays a critical role in the persistence of the correlation between defaults in time. Specifically, a high degree of heterogeneity leads to an autocorrelation of the time sequence of defaults characterised by a hyperbolic decay rate, such that the autocorrelation function is not summable (infinite memory) and defaults are clustered. Conversely, if the degree of heterogeneity is reduced the autocorrelation function decays exponentially fast, and thus, correlation between defaults is only transient (short memory). Our model is also able to reproduce stylized facts, such as clustered volatility and non-Normal returns. Our findings suggest that future regulations might be directed at improving publicly available information, reducing the relative heterogeneity