The DD4HEP detector description toolkit offers a flexible and easy-to-use solution for the consistent and complete description of particle physics detectors in a single system. The sub-component DDREC provides a dedicated interface to the detector geometry as needed for event reconstruction. With DDREC there is no need to define an additional, separate reconstruction geometry as is often done in HEP, but one can transparently extend the existing detailed simulation model to be also used for the reconstruction. Based on the extension mechanism of DD4HEP, DDREC allows one to attach user defined data structures to detector elements at all levels of the geometry hierarchy. These data structures define a high level view onto the detectors describing their physical properties, such as measurement layers, point resolutions, and cell sizes. For the purpose of charged particle track reconstruction, dedicated surface objects can be attached to every volume in the detector geometry. These surfaces provide the measurement directions, local-to-global coordinate transformations, and material properties. The material properties, essential for the correct treatment of multiple scattering and energy loss effects in charged particle reconstruction, are automatically averaged from the detailed geometry model along the normal of the surface. Additionally, a generic interface allows the user to query material properties at any given point or between any two points in the detector's world volume. In this paper we will present DDREC and how it is used together with the linear collider tracking software and the particle-flow package PANDORAPFA for full event reconstruction of the ILC detector concepts ILD and SiD, and of CLICdp. This flexible tool chain is also well suited for other future accelerator projects such as FCC and CEPC