Although an association between exposure to phthalates in house dust and childhood asthma or allergies has been reported in recent years, there have been no reports of these associations focusing on both adults and children. We aimed to investigate the relationships between phthalate levels in Japanese dwellings and the prevalence of asthma and allergies in both children and adult inhabitants in a cross-sectional study. The levels of seven phthalates in floor dust and multi-surface dust in 156 single-family homes were measured. According to a self-reported questionnaire, the prevalence of bronchial asthma, allergic rhinitis, allergic conjunctivitis, and atopic dermatitis in the 2 years preceding the study was 4.7%, 18.6%, 7.6%, and 10.3%, respectively. After evaluating the interaction effects of age and exposure categories with generalized liner mixed models, interaction effects were obtained for DiNP and bronchial asthma in adults (Pinteraction = 0.028) and for DMP and allergic rhinitis in children (Pinteraction = 0.015). Although not statistically significant, children had higher ORs of allergic rhinitis for DiNP, allergic conjunctivitis for DEHP, and atopic dermatitis for DiBP and BBzP than adults, and liner associations were observed (Ptrend < 0.05). On the other hand, adults had a higher OR for atopic dermatitis and DEHP compared to children. No significant associations were found in phthalates levels collected from multi-surfaces. This study suggests that the levels of DMP, DEHP, DiBP, and BBzP in floor dust were associated with the prevalence of allergic rhinitis, conjunctivitis, and atopic dermatitis in children, and children are more vulnerable to phthalate exposure via household floor dust than are adults. The results from this study were shown by cross-sectional nature of the analyses and elaborate assessments for metabolism of phthalates were not considered. Further studies are needed to advance our understanding of phthalate toxicity