Decision Problems for Subclasses of Rational Relations over Finite and Infinite Words

We consider decision problems for relations over finite and infinite words defined by finite automata. We prove that the equivalence problem for binary deterministic rational relations over infinite words is undecidable in contrast to the case of finite words, where the problem is decidable. Furthermore, we show that it is decidable in doubly exponential time for an automatic relation over infinite words whether it is a recognizable relation. We also revisit this problem in the context of finite words and improve the complexity of the decision procedure to single exponential time. The procedure is based on a polynomial time regularity test for deterministic visibly pushdown automata, which is a result of independent interest.Comment: v1: 31 pages, submitted to DMTCS, extended version of the paper with the same title published in the conference proceedings of FCT 2017; v2: 32 pages, minor revision of v1 (DMTCS review process), results unchanged; v3: 32 pages, enabled hyperref for Figure 1; v4: 32 pages, add reference for known complexity results for the slenderness problem; v5: 32 pages, added DMTCS metadat