Driven nonlinear resonators provide a fertile ground for phenomena related to phase transitions far from equilibrium, which can open opportunities unattainable in their linear counterparts. Here, we show that optical parametric oscillators (OPOs) can undergo second-order phase transitions in the spectral domain between degenerate and non-degenerate regimes. This abrupt change in the spectral response follows a square-root dependence around the critical point, exhibiting high sensitivity to parameter variation akin to systems around an exceptional point. We experimentally demonstrate such a phase transition in a quadratic OPO. We show that the divergent susceptibility of the critical point is accompanied by spontaneous symmetry breaking and distinct phase noise properties in the two regimes, indicating the importance of a beyond nonlinear bifurcation interpretation. We also predict the occurrence of first-order spectral phase transitions in coupled OPOs. Our results on non-equilibrium spectral behaviors can be utilized for enhanced sensing, advanced computing, and quantum information processing