In this paper, we study the tri-stable stochastic P-bifurcation problem of a generalized Van der Pol system with fractional derivative under Gaussian white noise excitation. Firstly, using the principle for minimal mean square error, we show that the fractional derivative term is equivalent to a linear combination of the damping force and restoring force, so that the original system can be transformed into an equivalent integer order system. Secondly, we obtain the stationary Probability Density Function (PDF) of the system’s amplitude by the stochastic averaging, and using the singularity theory, we find the critical parametric conditions for stochastic P-bifurcation of amplitude of the system, which can make the system switch among the three steady states. Finally, we analyze different types of the stationary PDF curves of the system amplitude qualitatively by choosing parameters corresponding to each region divided by the transition set curves, and the system response can be maintained at the small amplitude near the equilibrium by selecting the appropriate unfolding parameters. We verify the theoretical analysis and calculation of the transition set by showing the consistency of the numerical results obtained by Monte Carlo simulation with the analytical results. The method used in this paper directly guides the design of the fractional order controller to adjust the response of the system
