There are two key problems in bearing fault diagnosis that need to be addressed, one is feature selection, the other is faulty dataset problem. On the one hand, signal decomposition methods are popular ways to decompose signal into a number of modes of interest, while the most interesting modes need to be selected to represent original signal. This procedure may easily lead to loss of important information. On the other hand, most of works adopt the faulty data to train fault diagnosis classifier, while the faulty data sets are difficult to collect in real life. Hence many existing methods are unsuitable for practical application. Moreover, a high number of researchers introduce various hybrid methods to improve the ability of original methods, which increases the complexity of fault diagnosis. To solve these problems, firstly, a canonical variate analysis (CVA) detector based on visual inspection is proposed to classify operating states. Healthy dataset obtained under normal condition is applied for building a reference model and generating a threshold. CVA transforms the unknown variable into state space and residual space, then T2 and Q metrics are used to capture the variation in the two spaces, respectively. The metrics of variable compared with reference model will determine the state of rolling bearing. Considering that the threshold of proposed detector is likely to be exceeded, and visual inspection fails to identify bearing fault automatically. Then the means of T2 and Q metrics are presented to enlarge the distance between normal and abnormal conditions to avoid those drawbacks. At last, experiment and comparison are conducted to verify the capability of the proposed work. The results demonstrate that the proposed work is simple and effective in bearing fault diagnosis