In medical science there are different health disorders have high economical cost. There are many diseases present in medical science,mental disorder is the one of the most powerful disease which can have large impact on society. We are going to implement the innovative approach for sensing the human emotion by using automatic facial tracking in video, measuring facial activity, recognition of facial expression and by using the frequency of audio signal. The main goal is to develop and diagnostic mental disorder using affective sensing technique. The sound and visual communication complement each other, by considering this hypothesis for mental disorder analysis. Using multimodal approach for mental disorder diagnosis we are using combination of audio and video fusion method. A different audio and video features are generated separately. Frame level used to classify and combined video and audio features by using support vector machine (SVM).The innovative techniques show the proposed framework’s effectiveness in mental disorder analysis