Outlier detection algorithms over fuzzy data with weighted least squares

In the classical leave-one-out procedure for outlier detection in regression analysis, we exclude an observation and then construct a model on the remaining data. If the difference between predicted and observed value is high we declare this value an outlier. As a rule, those procedures utilize single comparison testing. The problem becomes much harder when the observations can be associated with a given degree of membership to an underlying population, and the outlier detection should be generalized to operate over fuzzy data. We present a new approach for outlier detection that operates over fuzzy data using two inter-related algorithms. Due to the way outliers enter the observation sample, they may be of various order of magnitude. To account for this, we divided the outlier detection procedure into cycles. Furthermore, each cycle consists of two phases. In Phase 1, we apply a leave-one-out procedure for each non-outlier in the dataset. In Phase 2, all previously declared outliers are subjected to Benjamini–Hochberg step-up multiple testing procedure controlling the false-discovery rate, and the non-confirmed outliers can return to the dataset. Finally, we construct a regression model over the resulting set of non-outliers. In that way, we ensure that a reliable and high-quality regression model is obtained in Phase 1 because the leave-one-out procedure comparatively easily purges the dubious observations due to the single comparison testing. In the same time, the confirmation of the outlier status in relation to the newly obtained high-quality regression model is much harder due to the multiple testing procedure applied hence only the true outliers remain outside the data sample. The two phases in each cycle are a good trade-off between the desire to construct a high-quality model (i.e., over informative data points) and the desire to use as much data points as possible (thus leaving as much observations as possible in the data sample). The number of cycles is user defined, but the procedures can finalize the analysis in case a cycle with no new outliers is detected. We offer one illustrative example and two other practical case studies (from real-life thrombosis studies) that demonstrate the application and strengths of our algorithms. In the concluding section, we discuss several limitations of our approach and also offer directions for future research

Outlier detection algorithms over fuzzy data with weighted least squares

In the classical leave-one-out procedure for outlier detection in regression analysis, we exclude an observation and then construct a model on the remaining data. If the difference between predicted and observed value is high we declare this value an outlier. As a rule, those procedures utilize single comparison testing. The problem becomes much harder when the observations can be associated with a given degree of membership to an underlying population, and the outlier detection should be generalized to operate over fuzzy data. We present a new approach for outlier detection that operates over fuzzy data using two inter-related algorithms. Due to the way outliers enter the observation sample, they may be of various order of magnitude. To account for this, we divided the outlier detection procedure into cycles. Furthermore, each cycle consists of two phases. In Phase 1, we apply a leave-one-out procedure for each non-outlier in the dataset. In Phase 2, all previously declared outliers are subjected to Benjamini–Hochberg step-up multiple testing procedure controlling the false-discovery rate, and the non-confirmed outliers can return to the dataset. Finally, we construct a regression model over the resulting set of non-outliers. In that way, we ensure that a reliable and high-quality regression model is obtained in Phase 1 because the leave-one-out procedure comparatively easily purges the dubious observations due to the single comparison testing. In the same time, the confirmation of the outlier status in relation to the newly obtained high-quality regression model is much harder due to the multiple testing procedure applied hence only the true outliers remain outside the data sample. The two phases in each cycle are a good trade-off between the desire to construct a high-quality model (i.e., over informative data points) and the desire to use as much data points as possible (thus leaving as much observations as possible in the data sample). The number of cycles is user defined, but the procedures can finalize the analysis in case a cycle with no new outliers is detected. We offer one illustrative example and two other practical case studies (from real-life thrombosis studies) that demonstrate the application and strengths of our algorithms. In the concluding section, we discuss several limitations of our approach and also offer directions for future research

Viral infections in 47 CVID patients in allergy and immunology department of Rasool E Akram hospital in Tehran

Background: CVID is a heterogeneous primary immune deficiency with infectious, autoimmune and autoinflamatory features. It is most common symptomatic PID in Iran, with prevalence of 1 in 25000 to 50000 people. CVID has been divided into some phenotypes to produce more homogenized subpopulations. CVID is not a pure Ab deficiency .and because of both abnormalities in Tcell and innate immunity in combination with B cell dysfunction these patients are predisposed to viral and opportunistic infections. Method: prevalence of viral infections is reported in 47 CVID patients registered in Rasool E Akram hospital in Tehran. Patients have been diagnosed as CVID with the PAGID-ESID diagnostic criteria in our department or referred from other clinics for follow up and treatment. Diagnosis of viral germs has been made by clinical signs, pathological significances and in some cases by PCR. Cases: 9 patients (19%) had problems with viral infections. Infections occurred befor diagnosis of CVID in some cases or after that. Four patients (8.5 %) had problems with wart. Sever mucocutaneus HSV infection has occurred in 3 (6 %), recurrent zona in one (2 %) and CMV infection as colitis or pneumonitis in 3(6 %) patients. Sever progressive lethal CNS infection with JC virus occurred in one patient. Conclusion: evidences show that CVID is not a pure B cell defect, and we should be aware of opportunistic and viral infections that in some cases may be fatal