On the Strong Correlation Between Model Invariance and Generalization

Generalization and invariance are two essential properties of any machine learning model. Generalization captures a model's ability to classify unseen data while invariance measures consistency of model predictions on transformations of the data. Existing research suggests a positive relationship: a model generalizing well should be invariant to certain visual factors. Building on this qualitative implication we make two contributions. First, we introduce effective invariance (EI), a simple and reasonable measure of model invariance which does not rely on image labels. Given predictions on a test image and its transformed version, EI measures how well the predictions agree and with what level of confidence. Second, using invariance scores computed by EI, we perform large-scale quantitative correlation studies between generalization and invariance, focusing on rotation and grayscale transformations. From a model-centric view, we observe generalization and invariance of different models exhibit a strong linear relationship, on both in-distribution and out-of-distribution datasets. From a dataset-centric view, we find a certain model's accuracy and invariance linearly correlated on different test sets. Apart from these major findings, other minor but interesting insights are also discussed.Comment: 18 pages, 11 figures; this version is not fully edited and will be updated soo

Experimental study on penetration of dental implants into the maxillary sinus in different depths

The exposing of dental implant into the maxillary sinus combined with membrane perforation might increase risks of implant failure and sinus complications. Objective: The purpose of this study was to investigate the effects of the dental implant penetration into the maxillary sinus cavity in different depths on osseointegration and sinus health in a dog model. Material and Methods: Sixteen titanium implants were placed in the bilateral maxillary molar areas of eight adult mongrel dogs, which were randomly divided into four groups according to the different penetrating extents of implants into the sinus cavities (group A: 0 mm; group B: 1 mm; group C: 2 mm; group D: 3 mm). The block biopsies were harvested five months after surgery and evaluated by radiographic observation and histological analysis. Results: No signs of inflammatory reactions were observed in any maxillary sinus of the eight dogs. The tips of the implants with penetrating depth of 1 mm and 2 mm were found to be fully covered with newly formed membrane and partially with new bone. The tips of the implants with penetrating depth over 3 mm were exposed in the sinus cavity and showed no membrane or bone coverage. No significant differences were found among groups regarding implant stability, bone-to-implant contact (BIC) and bone area in the implant threads (BA). Conclusions: Despite the protrusion extents, penetration of dental implant into the maxillary sinus with membrane perforation does not compromise the sinus health and the implant osseointegration in canine

Differential Expression of MicroRNA-19b Promotes Proliferation of Cancer Stem Cells by Regulating the TSC1/mTOR Signaling Pathway in Multiple Myeloma

Background/Aims: MiR-19b has been reported to be involved in several malignancies, but its role in multiple myeloma (MM) is still unknown. The objective of this study was to explore the biological mechanism of miR-19b in the progression of MM. Methods: First, we performed real-time polymerase chain reaction (PCR) and Western blot to study the expression of miR-19b, tuberous sclerosis 1 (TSC1), and caspase-3 in different groups. MTT assay was performed to explore the effect of miR-19b on survival and apoptosis of cancer stem cells (CSCs). Computation analysis and luciferase assay were utilized to confirm the interaction between miR-19b and TSC1. Results: A total of 38 participants comprising 20 subjects with MM and 18 healthy subjects as normal controls were enrolled in our study. Real-time PCR showed dramatic upregulation of miR-19b, but TSC1 was evidently suppressed in the MM group. MiR-19b overexpression substantially promoted clonogenicity and cell viability, and further inhibited apoptosis of CSCs in vitro. Furthermore, miR-19b overexpression downregulated the expression of caspase-3, which induced apoptosis. Using in silico analysis, we identified that TSC1 might be a direct downstream target of miR-19b, and this was further confirmed by luciferase assay showing that miR-19b apparently reduced the luciferase activity of wild-type TSC1 3´-UTR, but not that of mutant TSC1 3´-UTR. There was also evident decrease in TSC1 mRNA and protein in CSCs following introduction of miR-19b. Interestingly, reintroduction of TSC1 abolished the miR-19b-induced proliferation promotion and apoptosis inhibition in CSCs. Conclusion: These findings collectively suggest that miR-19b promotes cell survival and suppresses apoptosis of MM CSCs via targeting TSC1 directly, indicating that miR-19b may serve as a potential and novel therapeutic target of MM based on miRNA expression

Clinical analysis of transurethral holmium laser enucleation in the treatment of benign prostatic hyperplasia with prostatic inflammation: A prospective research study

ObjectiveTo investigate the clinical efficacy of holmium laser enucleation of the prostate (HoLEP) in the treatment of benign prostatic hyperplasia (BPH) with prostatic inflammation (PI).MethodsWe prospectively collected and followed up data on patients with BPH who underwent HoLEP at the Affiliated Hospital of Weifang Medical University between July 2021 and July 2022. According to the postoperative pathological results, the patients were divided into two groups: BPH without PI group (BPH group) and BPH with PI group. Statistical analysis was performed on clinical data, including age and body mass index (BMI), prostate volume (PV), postoperative residual urine volume (PVR), preoperative serum total prostate-specific antigen (tPSA), serum-free prostate-specific antigen (fPSA), preoperative and postoperative maximum urinary flow rate (Qmax), International Prostate Symptom Score (IPSS) before and 3 months after surgery, quality of life index (QoL) before and 3 months after surgery, and postoperative complications.ResultsA total of 41 patients were included in this study, including 16 in the BPH group and 25 in the BPH with PI group. There were no significant differences in preoperative age, BMI, PV, PVR, tPSA, fPSA, and f/tPSA between the BPH and BPH with PI groups (P > 0.05). The preoperative mean Qmax of the BPH and BPH with PI groups were 9.44 ± 2.449 and 7.52 ± 2.946 [mean ± standard deviation (SD)] ml/s, mean IPSS were 17.75 ± 5.335 and 24.24 ± 5.861 (mean ± SD), and mean QoL were 4.13 ± 0.806 and 4.48 ± 0.8 (mean ± SD), respectively. The postoperative mean Qmax of the BPH and BPH with PI groups were 20.38 ± 4.787 and 14.32 ± 3.827 (mean ± SD) ml/s, mean IPSS were 2.69 ± 1.25 and 5.84 ± 3.579 (mean ± SD), and mean QoL were 0.13 ± 0.342 and 0.92 ± 0.759 (mean ± SD), respectively. In both groups, Qmax significantly increased (P < 0.05) and IPSS and QoL significantly decreased after HoLEP (P < 0.05). Before and after surgery, the Qmax in the BPH with PI group was lower than that in the BPH group, and the IPSS and QoL levels in the BPH with PI group were higher than those in the BPH group (P < 0.05). Compared with the BPH group, the increase in Qmax in the BPH with PI group was smaller and the decrease in IPSS was larger (P < 0.05), but the variation in QoL was not statistically significant (P > 0.05).ConclusionImprovements in Qmax, IPSS, and QoL in BPH patients with PI after HoLEP surgery were lower than those in BPH patients alone. PI may be a predictor of a worse response to surgical treatment. However, more multicenter randomized controlled trials with larger samples and long-term follow-up are needed to verify this