Revisiting Discriminative vs. Generative Classifiers: Theory and Implications

A large-scale deep model pre-trained on massive labeled or unlabeled data transfers well to downstream tasks. Linear evaluation freezes parameters in the pre-trained model and trains a linear classifier separately, which is efficient and attractive for transfer. However, little work has investigated the classifier in linear evaluation except for the default logistic regression. Inspired by the statistical efficiency of naive Bayes, the paper revisits the classical topic on discriminative vs. generative classifiers. Theoretically, the paper considers the surrogate loss instead of the zero-one loss in analyses and generalizes the classical results from binary cases to multiclass ones. We show that, under mild assumptions, multiclass naive Bayes requires $O(\log n)$ samples to approach its asymptotic error while the corresponding multiclass logistic regression requires $O(n)$ samples, where $n$ is the feature dimension. To establish it, we present a multiclass $\mathcal{H}$-consistency bound framework and an explicit bound for logistic loss, which are of independent interests. Simulation results on a mixture of Gaussian validate our theoretical findings. Experiments on various pre-trained deep vision models show that naive Bayes consistently converges faster as the number of data increases. Besides, naive Bayes shows promise in few-shot cases and we observe the "two regimes" phenomenon in pre-trained supervised models. Our code is available at https://github.com/ML-GSAI/Revisiting-Dis-vs-Gen-Classifiers.Comment: Accepted by ICML 2023, 58 page

Visualization Experiments of a Specific Fuel Flow Through Quartz-glass Tubes Under both Sub- and Supercritical Conditions

AbstractThe present work is a visualization study of a typical kerosene (RP-3) flowing through vertical and horizontal quartz-glass tubes under both sub- and supercritical conditions by a high speed camera. The experiments are accomplished at temperatures of 300-730 K under pressures from 0.107-5 MPa. Six distinctive two-phase flow patterns are observed in upward flow and the critical point of RP-3 is identified as critical pressure pc=2.33 MPa and critical temperature Tc=645.04 K and it is found that when the fluid pressure exceeds 2.33 MPa the flow can be considered as a single phase flow. The critical opalescence phenomenon of RP-3 is observed when the temperature is between 643.16 K and 648.61 K and the pressure is between 2.308 MPa and 2.366 MPa. The region filled by the critical opalescence in the upward flow is clearly larger than that in the downward flow due to the interaction between the buoyancy force and fluid inertia. Morecover, obvious layered flow phenomenon is observed in horizontal flow under supercritical pressures due to the differences of gravity and density

Biphasic activation of PI3K/Akt and MAPK/Erk1/2 signaling pathways in bovine herpesvirus type 1 infection of MDBK cells

Many viruses have been known to control key cellular signaling pathways to facilitate the virus infection. The possible involvement of signaling pathways in bovine herpesvirus type 1 (BoHV-1) infection is unknown. This study indicated that infection of MDBK cells with BoHV-1 induced an early-stage transient and a late-stage sustained activation of both phosphatidylinositol 3-kinase (PI3K)/Akt and mitogen activated protein kinases/extracellular signal-regulated kinase 1/2 (MAPK/Erk1/2) signaling pathways. Analysis with the stimulation of UV-irradiated virus indicated that the virus binding and/or entry process was enough to trigger the early phase activations, while the late phase activations were viral protein expression dependent. Biphasic activation of both pathways was suppressed by the selective inhibitor, Ly294002 for PI3K and U0126 for MAPK kinase (MEK1/2), respectively. Furthermore, treatment of MDBK cells with Ly294002 caused a 1.5-log reduction in virus titer, while U0126 had little effect on the virus production. In addition, the inhibition effect of Ly294002 mainly occurred at the post-entry stage of the virus replication cycle. This revealed for the first time that BoHV-1 actively induced both PI3K/Akt and MAPK/Erk1/2 signaling pathways, and the activation of PI3K was important for fully efficient replication, especially for the post-entry stage

Electrical-controllable antiferromagnet-based tunnel junction

Electrical-controllable antiferromagnet tunnel junction is a key goal in spintronics, holding immense promise for ultra-dense and ultra-stable antiferromagnetic memory with high processing speed for modern information technology. Here, we have advanced towards this goal by achieving an electrical-controllable antiferromagnet-based tunnel junction of Pt/Co/Pt/Co/IrMn/MgO/Pt. The exchange coupling between antiferromagnetic IrMn and Co/Pt perpendicular magnetic multilayers results in the formation of interfacial exchange bias and exchange spring in IrMn. Encoding information states 0 and 1 is realized through the exchange spring in IrMn, which can be electrically written by spin-orbit torque switching with high cyclability and electrically read by antiferromagnetic tunneling anisotropic magnetoresistance. Combining spin-orbit torque switching of both exchange spring andexchange bias, 16 Boolean logic operation is successfully demonstrated. With both memory and logic functionalities integrated into our electrical-controllable antiferromagnetic-based tunnel junction, we chart the course toward high-performance antiferromagnetic logic-in-memory.Comment: 20 pages, 4 figure