FP8 Quantization: The Power of the Exponent

When quantizing neural networks for efficient inference, low-bit integers are the go-to format for efficiency. However, low-bit floating point numbers have an extra degree of freedom, assigning some bits to work on an exponential scale instead. This paper in-depth investigates this benefit of the floating point format for neural network inference. We detail the choices that can be made for the FP8 format, including the important choice of the number of bits for the mantissa and exponent, and show analytically in which settings these choices give better performance. Then we show how these findings translate to real networks, provide an efficient implementation for FP8 simulation, and a new algorithm that enables the learning of both the scale parameters and the number of exponent bits in the FP8 format. Our chief conclusion is that when doing post-training quantization for a wide range of networks, the FP8 format is better than INT8 in terms of accuracy, and the choice of the number of exponent bits is driven by the severity of outliers in the network. We also conduct experiments with quantization-aware training where the difference in formats disappears as the network is trained to reduce the effect of outliers

High-Dielectric PVP@PANI/PDMS Composites Fabricated via an Electric Field-Assisted Approach

Polymer-based composite films with multiple properties, such as low dielectric loss tangent, high dielectric constant, and low cost are promising materials in the area of electronics and electric industries. In this study, flexible dielectric films were fabricated via an electric field-assisted method. Polyaniline (PANI) was modified by polyvinylpyrrolidone (PVP) to form a core–shell structure to serve as functional particles and silicone rubber polydimethylsiloxane (PDMS) served as the matrix. The dielectric constant of the composites prepared under electric fields was improved by the micro-structures formed by external electric fields. With the addition of 2.5 wt% PVP@PANI, the dielectric constant could be significantly enhanced, up to 23; the dielectric loss tangent is only 1, which is lower than that of the aligned PANI samples. This new processing technology provides important insights for aligning fillers in polymer matrix to form composites with enhanced dielectric properties

Mitochondrial DNA heteroplasmy analysis in keratoconus patients from China

Background: Mitochondrial DNA (mtDNA) variants have been implicated in keratoconus (KC). The present study aimed to characterize the mtDNA heteroplasmy profile in KC and explore the association of mitochondrial heteroplasmic levels with KC.Methods: Mitochondrial sequencing of peripheral blood samples and corneal tomography were conducted in 300 KC cases and 300 matched controls. The number of heteroplasmic and homoplasmic variants was calculated across the mitochondrial genome. Spearman’s correlation was used to analyze the correlation between the number of heteroplasmic variants and age. The association of mtDNA heteroplasmic level with KC was analyzed by logistic regression analysis. Moreover, the relationship between mitochondrial heteroplasmic levels and clinical parameters was determined by linear regression analysis.Results: The distribution of mtDNA heteroplasmic variants showed the highest number of heteroplasmic variants in the non-coding region, while the COX3 gene exhibited the highest number in protein-coding genes. Comparisons of the number of heteroplasmic and homoplasmic non-synonymous variants in protein-coding genes revealed no significant differences between KC cases and controls (all p > 0.05). In addition, the number of heteroplasmic variants was positively associated with age in all subjects (r = 0.085, p = 0.037). The logistic regression analyses indicated that the heteroplasmic levels of m.16180_16181delAA was associated with KC (p < 0.005). Linear regression analyses demonstrated that the heteroplasmic levels of m.16180_16181delAA and m.302A>C were not correlated with thinnest corneal thickness (TCT), steep keratometry (Ks), and flat keratometry (Kf) (all p > 0.05) in KC cases and controls separately.Conclusion: The current study characterized the mtDNA heteroplasmy profile in KC, and revealed that the heteroplasmic levels of m.16180_16181delAA were associated with KC

Accuracy of tomographic and biomechanical parameters in detecting unilateral post-LASIK keratoectasia and fellow eyes

Background: Patients with unilateral post-LASIK keratectasia (KE) have clinical ectasia in one eye but not in the fellow eye. As serious complications, these cases are rarely reported but are worth investigating. This study aimed to explore the characteristics of unilateral KE and the accuracy of corneal tomographic and biomechanical parameters to detect KE and distinguish fellow eyes from control eyes.Methods: The study analyzed 23 KE eyes, 23 KE fellow eyes, and 48 normal eyes from age- and sex-matched patients who had undergone LASIK. The Kruskal–Wallis test and further paired comparisons were performed to compare the clinical measurements of the three groups. The receiver operating characteristic curve was used to evaluate the ability to distinguish KE and fellow eyes from the control eyes. Binary logistic regression with the forward stepwise method was performed to produce a combined index, and the DeLong test was used to compare the discriminability difference of the parameters.Results: Males accounted for 69.6% of patients with unilateral KE. The duration between corneal surgery and the onset of ectasia ranged from 4 months to 18 years, with a median time of 10 years. The KE fellow eye had a higher posterior evaluation (PE) value than the control eyes (5 vs. 2, p = 0.035). Diagnostic tests showed that PE, posterior radius of curvature (3 mm), anterior evaluation (FE), and Corvis biomechanical index–laser vision correction (CBI-LVC) were sensitive indicators for distinguishing KE in the control eyes. The ability of PE to detect the KE fellow eye from the control eye was 0.745 (0.628 and 0.841), with 73.91% sensitivity and 68.75% specificity at a cut-off value of 3. The ability of a combined index, constructed using PE and FE, to distinguish fellow eyes of KE from controls was 0.831 (0.723 and 0.909), which was higher than that of PE and FE individually (p < 0.05).Conclusion: The fellow eyes of patients with unilateral KE had significantly higher PE values than control eyes, and a combination of PE and FE enhanced this differentiation in a Chinese population. More attention should be paid to the long-term follow-up of patients after LASIK and to be wary of the occurrence of early KE