369 research outputs found
Speech Signal Enhancement through Adaptive Wavelet Thresholding
This paper demonstrates the application of the Bionic Wavelet Transform (BWT), an adaptive wavelet transform derived from a non-linear auditory model of the cochlea, to the task of speech signal enhancement. Results, measured objectively by Signal-to-Noise ratio (SNR) and Segmental SNR (SSNR) and subjectively by Mean Opinion Score (MOS), are given for additive white Gaussian noise as well as four different types of realistic noise environments. Enhancement is accomplished through the use of thresholding on the adapted BWT coefficients, and the results are compared to a variety of speech enhancement techniques, including Ephraim Malah filtering, iterative Wiener filtering, and spectral subtraction, as well as to wavelet denoising based on a perceptually scaled wavelet packet transform decomposition. Overall results indicate that SNR and SSNR improvements for the proposed approach are comparable to those of the Ephraim Malah filter, with BWT enhancement giving the best results of all methods for the noisiest (−10 db and −5 db input SNR) conditions. Subjective measurements using MOS surveys across a variety of 0 db SNR noise conditions indicate enhancement quality competitive with but still lower than results for Ephraim Malah filtering and iterative Wiener filtering, but higher than the perceptually scaled wavelet method
NORM: Knowledge Distillation via N-to-One Representation Matching
Existing feature distillation methods commonly adopt the One-to-one
Representation Matching between any pre-selected teacher-student layer pair. In
this paper, we present N-to-One Representation (NORM), a new two-stage
knowledge distillation method, which relies on a simple Feature Transform (FT)
module consisting of two linear layers. In view of preserving the intact
information learnt by the teacher network, during training, our FT module is
merely inserted after the last convolutional layer of the student network. The
first linear layer projects the student representation to a feature space
having N times feature channels than the teacher representation from the last
convolutional layer, and the second linear layer contracts the expanded output
back to the original feature space. By sequentially splitting the expanded
student representation into N non-overlapping feature segments having the same
number of feature channels as the teacher's, they can be readily forced to
approximate the intact teacher representation simultaneously, formulating a
novel many-to-one representation matching mechanism conditioned on a single
teacher-student layer pair. After training, such an FT module will be naturally
merged into the subsequent fully connected layer thanks to its linear property,
introducing no extra parameters or architectural modifications to the student
network at inference. Extensive experiments on different visual recognition
benchmarks demonstrate the leading performance of our method. For instance, the
ResNet18|MobileNet|ResNet50-1/4 model trained by NORM reaches
72.14%|74.26%|68.03% top-1 accuracy on the ImageNet dataset when using a
pre-trained ResNet34|ResNet50|ResNet50 model as the teacher, achieving an
absolute improvement of 2.01%|4.63%|3.03% against the individually trained
counterpart. Code is available at https://github.com/OSVAI/NORMComment: The paper of NORM is published at ICLR 2023. Code and models are
available at https://github.com/OSVAI/NOR
On new generalized differentials with respect to a set and their applications
The notions and certain fundamental characteristics of the proximal and
limiting normal cones with respect to a set are first presented in this paper.
We present the ideas of the limiting coderivative and subdifferential with
respect to a set of multifunctions and singleton mappings, respectively, based
on these normal cones. The necessary and sufficient conditions for the Aubin
property with respect to a set of multifunctions are then described by using
the limiting coderivative with respect to a set. As a result of the limiting
subdifferential with respect to a set, we offer the requisite optimality
criteria for local solutions to optimization problems. In addition, we also
provide examples to demonstrate the outcomes
Formulas for calculating of generalized differentials with respect to a set and their applications
This paper provides formulas for calculating of Fr\'{e}chet and limiting
normal cones with respect to a set of sets and the limiting coderivative with
respect to a set of set-valued mappings. These calculations are obtained under
some qualification constraints and are expressed in the similar forms of these
ones of Fr\'{e}chet and limiting normal cones and the limiting coderivative. By
using these obtained formulas, we state explicit necessary optimality
conditions with respect to a set for optimization problems with equilibrium
constraints under certain qualification conditions. Some illustrated examples
to obtained results are also established.Comment: 29 page
Genomic survey, expression profile and co-expression network analysis of OsWD40 family in rice
<p>Abstract</p> <p>Background</p> <p>WD40 proteins represent a large family in eukaryotes, which have been involved in a broad spectrum of crucial functions. Systematic characterization and co-expression analysis of <it>OsWD40 </it>genes enable us to understand the networks of the WD40 proteins and their biological processes and gene functions in rice.</p> <p>Results</p> <p>In this study, we identify and analyze 200 potential <it>OsWD40 </it>genes in rice, describing their gene structures, genome localizations, and evolutionary relationship of each member. Expression profiles covering the whole life cycle in rice has revealed that transcripts of <it>OsWD40 </it>were accumulated differentially during vegetative and reproductive development and preferentially up or down-regulated in different tissues. Under phytohormone treatments, 25 <it>OsWD40 </it>genes were differentially expressed with treatments of one or more of the phytohormone NAA, KT, or GA3 in rice seedlings. We also used a combined analysis of expression correlation and Gene Ontology annotation to infer the biological role of the <it>OsWD40 </it>genes in rice. The results suggested that <it>OsWD40 </it>genes may perform their diverse functions by complex network, thus were predictive for understanding their biological pathways. The analysis also revealed that <it>OsWD40 </it>genes might interact with each other to take part in metabolic pathways, suggesting a more complex feedback network.</p> <p>Conclusions</p> <p>All of these analyses suggest that the functions of <it>OsWD40 </it>genes are diversified, which provide useful references for selecting candidate genes for further functional studies.</p
- …