89 research outputs found

    Revisiting Scalarization in Multi-Task Learning: A Theoretical Perspective

    Full text link
    Linear scalarization, i.e., combining all loss functions by a weighted sum, has been the default choice in the literature of multi-task learning (MTL) since its inception. In recent years, there is a surge of interest in developing Specialized Multi-Task Optimizers (SMTOs) that treat MTL as a multi-objective optimization problem. However, it remains open whether there is a fundamental advantage of SMTOs over scalarization. In fact, heated debates exist in the community comparing these two types of algorithms, mostly from an empirical perspective. To approach the above question, in this paper, we revisit scalarization from a theoretical perspective. We focus on linear MTL models and study whether scalarization is capable of fully exploring the Pareto front. Our findings reveal that, in contrast to recent works that claimed empirical advantages of scalarization, scalarization is inherently incapable of full exploration, especially for those Pareto optimal solutions that strike the balanced trade-offs between multiple tasks. More concretely, when the model is under-parametrized, we reveal a multi-surface structure of the feasible region and identify necessary and sufficient conditions for full exploration. This leads to the conclusion that scalarization is in general incapable of tracing out the Pareto front. Our theoretical results partially answer the open questions in Xin et al. (2021), and provide a more intuitive explanation on why scalarization fails beyond non-convexity. We additionally perform experiments on a real-world dataset using both scalarization and state-of-the-art SMTOs. The experimental results not only corroborate our theoretical findings, but also unveil the potential of SMTOs in finding balanced solutions, which cannot be achieved by scalarization.Comment: Accepted at NeurIPS 202

    Comprehensive analysis of prognosis of cuproptosis-related oxidative stress genes in multiple myeloma

    Get PDF
    Introduction: Multiple myeloma (MM) is a highly heterogeneous hematologic malignancy. The patients’ survival outcomes vary widely. Establishing a more accurate prognostic model is necessary to improve prognostic precision and guide clinical therapy.Methods: We developed an eight-gene model to assess the prognostic outcome of MM patients. Univariate Cox analysis, Least absolute shrinkage and selection operator (LASSO) regression, and multivariate Cox regression analyses were used to identify the significant genes and construct the model. Other independent databases were used to validate the model.Results: The results showed that the overall survival of patients in the high-risk group was signifificantly shorter compared with that of those in the low-risk group. The eight-gene model demonstrated high accuracy and reliability in predicting the prognosis of MM patients.Discussion: Our study provides a novel prognostic model for MM patients based on cuproptosis and oxidative stress. The eight-gene model can provide valid predictions for prognosis and guide personalized clinical treatment. Further studies are needed to validate the clinical utility of the model and explore potential therapeutic targets

    Adaptive and Blind Audio Watermarking Algorithm Based on Chaotic Encryption in Hybrid Domain

    No full text
    An adaptive and blind audio watermarking algorithm is proposed based on chaotic encryption in discrete cosine transform (DCT) and discrete wavelet transform (DWT) hybrid domain. Since human ears are not sensitive to small changes in the high-frequency components of the audio media, the encrypted watermark can be embedded into the audio signal according to the special embedding rules. The embedding depth of each audio segment is controlled by the overall average amplitude to effectively improve the robustness and imperceptibility. The watermark is encrypted by a chaotic sequence to improve the security of watermark, so only users who hold the correct key can accurately extract the watermark without the original audio signal. Experimental results show that the proposed algorithm has larger capacity, higher imperceptibility, better security, and stronger robustness when combating against signal-processing attacks than the involved audio watermarking algorithms in recent years

    A Novel Robust Audio Watermarking Algorithm by Modifying the Average Amplitude in Transform Domain

    No full text
    In order to improve the robustness and imperceptibility in practical application, a novel audio watermarking algorithm with strong robustness is proposed by exploring the multi-resolution characteristic of discrete wavelet transform (DWT) and the energy compaction capability of discrete cosine transform (DCT). The human auditory system is insensitive to the minor changes in the frequency components of the audio signal, so the watermarks can be embedded by slightly modifying the frequency components of the audio signal. The audio fragments segmented from the cover audio signal are decomposed by DWT to obtain several groups of wavelet coefficients with different frequency bands, and then the fourth level detail coefficient is selected to be divided into the former packet and the latter packet, which are executed for DCT to get two sets of transform domain coefficients (TDC) respectively. Finally, the average amplitudes of the two sets of TDC are modified to embed the binary image watermark according to the special embedding rule. The watermark extraction is blind without the carrier audio signal. Experimental results confirm that the proposed algorithm has good imperceptibility, large payload capacity and strong robustness when resisting against various attacks such as MP3 compression, low-pass filtering, re-sampling, re-quantization, amplitude scaling, echo addition and noise corruption

    supplement .docx

    No full text
    figure and table</p

    Robust and Blind Audio Watermarking Algorithm in Dual Domain for Overcoming Synchronization Attacks

    No full text
    How to effectively resist synchronization attacks is the most challenging topic in the research of robust watermarking algorithms. A robust and blind audio watermarking algorithm for overcoming synchronization attacks is proposed in dual domain by considering time domain and transform domain. Based on analysing the characteristics of synchronization attacks, an implicit synchronization mechanism (ISM) is developed in the time domain, which can effectively track the appropriate region for embedding and extracting watermarks. The data in this region will be subjected to discrete cosine transform (DCT) and singular value decomposition (SVD) in turn to obtain the eigenvalue that can be utilized to carry watermarks. In order to extract the watermark blindly, the eigenvalue will be quantized. Genetic algorithm (GA) is utilized to optimize the quantization step to balance both transparency and robustness. The experimental results confirm that the proposed algorithm not only withstands various conventional signal processing operations but also resists malicious synchronization attacks, such as time scale modification (TSM), pitch-shifting modification (PSM), jittering, and random cropping. Especially, it can overcome TSM with strength from −30% to +30%, which is much higher than the standard of the International Federation of the Phonographic Industry (IFPI) and far superior to the other algorithms in related papers

    The design of a new type of pipe rack for civil construction

    No full text
    At present, the traditional way of placing building pipe fittings has many problems, such as labor, large space occupation, and insecurity, while the shelves on the market are not easy to remove the high pipe fittings and have low efficiency. In this paper, a new type of pipe laying frame is proposed, which consists of adjusting mechanism, taking mechanism and resetting mechanism. It not only optimizes the defects of the common display rack in the market, but also innovates the fixation and arrangement of the internal pipe fittings. It can not only solve the problems existing in the existing building pipe fitting display rack technology, but also reduce the problems and disadvantages in the use process. Under the actual application, it can improve the placement efficiency of the pipe fittings and reduce the staff, so as to improve the practicability of the rack

    Accurate Faraday measurement system for PBB glasses in current transducer application

    No full text
    3rd international conference on manufacturing science and engineering (ICMSE 2012
    • …
    corecore