Rover: An online Spark SQL tuning service via generalized transfer learning

Distributed data analytic engines like Spark are common choices to process massive data in industry. However, the performance of Spark SQL highly depends on the choice of configurations, where the optimal ones vary with the executed workloads. Among various alternatives for Spark SQL tuning, Bayesian optimization (BO) is a popular framework that finds near-optimal configurations given sufficient budget, but it suffers from the re-optimization issue and is not practical in real production. When applying transfer learning to accelerate the tuning process, we notice two domain-specific challenges: 1) most previous work focus on transferring tuning history, while expert knowledge from Spark engineers is of great potential to improve the tuning performance but is not well studied so far; 2) history tasks should be carefully utilized, where using dissimilar ones lead to a deteriorated performance in production. In this paper, we present Rover, a deployed online Spark SQL tuning service for efficient and safe search on industrial workloads. To address the challenges, we propose generalized transfer learning to boost the tuning performance based on external knowledge, including expert-assisted Bayesian optimization and controlled history transfer. Experiments on public benchmarks and real-world tasks show the superiority of Rover over competitive baselines. Notably, Rover saves an average of 50.1% of the memory cost on 12k real-world Spark SQL tasks in 20 iterations, among which 76.2% of the tasks achieve a significant memory reduction of over 60%.Comment: Accepted by KDD 202

Fermentation improves flavors, bioactive substances, and antioxidant capacity of Bian-Que Triple-Bean Soup by lactic acid bacteria

The ancient traditional Chinese drink Bian-Que Triple-Bean Soup made by fermentation (FTBS) of Lactococcus lactis subsp. lactis YM313 and Lacticaseibacillus casei YQ336 is a potential functional drink. The effect of fermentation on the flavor and biological activity of FTBS was evaluated by analyzing its chemical composition. Five volatile flavors were detected in modified FTBS. Fermentation decreased the proportion of nonanal (beany flavor substances) but significantly increased the total flavone contents, phenol contents and many bioactive small molecule substances in FTBS. The changes of these substances led to the significant improvement of FTBS sensory evaluation, antioxidant activity and prebiotic potential. This research provides a theoretical basis for the application of Lactic acid bacteria (LAB) in the fermentation of edible plant-based foods and transformation from traditional food to industrial production

Comparisons of Pre-Sale Strategies for a Fresh Agri-Product Supply Chain with Service Effort

Preselling strategies have been a common marketing tool, but research on this selection is limited. Thus, we examine three pre-sale strategies of a manufacturer who produces and sells a seasonal product to a retailer: (1) supplier pre-sale strategy—the supplier carries out preselling by opening a direct channel; (2) retailer pre-sale strategy—the retailer purchases pre-sale products from the supplier and sells them in online and offline channels; and (3) joint pre-sale strategy—the retailer acts as a pre-sale platform, providing order information and pre-sale services. For each preselling mode, we construct the Stackelberg game model aiming to maximize profits and obtain optimal service levels and pricing decisions. We find that the two latter scenarios, that is, to cooperate with the retailer (retailer pre-sale and joint pre-sale strategies), could highly gain more profit for the supplier compared with the former. For the supplier, the joint pre-sale strategy will likely be the dominant strategy because of its wide-range applicability. On the contrary, the retailer is swaying between retailer pre-sale and joint pre-sale strategies under different conditions. For the supplier, leadership always guarantees a high profit, but if the joint pre-sale strategy is adopted, then the existence of a profit-sharing ratio will narrow the profit gap between the two players

Green Manufacturing Strategy Considering Retailers’ Fairness Concerns

This paper addresses the problem of green manufacturing decision making for a green dual-channel supply chain (SC). In the investigated SC, the manufacturer will decide whether to adopt green manufacturing under the influence of the retailer’s fairness concern-based dual-channel. Thus, we discuss two decision scenarios: the no green manufacturing strategy with retailer fairness (NM model), and green manufacturing with retailer fairness (GM model). Our study has several findings: Firstly, adopting a green manufacturing strategy is not always beneficial to supply-chain members when a retailer has fairness. In particular, when fairness is at a relatively high level, the manufacturer will not adopt green manufacturing. Secondly, under green manufacturing, the product’s green degree and subsidies have a positive impact on the price and demand and the members’ profit and utility. Besides, the subsidies and retailer fairness have a counter effect on the optimal decision. Thirdly, comparing the two scenarios (NM & GM), we found that the channel price of the GM model is lower than the NM model. Finally, from the perspective of the supply chain system, the system tends toward the manufacturer adopting green manufacturing and maintaining retailer fairness concerns at a lower level

Maintenance of K+/Na+ Balance in the Roots of Nitraria sibirica Pall. in Response to NaCl Stress

Using Non-invasive Micro-test Technology (NMT), the Na+, K+ and H+ flux profiles in the root meristem regions were investigated in Nitraria sibirica Pall. seedlings under different NaCl concentrations. NaCl stress increased the K+ and Na+ contents in the roots of N. sibirica seedlings. NaCl stress significantly increased the steady Na+ efflux from the N. sibirica seedling roots. Steady K+ effluxes were measured in the control roots (without NaCl) and in the roots treated with 200 mM NaCl, and no significant differences were observed between the two treatments. The steady K+ efflux from roots treated with 400 mM NaCl decreased gradually. NaCl treatment significantly increased the H+ influx. Pharmacological experiments showed that amiloride and sodium vanadate significantly inhibited the Na+ efflux and H+ influx, suggesting that the Na+ efflux was mediated by a Na+/H+ antiporter using energy provided by plasma membrane H+-ATPase. The NaCl-induced root K+ efflux was inhibited by the K+ channel inhibitor tetraethylammonium chloride (TEA), and was significantly increased by the H+-ATPase inhibitor sodium vanadate. The NaCl-induced K+ efflux was mediated by depolarization-activated outward-rectifying K+ channels and nonselective cation channels (NSCCs). Under salt stress, N. sibirica seedlings showed increased Na+ efflux due to increased plasma membrane H+-ATPase and Na+/H+ antiporter activity. High H+ pump activity not only restricts the Na+ influx through NSCCs, but also limits K+ leakage through outward-rectifying K+ channels and NSCCs, leading to maintenance of the K+/Na+ balance and higher salt tolerance

Comprehensive transcriptome and metabolome profiling reveal metabolic mechanisms of Nitraria sibirica Pall. to salt stress

Abstract Nitraria sibirica Pall., a typical halophyte that can survive under extreme drought conditions and in saline-alkali environments, exhibits strong salt tolerance and environmental adaptability. Understanding the mechanism of molecular and physiological metabolic response to salt stress of plant will better promote the cultivation and use of halophytes. To explore the mechanism of molecular and physiological metabolic of N. sibirica response to salt stress, two-month-old seedlings were treated with 0, 100, and 400 mM NaCl. The results showed that the differentially expressed genes between 100 and 400 mmol L−1 NaCl and unsalted treatment showed significant enrichment in GO terms such as binding, cell wall, extemal encapsulating structure, extracellular region and nucleotide binding. KEGG enrichment analysis found that NaCl treatment had a significant effect on the metabolic pathways in N. sibirica leaves, which mainly including plant-pathogen interaction, amino acid metabolism of the beta alanine, arginine, proline and glycine metabolism, carbon metabolism of glycolysis, gluconeogenesis, galactose, starch and sucrose metabolism, plant hormone signal transduction and spliceosome. Metabolomics analysis found that the differential metabolites between the unsalted treatment and the NaCl treatment are mainly amino acids (proline, aspartic acid, methionine, etc.), organic acids (oxaloacetic acid, fumaric acid, nicotinic acid, etc.) and polyhydric alcohols (inositol, ribitol, etc.), etc. KEGG annotation and enrichment analysis showed that 100 mmol L−1 NaCl treatment had a greater effect on the sulfur metabolism, cysteine and methionine metabolism in N. sibirica leaves, while various amino acid metabolism, TCA cycle, photosynthetic carbon fixation and sulfur metabolism and other metabolic pathways have been significantly affected by 400 mmol L−1 NaCl treatment. Correlation analysis of differential genes in transcriptome and differential metabolites in metabolome have found that the genes of AMY2, BAM1, GPAT3, ASP1, CML38 and RPL4 and the metabolites of L-cysteine, proline, 4-aminobutyric acid and oxaloacetate played an important role in N. sibirica salt tolerance control. This is a further improvement of the salt tolerance mechanism of N. sibirica, and it will provide a theoretical basis and technical support for treatment of saline-alkali soil and the cultivation of halophytes

Study on Thermal Coupling Characteristics of Constrained Blades Based on Spin Softening

The effects of spin softening and thermal shock had important influence upon the structural stability of blades in rotary machinery. Based on the theories of rotor dynamics and thermodynamics, a dynamic model of rotating blade was built. Considering the effect of spin softening, the research on vibration characteristics of high speed rotating blades was carried out under the centrifugal field and thermal coupling. The results had demonstrated that frequency of blade vibration increases with rising rotating velocity due to the effect of centrifugal force, whilst the frequency of all orders declined with the influence of thermal coupling. The conclusion derived from this paper had both theoretical and empirical value on retrofitting, optimal-designing, as well as engineering application for high speed rotating blades

De Novo Transcriptome Characterization, Gene Expression Profiling and Ionic Responses of Nitraria sibirica Pall. under Salt Stress

Nitraria sibirica Pall., a typical halophyte of great ecological value, is widely distributed in desert, saline, and coastal saline-alkali environments. Consequently, researching the salt tolerance mechanism of N. sibirica Pall. has great significance to the cultivation and utilization of salt-tolerant plants. In this research, RNA-seq, digital gene expression (DGE), and high flux element analysis technologies were used to investigate the molecular and physiological mechanisms related to salt tolerance of N. sibirica Pall. Integrative analysis and de novo transcriptome assembly generated 137,421 unigenes. In total, 58,340 and 34,033 unigenes were annotated with gene ontology (GO) terms and mapped in Kyoto Encyclopedia of Genes and Genomes (KEGG) pathways, respectively. Three differentially expressed genes (DEGs) libraries were subsequently constructed from the leaves of N. sibirica Pall. seedlings under different treatments: control (CK), light short-term salt stress (CL2), and heavy long-term salt stress (CL6). Eight hundred and twenty-six, and 224 differentially expressed genes were identified in CL2 and CL6 compared to CK, respectively. Finally, ionomic analysis of N. sibirica Pall. seedlings treated with 0, 100, 200 or 300 mM concentrations of NaCl for one day showed that the uptake and distribution of Ca, Cu, Fe, Mg and K in different organs of N. sibirica Pall. were significantly affected by salt stress. Our findings have identified potential genes involved in salt tolerance and in the reference transcriptome and have revealed the salt tolerance mechanism in N. sibirica Pall. These findings will provide further insight into the molecular and physiological mechanisms related to salt stress in N. sibirica Pall. and in other halophytes

Climatic Factors Shape the Spatial Distribution of Concentrations of Triterpenoids in Barks of White Birch (Betula Platyphylla Suk.) Trees in Northeast China

Betulin, betulinic acid and lupeol are naturally occurring pentacyclic triterpenoids with significant medicinal values. Great amounts of triterpenoids are found in the bark of white birch (Betula platyphylla Suk.) trees, which can be affected by climatic factors along the geographical gradients. In this study, site-based data of triterpenoids’ (betulin, betulinic acid and lupeol) concentrations were determined in barks of white birch trees from 48 sites in Northeast China. Triterpenoid concentration in white birch tree barks did not change in response to any geographical gradients along latitudes, longitudes or elevations. Instead, concentrations of betulin and lupeol in birch tree barks increased with the increase of temperature and precipitation but declined with the increase of relative humidity. As a result, betulin concentration was higher in birch trees in the northeastern and southwestern parts of the study area, and lower in the central part of the study area in Northeast China. Although betulinic acid concentration did not change with climatic factors, its distribution pattern was similar to betulin concentration. Lupeol concentration was highest in the north-eastern part and along the southern and eastern boundaries in the study area. Our results can supply information for precondition of triterpenoids’ extraction for industrial production, which can be an available approach to solve the issue of bark waste processing of white birch