Product-based Neural Networks for User Response Prediction

Predicting user responses, such as clicks and conversions, is of great importance and has found its usage in many Web applications including recommender systems, web search and online advertising. The data in those applications is mostly categorical and contains multiple fields; a typical representation is to transform it into a high-dimensional sparse binary feature representation via one-hot encoding. Facing with the extreme sparsity, traditional models may limit their capacity of mining shallow patterns from the data, i.e. low-order feature combinations. Deep models like deep neural networks, on the other hand, cannot be directly applied for the high-dimensional input because of the huge feature space. In this paper, we propose a Product-based Neural Networks (PNN) with an embedding layer to learn a distributed representation of the categorical data, a product layer to capture interactive patterns between inter-field categories, and further fully connected layers to explore high-order feature interactions. Our experimental results on two large-scale real-world ad click datasets demonstrate that PNNs consistently outperform the state-of-the-art models on various metrics.Comment: 6 pages, 5 figures, ICDM201

Multi-Device Task-Oriented Communication via Maximal Coding Rate Reduction

Task-oriented communication offers ample opportunities to alleviate the communication burden in next-generation wireless networks. Most existing work designed the physical-layer communication modules and learning-based codecs with distinct objectives: learning is targeted at accurate execution of specific tasks, while communication aims at optimizing conventional communication metrics, such as throughput maximization, delay minimization, or bit error rate minimization. The inconsistency between the design objectives may hinder the exploitation of the full benefits of task-oriented communications. In this paper, we consider a specific task-oriented communication system for multi-device edge inference over a multiple-input multiple-output (MIMO) multiple-access channel, where the learning (i.e., feature encoding and classification) and communication (i.e., precoding) modules are designed with the same goal of inference accuracy maximization. Instead of end-to-end learning which involves both the task dataset and wireless channel during training, we advocate a separate design of learning and communication to achieve the consistent goal. Specifically, we leverage the maximal coding rate reduction (MCR2) objective as a surrogate to represent the inference accuracy, which allows us to explicitly formulate the precoding optimization problem. We cast valuable insights into this formulation and develop a block coordinate descent (BCD) solution algorithm. Moreover, the MCR2 objective also serves the loss function of the feature encoding network, based on which we characterize the received features as a Gaussian mixture (GM) model, facilitating a maximum a posteriori (MAP) classifier to infer the result. Simulation results on both the synthetic and real-world datasets demonstrate the superior performance of the proposed method compared to various baselines.Comment: submitted to IEEE for possible publicatio

The traditional Chinese medicine formulation Ruanjian Sanjie Decoction regulates the tumor matrix and improves the anti-tumor efficacy of TP-PEG-LPs

The Ruanjian Sanjie Decoction (RSD) is a traditional Chinese medicine (TCM) formulation consisting of Spica Prunellae, Pseudobulbus Cremastrae Seu Pleiones, Concha Ostreae and Semen Coicis, and widely used as an adjuvant in anti-cancer therapy. The aim of this study was to determine the effects of RSD on the extracellular matrix (ECM) of tumors, and on the efficacy of anti-cancer nano-formulations in a tumor-bearing mouse model. The mice were treated with triptolide encapsulated in PEG-modified liposomes (TP-PEG-LPs), either alone or in combination with RSD. The combination treatment significantly retarded tumor growth relative to the untreated controls, indicating the potent adjuvant effect of RSD in targeted anti-cancer therapy. In addition, RSD also reduced the amount of total collagen and collagen I and increased that of collagen III in the tumor ECM, along with decreasing the expression of the pro-angiogenic VEGF. Finally, even high doses of RSD did not significantly affect the liver and kidney function or body weight, indicating low toxicity

In vitro antioxidant activity and inhibitory hepatic steatosis effect on oleic acid-induced fatty liver model of consecutive extracts from Rosa davurica Pall

The nutrient and phytochemical composition of Rosa davurica Pall. fruit (RDF) from China were determined, including sugar, reducing sugar, ascorbic acid, caroteniods and phenolics. RDF was successively extracted with chloroform, ethyl acetate (EA), water-saturated n-butanol, ethanol and distilled water, respectively. Among the five fractions, EA fraction revealed the highest total phenolic content and the strongest antioxidant ability in cyclic voltammograms (CV) and oxygen radical absorbance capacity (ORAC) assays. Moreover, the strongest inhibitory activity against oleic acidinduced (OA-induced) fatty liver in vitro was also the EA fraction. Further, it was separated by a semipreparative high performance liquid chromatography (HPLC) on C18 column. The most active fraction (EA-FII) of EA in all assays above, which mainly included catechin, quercetin-sedoheptulose and quercetin-94, was identified by LC/MS, HPLC and ultraviolet (UV)/V spectrum analysis.Keywords: RDF extracts, composition properties, antioxidant ability, inhibitory activity, oleic acid-induced, HPLC, LC/MS.African Journal of Biotechnology Vol. 12(31), pp. 4944-495

Time-varying Reliability Analysis of Long-span Continuous Rigid Frame bridge under Cantilever Construction Stage based on the Monitored Strain Data

Abstract: In general, the material properties, loads, resistance of the prestressed concrete continuous rigid frame bridge in different construction stages are time-varying. So, it is essential to monitor the internal force state when the bridge is in construction. Among them, how to assess the safety is one of the challenges. As the continuous monitoring over a long-term period can increase the reliability of the assessment, so, based on a large number of monitored strain data collected from the structural health monitoring system (SHMS) during construction, a calculation method of the punctiform time-varying reliability is proposed in this paper to evaluate the stress state of this type bridge in cantilever construction stage by using the basic reliability theory. At the same time, the optimal stress distribution function in the bridge mid-span base plate is determined when the bridge is closed. This method can provide basis and direction for the internal force control of this type bridge in construction process. So, it can reduce the bridge safety and quality accidents in construction stages

In situ epicatechin-loaded hydrogel implants for local drug delivery to spinal column for effective management of post-traumatic spinal injuries

Purpose: To prepare hydrogels loaded with epicatechin, a strong antioxidant,  anti-inflammatory, and neuroprotective tea flavonoid, and characterise them in situ as a vehicle for prolonged and safer drug delivery in patients with post-traumatic spinal cord injury.Methods: Five in situ gel formulations were prepared using chitosan and evaluated in terms of their visual appearance, clarity, pH, viscosity, and in vitro drug release. In vivo anti-inflammatory activity was determined and compared with 2 % piroxicam gel as standard. Motor function activity in a rat model of spinal injury was examined comparatively with i.v. methylprednisolone as standard.Results: The N-methyl pyrrolidone solution (containing 1 % w/w epicatechin with 2 to 10 % w/w chitosan) of the in situ gel formulation had a uniform pH in the range of 4.01 ± 0.12 to 4.27 ± 0.02. High and uniform drug loading, ranging from 94.48 ± 1.28 to 98.08 ± 1.24 %, and good in vitro drug release (79.48 ± 2.84 to 96.48 ± 1.02 % after 7 days) were achieved. The in situ gel prepared from 1 % epicatechin and 2 % chitosan (E5) showed the greatest in vivo anti-inflammatory activity  (60.58 % inhibition of paw oedema in standard carrageenan-induced hind rat paw oedema model, compared with 48.08 % for the standard). The gels showed  significant therapeutic effectiveness against post-traumainduced spinal injury in rats. E5 elicited maximum motor activity (horizontal bar test) in the spinal injuryrat model; the rats that received E5 treatment produced an activity score of 3.62 ± 0.02 at the end of 7 days, compared with 5.0 ± 0.20 following treatment with the standard.Conclusion: In situ epicatechin-loaded gel exhibits significant neuroprotective and anti-inflammatory effects, and therefore can potentially be used for prolonged and safe drug delivery in patients with traumatic spinal cord injury.Keywords: Epicatechin, In situ gel, Chitosan, Spinal injury, Post-traumatic, Motor activity, Antiinflammator

Long-Term Follow-Up of the Fellow Eye in Patients Undergoing Surgery on One Eye for Treating Myopic Traction Maculopathy

Objective. To observe the fellow eye in patients undergoing surgery on one eye for treating myopic traction maculopathy. Methods. 99 fellow eyes of consecutive patients who underwent unilateral surgery to treat MTM were retrospectively evaluated. All patients underwent thorough ophthalmologic examinations, including age, gender, duration of follow-up, refraction, axial length, intraocular pressure, lens status, presence/absence of a staphyloma, and best-corrected visual acuity (BCVA). Fundus photographs and SD-OCT images were obtained. When feasible, MP-1 microperimetry was performed to evaluate macular sensitivity and fixation stability. Results. At an average follow-up time of 24.7 months, 7% fellow eyes exhibited partial or complete MTM resolution, 68% stabilized, and 25% exhibited progression of MTM. Of the 38 eyes with “normal” macular structure on initial examination, 11% exhibited disease progression. The difference in progression rates in Groups 2, 3, and 4 was statistically significant. Refraction, axial length, the frequency of a posterior staphyloma, chorioretinal atrophy, initial BCVA, final BCVA, and retinal sensitivity all differed significantly among Groups 1–4. Conclusions. Long axial length, chorioretinal atrophy, a posterior staphyloma, and anterior traction contribute to MTM development. Patients with high myopia and unilateral MTM require regular OCT monitoring of the fellow eye to assess progression to myopic pre-MTM. For cases exhibiting one or more potential risk factors, early surgical intervention may maximize the visual outcomes