PartialFormer: Modeling Part Instead of Whole

The design choices in Transformer feed-forward neural networks have resulted in significant computational and parameter overhead. In this work, we emphasize the importance of hidden dimension in designing lightweight FFNs, a factor often overlooked in previous architectures. Guided by this principle, we introduce PartialFormer, a parameter-efficient Transformer architecture utilizing multiple smaller FFNs to reduce parameters and computation while maintaining essential hidden dimensions. These smaller FFNs are integrated into a multi-head attention system to enable effective collaboration. We also propose a tailored head scaling strategy to enhance PartialFormer's capabilities. Furthermore, we present a residual-like attention calculation to improve depth scaling within PartialFormer. Extensive experiments on 9 translation tasks and 1 abstractive summarization task validate the effectiveness of our PartialFormer approach. Our code would be available at: \url{https://github.com/zhengkid/PartialFormer}.Comment: 11 pages, 5 figure

Multivisceral resection of nonfunctional pancreatic neuroendocrine neoplasm with nearby organ invasion: a case report

Pancreatic neuroendocrine neoplasms (pNENs) are relatively rare epithelial malignancies originating from pancreatic neuroendocrine cells, pathologically classified into well-differentiated pancreatic neuroendocrine tumors (pNETs) and poorly-differentiated pancreatic neuroendocrine carcinoma (pNECs). Although they also fall under the category of pNENs, the almost entirely distinct biological characteristics and survival prognosis have caused debate among surgeons when it comes to the development of surgical intervention options, particularly for locally advanced G3 pNETs and pNECs. We present a case of 66-year-old male with nonfunctional G3 pNET, invasion of five nearby pancreatic organs and type II liver metastases. The patient achieved good outcomes after undergoing multivisceral resection and postoperative adjuvant chemotherapy. This finding helps surgeons better understand locally advanced pNENs, formulate treatment decisions systematically and confidently, and balance patient benefits and risks of surgery

Involvement of Glutamate Transporter-1 in Neuroprotection against Global Brain Ischemia-Reperfusion Injury Induced by Postconditioning in Rats

Ischemic postconditioning refers to several transient reperfusion and ischemia cycles after an ischemic event and before a long duration of reperfusion. The procedure produces neuroprotective effects. The mechanisms underlying these neuroprotective effects are poorly understood. In this study, we found that most neurons in the CA1 region died after 10 minutes of ischemia and is followed by 72 hours of reperfusion. However, brain ischemic postconditioning (six cycles of 10 s/10 s reperfusion/re-occlusion) significantly reduced neuronal death. Significant up-regulation of Glutamate transporter-1 was found after 3, 6, 24, 72 hours of reperfusion. The present study showed that ischemic postconditioning decreases cell death and that upregulation of GLT-1 expression may play an important role on this effect

West Meets East in a New Two-Polarities Model of Personality: Combining Self-Relatedness Structure With Independent-Interdependent Functions

Self and relatedness are the two most essential dimensions of personality, as indicated in many personality theories, and have been supported by numerous empirical studies conducted in the western (individualistic) and eastern (collectivist) contexts. However, because of a confusion or failure to distinguish the structure and function of personality, popular theories (e.g., the Big Five model) do not make logic distinctions between these two basic personality dimensions. In terms of the cultural-relevant feature, both self and relatedness and their specific aspects may be variously highlighted in different cultural settings. On the basis of a re-examination of several crucial two-dimension (namely, self and relatedness) personality theories derived from the east and west, we reconstruct a new two polarities personality model to include not only self and relatedness but also the independent and interdependent functions in terms of some popular personality theories from western and eastern cultures. Theoretically and empirically, self and relatedness should be the basic structures of personality, whereas independence and interdependence should be the basic functions of personality. Self and relatedness have independent and interdependent functions; however, due to the cultural relevance of personality, the functions should be variously emphasized in different contexts. Several possible future research directions are discussed

Effect of ultrasound pretreatment on the drying kinetics and characteristics of pregelatinized kidney beans based on microwave-assisted drying

This study aimed to investigate the effects of ultrasound pretreatment combined with pulse-spouted microwave vacuum drying (PSMVD) and microwave hot air rolling drying (MHARD) on the drying characteristics, microstructure and physicochemical properties of pregelatinized kidney beans. The results showed that ultrasound pretreatment significantly improved the drying efficiency and physical properties of the samples during PSMVD and MHARD, and contributed to the formation of porous structures in the dried beans. Meanwhile, ultrasound promoted the hydrolysis of protein, free amino acids content was significantly increased by 3.69 %–11.4 %. However, the combination of ultrasound pretreatment and drying also resulted in a decreased polyphenolic content and antioxidant capacity of the dried beans. PSMVD with ultrasound for 30 min had the best color (ΔE = 14.17), the shortest drying time (50 min) and had a higher content of amino acids (206.15 mg/g) compared with other products. Overall, ultrasound pretreatment can effectively improve the drying process of kidney beans

Behavior of Confined Headed Bar Connection for Precast Reinforced Concrete Member Assembly

The mechanical performance of precast RC structures relies on the connections, especially the connections of steel bars, between precast RC members. Grouted sleeve splices and grouted spiral-confined overlap connections are widely used in engineering practice in China. Both of these two connection splices require on-site grouting. The process is concealed and invisible, leading to difficult on-site inspection. The unseen defects cause a challenge for detection and repair, which may impair the reliability of precast RC members’ behavior. This paper presents an RC member assembly connection with visible on-site construction quality-monitoring. The proposed confined headed-bar connection (CHBC) consists of two overlapping headed bars and confinement stirrup. With CHBC, the potential construction defects are diminished, and subsequently the construction quality as well as the reliability is upgraded. Experimental investigation on 18 CHBC specimens was carried out; the main parameters considered were overlap length and bar-head size. The failure modes, bearing capacity, stirrup strain development and bond versus slip response are studied. Working mechanism of CHBC is investigated in terms of bond behavior force and concrete compression force at head experimentally and numerically; distributive relationship of these two forces is revealed. The results show that for Φ12 reinforcement, a 90 mm overlap length under test parameters is adequate to reach headed bar ultimate strength in CHBC. Finally, a CHBC-bearing capacity prediction method is suggested based on the superposition method and strut-and-tie model theory

Effect of induction mode on 3D printing characteristics of whey protein isolate emulsion gel

This study mainly explored the influence of different induction modes such as NaCl and Transglutaminase on the 3D printing characteristics of whey protein isolate emulsion gel. The properties of gel were characterized from rheological properties, microstructure, Fourier transform infrared spectroscopy, thermal stability and other aspects, and the relationship between 3D printing molding characteristics of gel and its applicability as a diet for dysphagia was discussed. Strain and frequency sweep showed that the addition of NaCl made gel difficult to be extruded during printing, while the addition of TG could get the opposite result. From a microscopic point of view, too high concentration of NaCl would lead to the disordered aggregation of proteins, which would reduce the structural strength of gel and make the water binding unstable. The addition of TG made the gel network have an orderly three-dimensional structure, making the water binding more stable. Both NaCl and TG can cause the secondary structure of protein to be more orderly and the thermal stability to be reduced, and the texture characteristics such as hardness, resilence, springiness, gumminess and chewiness to be reduced. During 3D printing of emulsion gel containing high concentration of NaCl, unsmooth extrusion filaments and pattern collapse occurred. TG can significantly improve the accuracy of 3D printing products. This study provided a basis for the application of whey protein isolate emulsion gel in 3D printing

Extra long electron-hole diffusion lengths in CH3NH3PbI3-xClx perovskite single crystals

Long electron-hole diffusion lengths in organolead trihalide compounds play a key role in achieving the remarkable performance of perovskite photovoltaics. Diffusion lengths in solution-grown CH3NH3PbI3 single crystals have been found to be greater than 175 micrometer (mm). Herein, we report the diffusion lengths in CH3NH3PbI3-xClx single crystals exceeding 380 mm under 1 Sun illumination, which is twice that in CH3NH3PbI3 single crystals. Incorporation of chlorine is found to increase the density of trap-states and reduce the valence band level; these two factors, which dominate the carrier recombination and the charge transfer, respectively, are in a competing relation. As a result, the electron-hole diffusion lengths in a CH3NH3PbI3-xClx single crystal with an optimum Cl proportion (x = 0.005) reach the maximum values. This study provides a strategy for the design of perovskite optoelectronics