WavSpA: Wavelet Space Attention for Boosting Transformers' Long Sequence Learning Ability

Transformer and its variants are fundamental neural architectures in deep learning. Recent works show that learning attention in the Fourier space can improve the long sequence learning capability of Transformers. We argue that wavelet transform shall be a better choice because it captures both position and frequency information with linear time complexity. Therefore, in this paper, we systematically study the synergy between wavelet transform and Transformers. We propose Wavelet Space Attention (WavSpA) that facilitates attention learning in a learnable wavelet coefficient space which replaces the attention in Transformers by (1) applying forward wavelet transform to project the input sequences to multi-resolution bases, (2) conducting attention learning in the wavelet coefficient space, and (3) reconstructing the representation in input space via backward wavelet transform. Extensive experiments on the Long Range Arena demonstrate that learning attention in the wavelet space using either fixed or adaptive wavelets can consistently improve Transformer's performance and also significantly outperform learning in Fourier space. We further show our method can enhance Transformer's reasoning extrapolation capability over distance on the LEGO chain-of-reasoning task

Entrepreneurial Intentions and Behaviour as the Creation of Business: Based on the Theory of Planned Behaviour Extension Evidence from Polish Universities and Entrepreneurs

The purpose of this research was to analyze the relationships between the factors that influence entrepreneurial Intention (EI), using a modified version of Ajzen’s theory of planned behaviour (TPB), considering the perception of behaviour. This examination depended on participants' demographic characteristics and psycho-social behavioural traits of attitude (ATT), Subjective norm (SN), and perceived behavioural control (PBC). The establishment of a new business entails various forms of action to achieve desired results. This research analyzes entrepreneurship as the creation of business by engaging in rational behaviour to optimize the use of available technologies and financial sources. These activities are not standardized: They emerge from the entrepreneurial imagination, the perception of new opportunities, and innovation. The aim of a business is not just to produce and sell goods or services. A company must determine the appropriate means of providing them and choose the values to be adopted in the procedure of doing so. Companies should also identify the actions to be taken so that principals or employees incorporate these values into their activities and establish the character that will permit them to regards options and make correct decisions in keeping with the business’s goals

How Leaders Generate Meanings For Monetary Rewards

Scant research has focused on how to increase the value of monetary rewards when they are delivered by leaders to employees. Drawing upon the perspectives of sensegiving and sensemaking, this study explores how leaders generate meanings of monetary rewards perceived by employee recipients in organizational settings. Using a qualitative method design and analyzing qualitative data from 291 incidents, we found that in the distribution process of monetary rewards, sensemaking of employees included strong and weak instrumental meanings as well as symbolic meanings. The results show that leaders adopted a set of sensegiving strategies in distributing monetary rewards including emphasizing money gain/loss and utility, providing feedback, valuing employees, orienting toward the future, guiding values, and publicizing. In the presence of leader’s sensegiving, employee recipients endorsed more positive symbolic meanings of monetary rewards (i.e., recognition and respect). Our research offers a richer view of the role of leader’s sensegiving in making monetary rewards gain more value through employees’ sensemaking, and enriches understanding of monetary rewards, leadership, sensegiving and sensemaking

Entrepreneurial Intentions and Behaviour as the Creation of Business: Based on the Theory of Planned Behaviour Extension Evidence from Polish Universities and Entrepreneurs

The purpose of this research was to analyze the relationships between the factors that influence entrepreneurial Intention (EI), using a modified version of Ajzen’s theory of planned behaviour (TPB), considering the perception of behaviour. This examination depended on participants' demographic characteristics and psycho-social behavioural traits of attitude (ATT), Subjective norm (SN), and perceived behavioural control (PBC). The establishment of a new business entails various forms of action to achieve desired results. This research analyzes entrepreneurship as the creation of business by engaging in rational behaviour to optimize the use of available technologies and financial sources. These activities are not standardized: They emerge from the entrepreneurial imagination, the perception of new opportunities, and innovation. The aim of a business is not just to produce and sell goods or services. A company must determine the appropriate means of providing them and choose the values to be adopted in the procedure of doing so. Companies should also identify the actions to be taken so that principals or employees incorporate these values into their activities and establish the character that will permit them to regards options and make correct decisions in keeping with the business’s goals.El propósito de esta investigación fue analizar las relaciones entre los factores que influyen en la Intención empresarial (EI), utilizando una versión modificada de la teoría del comportamiento planificado (TPB) de Ajzen, considerando la percepción del comportamiento. Este examen dependió de las características demográficas de los participantes y los rasgos de actitud de comportamiento psicosocial (ATT), norma subjetiva (SN) y control conductual percibido (PBC). El establecimiento de un nuevo negocio implica varias formas de acción para lograr los resultados deseados. Esta investigación analiza el emprendimiento como la creación de negocios al participar en un comportamiento racional para optimizar el uso de las tecnologías disponibles y las fuentes financieras. Estas actividades no están estandarizadas: surgen de la imaginación empresarial, la percepción de nuevas oportunidades y la innovación. El objetivo de una empresa no es solo producir y vender bienes o servicios. Una empresa debe determinar los medios apropiados para proporcionarlos y elegir los valores que se adoptarán en el procedimiento para hacerlo. Las empresas también deben identificar las acciones a tomar para que los directores o empleados incorporen estos valores en sus actividades y establezcan el carácter que les permita considerar las opciones y tomar decisiones correctas de acuerdo con los objetivos de la empresa

Research status of rock sliding specular reflection and its application in shale gas preservation

Objective Specular reflection is a smooth surface formed during the sliding process of rock strata, with a certain metallic and glass luster and reflective properties. In some fault zones, these smooth surfaces are also known as fault mirrors (FMs). Specular reflection can be seen in many rock types, such as mudstone, shale, coal seam, carbonate rock, silicate rock and so on. The mechanism of specular reflection is different in different lithologies, but the formation of specular reflection is related to strata sliding. Therefore, the stress, slip rate, slip distance and temperature related to rock strata sliding have important influence on the formation of specularity. Methods A large amount of specular reflection is developed in the syncline Longmaxi Formation shale in Anchang, northern Guizhou. To find out the factors influencing the formation of specular reflection and the internal relationship between them and the gas content of shale in this paper, the development characteristics and formation mechanism of specular reflection and its effects on fluid flow and shale gas preservation conditions were summarized systematically through a large number of literature reviews. Results The results show that: (1) Stress, slip rate, slip displacement and temperature have important influence on the formation of specular reflection. (2) The formation of specular reflection depends on the combination form of stress and sliding rate. It is easier to form specular reflection under high-speed and high-stress conditions. Under low-speed and low-stress conditions, the specular reflection will not be formed even if the sliding displacement is large. (3) Under the same stress and sliding rate, the overall sliding displacement will promote the increase of specular coverage, and the specular coverage can even reach 100%. (4) The temperature makes the rock particles change from brittle to plastic, which can prevent the brittle fracture of the rock particles to a certain extent, and then sinter the rock particles, prompting the formation of specular reflection. (5) The specular roughness is very low, usually in the micrometer level, the average roughness range is only a few micrometers. (6) Specular cracks and slip distances are formed, which significantly improve the flow of shale gas, accelerated loss of shale gas may lead to poor gas. Conclusion Therefore, in the absence of roof and floor conditions, specular refection may be one of the important reasons for the poor gas content of shale

Effects of Astronomical Cycles on Laminated Shales of the Paleogene Shahejie Formation in the Dongying Sag, Bohai Bay Basin, China

Laminated shales are widely developed in the Dongying Sag and have attracted much attention as an oil reservoir. Macroscopically, these shales generally have multi-scale cyclicity, which is closely related to the development of laminae. Therefore, analyzing the origin of their cyclicity is helpful to understanding the formation mechanism of laminated shales and the vertical heterogeneity of shale reservoirs, which are of great significance for continental shale oil exploration and development. In this study, a gamma ray (GR) logging series, high-resolution elemental geochemical data, high-resolution core scanning photos and grayscale data, and mineralogical data were used to characterize the cyclicity of shale at different scales, and their relationship with different astronomical cycles was discussed. The results show that the Es3L and Es4U shale in the Dongying Sag has cyclicity from the meter-scale to the ten-meter scale and then to the hundred-meter scale, which is mainly manifested by periodic changes in organic matter abundance, mineral composition, element abundance, and grayscale. These cycles of different scales coincide with different astronomical periods. Specifically, the hundred-meter scale cyclicity is mainly controlled by the very long orbital period; the ten-meter scale cyclicity is mainly related to the eccentricity cycle; while the precession period is the main driver of the meter-scale cyclicity. Finally, we propose a simplified model for illustrating the formation of rhythmic organic-rich shale. This study is helpful to understanding the origin of continental organic-rich shale and predicting shale reservoir properties

Mass transfer mechanism and model of CO2 absorption into a promising DEEA-HMDA solvent in a packed column

Mass transfer performance plays an important role in solvent evaluation as well as design and scale-up of CO2 absorption process. The mass transfer process of CO2 absorption into blended DEEA -HMDA solution was studied over different operating conditions in a lab-scale absorption column packed with Sulzer DX structured packing. The effect of those operating parameters on KGav was fully investigated and discussed in this work. Meanwhile, mass transfer mechanism of CO2 absorption into blended DEEA-HMDA solution was comprehensively presented by identifying the rate-controlling step of mass transfer and the reaction zone of CO2 with amines, which could provide the operation guideline for running plans. In addition, a new KGav model was proposed and developed on basis of the observed experimental value of KGav, which gave a much better predication performance in comparison with empirical Kohl-Risenfield-Astarita model and Sheng model with respect to AAD

Biomarkers and experimental models for cancer immunology investigation

Abstract The rapid advancement of tumor immunotherapies poses challenges for the tools used in cancer immunology research, highlighting the need for highly effective biomarkers and reproducible experimental models. Current immunotherapy biomarkers encompass surface protein markers such as PD‐L1, genetic features such as microsatellite instability, tumor‐infiltrating lymphocytes, and biomarkers in liquid biopsy such as circulating tumor DNAs. Experimental models, ranging from 3D in vitro cultures (spheroids, submerged models, air–liquid interface models, organ‐on‐a‐chips) to advanced 3D bioprinting techniques, have emerged as valuable platforms for cancer immunology investigations and immunotherapy biomarker research. By preserving native immune components or coculturing with exogenous immune cells, these models replicate the tumor microenvironment in vitro. Animal models like syngeneic models, genetically engineered models, and patient‐derived xenografts provide opportunities to study in vivo tumor‐immune interactions. Humanized animal models further enable the simulation of the human‐specific tumor microenvironment. Here, we provide a comprehensive overview of the advantages, limitations, and prospects of different biomarkers and experimental models, specifically focusing on the role of biomarkers in predicting immunotherapy outcomes and the ability of experimental models to replicate the tumor microenvironment. By integrating cutting‐edge biomarkers and experimental models, this review serves as a valuable resource for accessing the forefront of cancer immunology investigation