Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithm

The Forward-Forward (FF) Algorithm has been recently proposed to alleviate the issues of backpropagation (BP) commonly used to train deep neural networks. However, its current formulation exhibits limitations such as the generation of negative data, slower convergence, and inadequate performance on complex tasks. In this paper, we take the main ideas of FF and improve them by leveraging channel-wise competitive learning in the context of convolutional neural networks for image classification tasks. A layer-wise loss function is introduced that promotes competitive learning and eliminates the need for negative data construction. To enhance both the learning of compositional features and feature space partitioning, a channel-wise feature separator and extractor block is proposed that complements the competitive learning process. Our method outperforms recent FF-based models on image classification tasks, achieving testing errors of 0.58%, 7.69%, 21.89%, and 48.77% on MNIST, Fashion-MNIST, CIFAR-10 and CIFAR-100 respectively. Our approach bridges the performance gap between FF learning and BP methods, indicating the potential of our proposed approach to learn useful representations in a layer-wise modular fashion, enabling more efficient and flexible learning.Comment: To be published in AAAI 2024, 11 pages, 7 figure

Computation of internal voltage distribution in transformer windings by utilizing a voltage distribution factor

Abstract--In this paper, a method for the application of the black-box transformer models to the lumped-parameter transformer winding models is presented. The methodology is based on applying terminal transformer voltages as input parameters that could be provided by using the powerful black box vector fitting. Then, internal voltage distribution is determined by applying a lumped-parameter model approximation. In particular, the paper is focused on the direct computation of the internal voltage distribution, by avoiding a complicated procedure of solving the lumped-parameter winding model. The method is based on the transformation matrix utilization of the voltage distribution factors. This transformation matrix reflects the voltage distribution at specific internal points along the winding with respect to the input terminal voltages. At this stage, the inputs for the lumped-parameters model are provided by measured voltages at transformer terminals and the transformation matrix is determined through geometrical data of the transformer. The implementation of the proposed method with the black-box modeling approach in existing simulation software tools like EMTP is under development. The method is verified by comparing measured with computed waveforms

Guanylyl cyclase activation reverses resistive breathing–induced lung injury and inflammation

Inspiratory resistive breathing (RB), encountered in obstructive lung diseases, induces lung injury. The soluble guanylyl cyclase (sGC)/cyclic guanosine monophosphate (cGMP) pathway is down-regulated in chronic and acute animal models of RB, such as asthma, chronic obstructive pulmonary disease, and in endotoxin-induced acute lung injury. Our objectives were to: (1) characterize the effects of increased concurrent inspiratory and expiratory resistance in mice via tracheal banding; and (2) investigate the contribution of the sGC/cGMP pathway in RB-induced lung injury. Anesthetized C57BL/6 mice underwent RB achieved by restricting tracheal surface area to 50% (tracheal banding). RB for 24 hours resulted in increased bronchoalveolar lavage fluid cellularity and protein content, marked leukocyte infiltration in the lungs, and perturbed respiratory mechanics (increased tissue resistance and elasticity, shifted static pressure–volume curve right and downwards, decreased static compliance), consistent with the presence of acute lung injury. RB down-regulated sGC expression in the lung. All manifestations of lung injury caused by RB were exacerbated by the administration of the sGC inhibitor, 1H-[1,2,4]oxodiazolo[4,3-]quinoxalin-l-one, or when RB was performed using sGCα1 knockout mice. Conversely, restoration of sGC signaling by prior administration of the sGC activator BAY 58-2667 (Bayer, Leverkusen, Germany) prevented RB-induced lung injury. Strikingly, direct pharmacological activation of sGC with BAY 58-2667 24 hours after RB reversed, within 6 hours, the established lung injury. These findings raise the possibility that pharmacological targeting of the sGC–cGMP axis could be used to ameliorate lung dysfunction in obstructive lung diseases

Adherence to Mediterranean Diet and Nutritional Status in Women with Breast Cancer: What Is Their Impact on Disease Progression and Recurrence-Free Patients’ Survival?

Introduction: Nutritional status impacts the survival of patients with cancer. There are few studies that investigate the role of nutritional status on breast cancer survival in women with breast cancer, and even fewer regarding the impact of adhering to the Mediterranean diet (MD). The present study aims to assess the nutritional status, MD adherence, physical activity levels and health-related quality of life (HRQOL) in women diagnosed with breast cancer and evaluate these parameters regarding recurrence-free survival. Methods: A total of 114 women, aged 35–87 years old, diagnosed with breast cancer in Larissa, Greece, participated in the study. Tumor histopathology was reported, and anthropometric indices were measured by a trained nurse, while questionnaires regarding nutritional status (via mini nutritional assessment), HRQOL via EORTC QLQ-C30, physical activity levels via IPAQ and Mediterranean diet adherence via MedDietScore were administered. The participants were followed-up for a maximum time interval of 42 months or until recurrence occurred. Results: A total of 74% of patients were overweight or obese, while 4% of women were undernourished, and 28% were at risk of malnutrition. After 42 months of follow-up, 22 patients (19.3%) had relapsed. The median time to recurrence was 38 months (IQR: 33–40 months) and ranged between 23 to 42 months. Higher levels of MD adherence were significantly associated with lower body mass index (BMI) values, earlier disease stage, smaller tumor size, absence of lymph node metastases and better physical activity levels (p \u3c 0.05). Normal nutritional status was significantly associated with higher BMI values and better health-related quality of life (p ≤ 0.05). In univariate analysis, patients with higher levels of MD adherence and well-nourished patients had significantly longer recurrence-free survival (p \u3c 0.05). In multivariate analysis, MD adherence and nutritional status were independently associated with recurrence-free patients’ survival after adjustment for several confounding factors (p \u3c 0.05). Conclusions: The impact of MD on time to recurrence is still under investigation, and future interventional studies need to focus on the role of adhering to the MD before and after therapy in survival and breast cancer progression. Furthermore, the present study also highlights the importance of an adequate nutritional status on disease progression, and the need for nutritional assessment, education and intervention in women with breast cancer

Sustainable and Regenerative Development of Water Mills as an Example of Agricultural Technologies for Small Farms

Nowadays, the reuse of built agricultural/industrial heritage has been a common practice worldwide. These structures represent excellent symbols of the great agricultural/industrial past. These agricultural/hydro-technologies also serve as monuments of socio-cultural identities, especially in rural areas and on small farms. One example of a successful application of agricultural technologies for small farms is the water mill. By harnessing the water energy, they were used for traditional flour and other goods production (e.g., olive oil) and works requiring energy, with the main role in the evolution of the traditional/cultural landscape. Water mills have been used to drive a mechanical process of milling, hammering, and rolling and are a portion of the agricultural, cultural, and industrial heritage. For approximately two millennia, the vertical mill water wheel prepared the initial source of mechanical power in many regions of the world. Water mills were the first device that converted natural resources of energy into mechanical energy in order to operate some form of machinery. The preservation/management of water mills is challenging due to their long-term abandonment and the lack of information/knowledge about their value. The other obstacles that are faced in their retrofitting and/or preservation are the lack of sufficient economic incentives and complex authorizations/legislations. Sustainability and regeneration of water mills through the centuries are then reviewed for history and agricultural/industrial “archaeology”. The history of water-powered mills in prehistoric and historic times, including ancient Persia/Iran, ancient China, ancient India, the Islamic world, Venetian Crete, medieval Europe, America, and finally present times, is discussed. The outcome of this review allows the understanding of the importance of conservation, optimization, and development of water mills. It will help to know more and achieve sustainable/regenerative development for small farms with respect to water and energy crises at present and in the future

ELECTRON: An Architectural Framework for Securing the Smart Electrical Grid with Federated Detection, Dynamic Risk Assessment and Self-Healing

The electrical grid has significantly evolved over the years, thus creating a smart paradigm, which is well known as the smart electrical grid. However, this evolution creates critical cybersecurity risks due to the vulnerable nature of the industrial systems and the involvement of new technologies. Therefore, in this paper, the ELECTRON architecture is presented as an integrated platform to detect, mitigate and prevent potential cyberthreats timely. ELECTRON combines both cybersecurity and energy defence mechanisms in a collaborative way. The key aspects of ELECTRON are (a) dynamic risk assessment, (b) asset certification, (c) federated intrusion detection and correlation, (d) Software Defined Networking (SDN) mitigation, (e) proactive islanding and (f) cybersecurity training and certification

A Political Theory of Russian Orthodoxy: Evidence from Public Goods Experiments

In this paper, I test the effects of religious norms on the provision of public goods. My evidence is drawn from public goods experiments that I ran with regional bureaucrats in Tomsk and Novosibirsk, Russia. I introduce three treatments, which I define as degrees of Eastern Orthodox collectivist enforcement: 1. Solidarity, 2. Obedience, and 3. Universal discipline. I argue for the existence of an Eastern Orthodox hierarchy in the Russian bureaucracy that facilitates the delivery of public goods under conditions of universal discipline and the principal´s overfulfillment. Eastern Orthodox hierarchy is enforced through universal disciplinary monitoring, which induces collective punishment when the public good is not delivered. Contrary to conventional wisdom about freeriding in administrative institutions, higher ranks in Russian bureaucracies are associated with less freeriding

Molecular mechanisms of cell death: recommendations of the Nomenclature Committee on Cell Death 2018.

Over the past decade, the Nomenclature Committee on Cell Death (NCCD) has formulated guidelines for the definition and interpretation of cell death from morphological, biochemical, and functional perspectives. Since the field continues to expand and novel mechanisms that orchestrate multiple cell death pathways are unveiled, we propose an updated classification of cell death subroutines focusing on mechanistic and essential (as opposed to correlative and dispensable) aspects of the process. As we provide molecularly oriented definitions of terms including intrinsic apoptosis, extrinsic apoptosis, mitochondrial permeability transition (MPT)-driven necrosis, necroptosis, ferroptosis, pyroptosis, parthanatos, entotic cell death, NETotic cell death, lysosome-dependent cell death, autophagy-dependent cell death, immunogenic cell death, cellular senescence, and mitotic catastrophe, we discuss the utility of neologisms that refer to highly specialized instances of these processes. The mission of the NCCD is to provide a widely accepted nomenclature on cell death in support of the continued development of the field