Uncertainty Estimation of Transformers' Predictions via Topological Analysis of the Attention Matrices

Determining the degree of confidence of deep learning model in its prediction is an open problem in the field of natural language processing. Most of the classical methods for uncertainty estimation are quite weak for text classification models. We set the task of obtaining an uncertainty estimate for neural networks based on the Transformer architecture. A key feature of such mo-dels is the attention mechanism, which supports the information flow between the hidden representations of tokens in the neural network. We explore the formed relationships between internal representations using Topological Data Analysis methods and utilize them to predict model's confidence. In this paper, we propose a method for uncertainty estimation based on the topological properties of the attention mechanism and compare it with classical methods. As a result, the proposed algorithm surpasses the existing methods in quality and opens up a new area of application of the attention mechanism, but requires the selection of topological features

Nanometer To Millimeter Scale Peptide-porphyrin Materials

AQ-Pal14 is a 30-residue polypeptide that was designed to form an alpha-helical coiled coil that contains a metal-binding 4-pyridylalanine residue on its solvent-exposed surface. However, characterization of this peptide shows that it exists as a three-stranded coiled coil, not a two-stranded one as predicted from its design. Reaction with cobalt(III) protoporphyrin IX (Co-PPIX) produces a six-coordinate Co-PPIX(AQ-Pal 14)(2) species that creates two coiled-coil oligomerization domains Coordinated to opposite laces of the porphyrin ring. It is found that this species undergoes a buffer-dependent Self-assembly process: nanometer-scale globular materials were formed when these components were reacted in unbuffered H(2)O, while millimeter-scale, rod-like materials were prepared when the reaction was performed in phosphate buffer (20 mM, pH 7). It is suggested that assembly of the globular material is dictated by the conformational properties of the coiled-coil forming AQ-Pal14 peptide, whereas that a the rod-like material involves interactions between Co-PPIX and phosphate ion

Endogenous Demand for Money and Default of a Creditor

We study a general equilibrium model of perfect competition with production and endogenous demand for fiat (or non-consumable) money (Shubik-Wilson, 1977), with workers, entrepreneurs, and a bank. Workers supply labor (Beker, 1971) and consume, entrepreneurs consume and organize production. There is no barter, and both agent types borrow money from a bank. The bank motivates borrowers to pay loans back with a punishment, which has an impact on demands for credits before a trade. The model has three markets: labor, goods, and credits. We study the results of the credit market with a numerical simulation in Maple. The model has 4 regimes, one of which corresponds to the classical money theory. Three other regimes have defaults as parts of an equilibrium.  The special feature of our model is that   it allows to study interactions of real (production and demand/supply of labor) markets with a nominal (credit) market, but also it can produce cases, when a value of default of borrowers exceeds total money supply from the bank, what become a reason for insolvency of the bank

Nanometer to Millimeter Scale Peptide-Porphyrin Materials

AQ-Pal14 is a 30-residue polypeptide that was designed to form an α-helical coiled coil which contains a metal-binding 4-pyridylalanine residue on its solvent-exposed surface. However, characterization of this peptide shows that it exists as a three-stranded coiled coil, and not a two-stranded one as predicted from its design. Reaction with cobalt(III) protoporphyrin IX (Co-PPIX) produces a six-coordinate Co-PPIX(AQ-Pal14)(2) species which creates two coiled-coil oligomerization domains coordinated to opposite faces of the porphyrin ring. It is found that this species undergoes a buffer-dependent self-assembly process: nanometer-scale globular materials were formed when these components were reacted in unbuffered H(2)O, while millimeter-scale rod-like materials were prepared when the reaction was performed in phosphate buffer (20 mM, pH 7). It is suggested that assembly of the globular material is dictated by the conformational properties of the coiled-coil forming AQ-Pal14 peptide, whereas that of the rod-like material involves interactions between Co-PPIX and phosphate ion

Rapid Efficacy of Gemtuzumab Ozogamicin in Refractory AML Patients with Pulmonary and Kidney Failure

Objectives: To the best of our knowledge, data from Gemtuzumab ozogamicin in Acute Myeloid Leukemia (AML) patients with failure of organ functions and poor performance status are extremely lacking. Moreover, the fast recovery from organ failure, after Gemtuzumab ozogamicin administration, has never been reported. This study aimed to demonstrate the efficacy and rapid response of Gemtuzumab ozogamicin in refractory acute myeloid leukemia (AML) patients with pulmonary and kidney failure and poor performance status. Three refractory AML patients, with organ dysfunction, are described. One patient was pre-treated with intensive chemotherapy, and two other patients progressed during Azacitidine treatment. Two patients had respiratory failure grade 2 and one patient suffered from acute kidney insufficiency. Two patients were highly febrile with an elevated С-Reactive Protein (CRP) level. The WHO performance status of three was measured in all patients. Gemtuzumab ozogamicin administration was performed in three patients, followed by a further switch to Gemtuzumab ozogamicin + Azacitidine or “7+3” treatment. Results: Gemtuzumab ozogamicin administration resulted in abrupt fever cessation in two febrile patients simultaneously with a rapid decrease in CRP level and fast resolution of respiratory failure. Recovery of kidney function was noticed rapidly in patients with renal insufficiency. The WHO performance status was elevated in all three patients. No adverse grade II–III effects were noticed. Further treatment made two patients eligible for intensive chemotherapy, one patient underwent allogeneic stem cell transplantation, and the patient with kidney failure obtained complete remission. Conclusions: Gemtuzumab ozogamicin therapy appeared to be safe and highly efficacious in relapsed/refractory AML patients with organ dysfunction, like pulmonary or renal failure and poor performance status, and may contribute to rapid recovery from organ failures