Channel Vision Transformers: An Image Is Worth C x 16 x 16 Words

Vision Transformer (ViT) has emerged as a powerful architecture in the realm of modern computer vision. However, its application in certain imaging fields, such as microscopy and satellite imaging, presents unique challenges. In these domains, images often contain multiple channels, each carrying semantically distinct and independent information. Furthermore, the model must demonstrate robustness to sparsity in input channels, as they may not be densely available during training or testing. In this paper, we propose a modification to the ViT architecture that enhances reasoning across the input channels and introduce Hierarchical Channel Sampling (HCS) as an additional regularization technique to ensure robustness when only partial channels are presented during test time. Our proposed model, ChannelViT, constructs patch tokens independently from each input channel and utilizes a learnable channel embedding that is added to the patch tokens, similar to positional embeddings. We evaluate the performance of ChannelViT on ImageNet, JUMP-CP (microscopy cell imaging), and So2Sat (satellite imaging). Our results show that ChannelViT outperforms ViT on classification tasks and generalizes well, even when a subset of input channels is used during testing. Across our experiments, HCS proves to be a powerful regularizer, independent of the architecture employed, suggesting itself as a straightforward technique for robust ViT training. Lastly, we find that ChannelViT generalizes effectively even when there is limited access to all channels during training, highlighting its potential for multi-channel imaging under real-world conditions with sparse sensors. Our code is available at https://github.com/insitro/ChannelViT

A Disorder-Induced Domino-Like Destabilization Mechanism Governs the Folding and Functional Dynamics of the Repeat Protein IκBα

<div><p>The stability of the repeat protein IκBα, a transcriptional inhibitor in mammalian cells, is critical in the functioning of the NF-κB signaling module implicated in an array of cellular processes, including cell growth, disease, immunity and apoptosis. Structurally, IκBα is complex, with both ordered and disordered regions, thus posing a challenge to the available computational protocols to model its conformational behavior. Here, we introduce a simple procedure to model disorder in systems that undergo binding-induced folding that involves modulation of the contact map guided by equilibrium experimental observables in combination with an Ising-like Wako-Saitô-Muñoz-Eaton model. This one-step procedure alone is able to reproduce a variety of experimental observables, including ensemble thermodynamics (scanning calorimetry, pre-transitions, <i>m</i>-values) and kinetics (roll-over in chevron plot, intermediates and their identity), and is consistent with hydrogen-deuterium exchange measurements. We further capture the intricate distance-dynamics between the domains as measured by single-molecule FRET by combining the model predictions with simple polymer physics arguments. Our results reveal a unique mechanism at work in IκBα folding, wherein disorder in one domain initiates a domino-like effect partially destabilizing neighboring domains, thus highlighting the effect of symmetry-breaking at the level of primary sequences. The offshoot is a multi-state and a dynamic conformational landscape that is populated by increasingly partially folded ensembles upon destabilization. Our results provide, in a straightforward fashion, a rationale to the promiscuous binding and short intracellular half-life of IκBα evolutionarily engineered into it through repeats with variable stabilities and expand the functional repertoire of disordered regions in proteins.</p></div

Intermediates and chevron roll-overs.

<p>(A) The predicted 1D free-energy profiles as a function of the number of structured residues (RC – reaction coordinate). (B) A closer look at the free energy profile close to the denaturation midpoint indicating the presence of two major intermediates (I₁ and I₂), a minor intermediate (I′) apart from the end states (U and N). The continuous red curve is the tryptophan signal calculated from the 2D structural ensemble while the dashed red curve is the assumed tryptophan signal switch. (C) Population of the major macrostates as a function of temperature. (D) Relaxation rates predicted by the model (continuous and dashed lines) compared with experiments (circles). The predicted rates were matched with the experimental midpoint relaxation rates assuming a single uniform diffusion coefficient of (7e6/<i>N</i>) n² s⁻¹ where <i>n</i> is the reaction coordinate value and <i>N</i> is the protein length. Triangles correspond to the faster phase observed in simulations.</p

Folding landscape and complexity.

<p>(A) SSA free-energy landscape of ligand-free IκBα highlighting the diversity of intermediates (lower free energy – FE - and blue in color) that can be populated during folding. The coordinates (<i>m, n</i>) represent the starting residue and the number of structured residues, respectively. The fully folded state is therefore (1, 213), i.e. starting from 1 there are 213 folded residues, while a partially structured state with ARs 2, 3, and 4 folded will be centered around (35, 90), i.e. starting from 35 there are 90 structured residues. The partially folded repeats in each of the local minima are indicated as numbers within ellipses following the color code of <a href="http://www.ploscompbiol.org/article/info:doi/10.1371/journal.pcbi.1003403#pcbi-1003403-g001" target="_blank">Figure 1A</a>. (B) Structural view of the intermediates I₁ and I₂. The black curves indicate unstructured regions.</p

Domino-like destabilization mechanism in the folding of free-IκBα.

<p>(A) Global unfolding probabilities of helical residues colored according to the repeat identity. (B) The mean residue probabilities (a larger value indicates higher relative stability) as a function of repeat index at 298 and 310 K. The triangles correspond to the control simulation that employs the contact-map of the bound-IκBα, i.e. employing the entire contact-map from the PDB id. 1NFI without deleting interactions. (C) Correlation between the predicted mean residue unfolding probabilities and the fraction of amides exchanged from experiments at 298 K.</p

Native state dynamics.

<p>(A and B) Single-molecule Monte-Carlo dynamic traces along the reaction coordinate value at two temperatures. (C) Distances between various repeats (1–4, 2–5, 2–6 and 3–6) calculated from the 2D structural ensemble and projected onto the 1D profile as a function of the number of structured residues. (D–G) Binned FRET efficiency histogram indicating that the number of peaks, their positions, and amplitudes are dependent on temperature and on the construct studied. (H) Correlation between experimental and predicted FRET peak positions. Circles correspond to the major peak at 298 K while the triangles indicate FRET position of the minor peaks that appear at 310 K (the data for AR 2–6 is not available).</p

Modeling disorder in IκBα and thermodynamics.

<p>(A) Crystal structure of the bound-IκBα. (B) Contact-map of bound- and modeled free-IκBα. It can be seen that the repeats 5 and 6 in the modeled free-IκBα (circled region) are dominated by local contacts. (C) The predicted unfolding curve for the free-IκBα with a prominent pre-transition that accounts for ∼20% of the total unfolding amplitude.</p

Spontaneous isolated superior mesenteric artery dissection - Report of two cases

Two cases of isolated superior mesenteric artery dissection diagnosed by contrast enhanced 64 slice CT are reported. In both, the dissection was seen extending along the entire length of the artery with one of them showing partially thrombosed false lumen. One case was associated with dissection of left renal artery with consequent renal infarcts. Although superior mesenteric artery dissection is a rare phenomenon, it should be considered in the differential diagnosis of abdominal angina