CLIP-S4^4: Language-Guided Self-Supervised Semantic Segmentation

Existing semantic segmentation approaches are often limited by costly pixel-wise annotations and predefined classes. In this work, we present CLIP-S$^4$ that leverages self-supervised pixel representation learning and vision-language models to enable various semantic segmentation tasks (e.g., unsupervised, transfer learning, language-driven segmentation) without any human annotations and unknown class information. We first learn pixel embeddings with pixel-segment contrastive learning from different augmented views of images. To further improve the pixel embeddings and enable language-driven semantic segmentation, we design two types of consistency guided by vision-language models: 1) embedding consistency, aligning our pixel embeddings to the joint feature space of a pre-trained vision-language model, CLIP; and 2) semantic consistency, forcing our model to make the same predictions as CLIP over a set of carefully designed target classes with both known and unknown prototypes. Thus, CLIP-S$^4$ enables a new task of class-free semantic segmentation where no unknown class information is needed during training. As a result, our approach shows consistent and substantial performance improvement over four popular benchmarks compared with the state-of-the-art unsupervised and language-driven semantic segmentation methods. More importantly, our method outperforms these methods on unknown class recognition by a large margin.Comment: The IEEE/CVF Conference on Computer Vision and Pattern Recognition 202

Isoxazole-Derived Amino Acids are Bromodomain-Binding Acetyl-Lysine Mimics: Incorporation into Histone H4 Peptides and Histone H3.

A range of isoxazole-containing amino acids was synthesized that displaced acetyl-lysine-containing peptides from the BAZ2A, BRD4(1), and BRD9 bromodomains. Three of these amino acids were incorporated into a histone H4-mimicking peptide and their affinity for BRD4(1) was assessed. Affinities of the isoxazole-containing peptides are comparable to those of a hyperacetylated histone H4-mimicking cognate peptide, and demonstrated a dependence on the position at which the unnatural residue was incorporated. An isoxazole-based alkylating agent was developed to selectively alkylate cysteine residues in situ. Selective monoalkylation of a histone H4-mimicking peptide, containing a lysine to cysteine residue substitution (K12C), resulted in acetyl-lysine mimic incorporation, with high affinity for the BRD4 bromodomain. The same technology was used to alkylate a K18C mutant of histone H3.Pfizer Neusentis for studentship suppor

Transcriptome-Wide Binding Sites for Components of the Saccharomyces cerevisiae Non-Poly(A) Termination Pathway: Nrd1, Nab3, and Sen1

RNA polymerase II synthesizes a diverse set of transcripts including both protein-coding and non-coding RNAs. One major difference between these two classes of transcripts is the mechanism of termination. Messenger RNA transcripts terminate downstream of the coding region in a process that is coupled to cleavage and polyadenylation reactions. Non-coding transcripts like Saccharomyces cerevisiae snoRNAs terminate in a process that requires the RNA–binding proteins Nrd1, Nab3, and Sen1. We report here the transcriptome-wide distribution of these termination factors. These data sets derived from in vivo protein–RNA cross-linking provide high-resolution definition of non-poly(A) terminators, identify novel genes regulated by attenuation of nascent transcripts close to the promoter, and demonstrate the widespread occurrence of Nrd1-bound 3′ antisense transcripts on genes that are poorly expressed. In addition, we show that Sen1 does not cross-link efficiently to many expected non-coding RNAs but does cross-link to the 3′ end of most pre–mRNA transcripts, suggesting an extensive role in mRNA 3′ end formation and/or termination

Kinetic CRAC uncovers a role for Nab3 in determining gene expression profiles during stress

RNA-binding proteins play a key role in shaping gene expression profiles during stress, however, little is known about the dynamic nature of these interactions and how this influences the kinetics of gene expression. To address this, we developed kinetic cross-linking and analysis of cDNAs (\u3c7CRAC), an ultraviolet cross-linking method that enabled us to quantitatively measure the dynamics of protein\u2013RNA interactions in vivo on a minute time-scale. Here, using \u3c7CRAC we measure the global RNA-binding dynamics of the yeast transcription termination factor Nab3 in response to glucose starvation. These measurements reveal rapid changes in protein\u2013RNA interactions within 1\u2009min following stress imposition. Changes in Nab3 binding are largely independent of alterations in transcription rate during the early stages of stress response, indicating orthogonal transcriptional control mechanisms. We also uncover a function for Nab3 in dampening expression of stress-responsive genes. \u3c7CRAC has the potential to greatly enhance our understanding of in vivo dynamics of protein\u2013RNA interactions