AMPNet: Attention as Message Passing for Graph Neural Networks

Graph Neural Networks (GNNs) have emerged as a powerful representation learning framework for graph-structured data. A key limitation of conventional GNNs is their representation of each node with a singular feature vector, potentially overlooking intricate details about individual node features. Here, we propose an Attention-based Message-Passing layer for GNNs (AMPNet) that encodes individual features per node and models feature-level interactions through cross-node attention during message-passing steps. We demonstrate the abilities of AMPNet through extensive benchmarking on real-world biological systems such as fMRI brain activity recordings and spatial genomic data, improving over existing baselines by 20% on fMRI signal reconstruction, and further improving another 8% with positional embedding added. Finally, we validate the ability of AMPNet to uncover meaningful feature-level interactions through case studies on biological systems. We anticipate that our architecture will be highly applicable to graph-structured data where node entities encompass rich feature-level information.Comment: 16 pages (12 + 4 pages appendix). 5 figures and 7 table

Chemoreceptor co-expression in Drosophila melanogaster olfactory neurons.

Drosophila melanogaster olfactory neurons have long been thought to express only one chemosensory receptor gene family. There are two main olfactory receptor gene families in Drosophila, the odorant receptors (ORs) and the ionotropic receptors (IRs). The dozens of odorant-binding receptors in each family require at least one co-receptor gene in order to function: Orco for ORs, and Ir25a, Ir8a, and Ir76b for IRs. Using a new genetic knock-in strategy, we targeted the four co-receptors representing the main chemosensory families in D. melanogaster (Orco, Ir8a, Ir76b, Ir25a). Co-receptor knock-in expression patterns were verified as accurate representations of endogenous expression. We find extensive overlap in expression among the different co-receptors. As defined by innervation into antennal lobe glomeruli, Ir25a is broadly expressed in 88% of all olfactory sensory neuron classes and is co-expressed in 82% of Orco+ neuron classes, including all neuron classes in the maxillary palp. Orco, Ir8a, and Ir76b expression patterns are also more expansive than previously assumed. Single sensillum recordings from Orco-expressing Ir25a mutant antennal and palpal neurons identify changes in olfactory responses. We also find co-expression of Orco and Ir25a in Drosophila sechellia and Anopheles coluzzii olfactory neurons. These results suggest that co-expression of chemosensory receptors is common in insect olfactory neurons. Together, our data present the first comprehensive map of chemosensory co-receptor expression and reveal their unexpected widespread co-expression in the fly olfactory system