InstructSeq: Unifying Vision Tasks with Instruction-conditioned Multi-modal Sequence Generation

Empowering models to dynamically accomplish tasks specified through natural language instructions represents a promising path toward more capable and general artificial intelligence. In this work, we introduce InstructSeq, an instruction-conditioned multi-modal modeling framework that unifies diverse vision tasks through flexible natural language control and handling of both visual and textual data. InstructSeq employs a multimodal transformer architecture encompassing visual, language, and sequential modeling. We utilize a visual encoder to extract image features and a text encoder to encode instructions. An autoregressive transformer fuses the representations and generates sequential task outputs. By training with LLM-generated natural language instructions, InstructSeq acquires a strong comprehension of free-form instructions for specifying visual tasks. This provides an intuitive interface for directing capabilities using flexible natural instructions. Without any task-specific tuning, InstructSeq achieves compelling performance on semantic segmentation, referring expression segmentation/comprehension, and image captioning. The flexible control and multi-task unification empower the model with more human-like versatility and generalizability for computer vision. The code will be released soon at https://github.com/rongyaofang/InstructSeq.Comment: 10 page

Metabolites from the fungus Phoma sp. 7210, associated with Aizoon canariense.

A new metabolite, 3,16-diketoaphidicolan (1), was isolated together with four known compounds: aphidicolin (2), 17-acetyl-aphidicolin (3), (+)-eupenoxide (4), and phomoxanthone A (5) from the endophytic fungus Phoma sp. The structure of the new compound 1 was determined by spectroscopic methods (mainly extensive 1D and 2D NMR experiments and by mass spectral measurements) and confirmed by X-ray crystallography. Its absolute configuration was assigned by means of the solid-state CD/TDDFT approach comparing the solid-state CD spectrum with the TDDFT-calculated one on the X-ray geometry

Allo-aromadendrane- and picrotoxane-type sesquiterpenes from Dendrobium moniliforme

Eight sesquiterpenes, four stilbene derivs. along with two lignans have been isolated from lipophilic fraction of stems of Dendrobium moniliforme (Orchidaceae). Among the eight sesquiterpenes, one allo-aromadendrane-type (I) and four picrotoxane-type sesquiterpenes (e.g. II) were identified to be new compds., and alpha -dihydropicrotoxinin was isolated as a new natural product. Their structures were established on the basis of spectroscopic anal. [on SciFinder (R)

New Nostocyclophanes from <i>Nostoc linckia</i>

Six new nostocyclophanes and four known compounds have been isolated from Nostoc linckia (Nostocaceae) cyanobacterial strain UTEX B1932. The new compounds, nostocyclophanes E–J (1–6), were characterized by NMR and MS techniques. The known compounds were nostocyclophanes B–D, previously isolated from this strain, and dedichloronostocyclophane D. Structural modifications on the new [7.7]paracyclophane analogs 1–5, isolated from the 80% methanol fraction, range from simple changes such as the lack of methylation or halogenation to more unusual modifications such as those seen in nostocyclophane H (4), in which the exocyclic alkyl chains are of different length; this is the first time this modification has been observed in this family of natural products. In addition, nostocyclophane J (6) is a linear analog in which C-20 is chlorinated in preparation for the presumed enzymatic Friedel–Craft cyclization needed to form the final ring structure, analogous to the biosynthesis of the related cylindrocyclophanes. Nostocyclophane D, dedichloronostocyclophane D, and nostocyclophanes E-J demonstrated moderate to weak growth inhibition against MDA-MB-231 breast cancer cells

Pregnane-10,2-carbolactones from a Hawaiian Marine Sponge in the Genus <i>Myrmekioderma</i>

Four new pregnanes, 3β,4β-dihydroxy-17-methyl-17α-pregna-5,13-diene-10,2-carbolactone (<b>1</b>), 6β-chloro-3β-hydroxy-17-methyl-17α-pregna-4,13-diene-10,2-carbolactone (<b>2</b>), 3β-hydroxy-6β-methoxy-17-methyl-17α-pregna-4,13-diene-10,2-carbolactone (<b>3</b>), and 3β,6β-dihydroxy-17-methyl-17α-pregna-4,13-diene-10,2-carbolactone (<b>4</b>), were isolated from an undescribed species of <i>Myrmekioderma</i> Ehlers along with the known pregnane carbolactone (<b>5</b>). The structures of the new compounds were determined by spectroscopic methods and comparison with previously described compounds. Compound <b>5</b> showed almost 4-fold activation of pregnane X receptor, while <b>2</b> inhibited BACE1 with an IC₅₀ value of 82 μM