Grammar-Constrained Decoding for Structured NLP Tasks without Finetuning

Despite their impressive performance, large language models (LMs) still struggle with reliably generating complex output structures when not finetuned to follow the required output format exactly. To address this issue, grammar-constrained decoding (GCD) can be used to control the generation of LMs, guaranteeing that the output follows a given structure. Most existing GCD methods are, however, limited to specific tasks, such as parsing or code generation. In this work, we demonstrate that formal grammars can describe the output space for a much wider range of tasks and argue that GCD can serve as a unified framework for structured NLP tasks in general. For increased flexibility, we introduce input-dependent grammars, which allow the grammar to depend on the input and thus enable the generation of different output structures for different inputs. We then empirically demonstrate the power and flexibility of GCD-enhanced LMs on (1) information extraction, (2) entity disambiguation, and (3) constituency parsing. Our results indicate that grammar-constrained LMs substantially outperform unconstrained LMs or even beat task-specific finetuned models. Grammar constraints thus hold great promise for harnessing off-the-shelf LMs for a wide range of structured NLP tasks, especially where training data is scarce or finetuning is expensive. Code and data: https://github.com/epfl-dlab/GCD.Comment: Accepted at EMNLP 2023 Main Conferenc

TINJAUAN HUKUM ISLAM TERHADAP SISTEM PENGUPAHAN PEKERJA PANGLONG (Studi Kasus di Panglong Sumadi Dusun I Ketiau Kelurahan Lempuyang Bandar Kecamatan Way Pengubuan Kabupaten Lampung Tengah)

ABSTRAK Menentukan upah yang adil bagi seorang pekerja sesuai kehendak syari’ah bukanlah pekerjaan mudah. Mawardi dalam “Al-Ahkam al-Suthaniah” berpendapat bahwa dasar penetapan upah pekerja adalah standar cukup, artinya gaji atau upah pekerja dapat menutupi kebutuhan minimum. Sistem upah yang dilakukan oleh pemilik panglong yaitu pak Sumadi adalah sistem borongan, dimana upah yang akan diberikan pada pekerja yaitu Jarkoni dan Hanafi, setelah diselesaikan pekerjaan barang yang diminta konsumen Jarkoni dan Hanafi dapat menerima upah yang menjadi haknya dari hasil pekerjaannya. Pada tahun 2015 didirikan perusahaan panglong, awal mulanya Bapak Sumadi mendirikan sebuah panglong yang beralamatkan di Dusun I Lempuyang Bandar Kecamatan Way Pengubuan Kabupaten Lampung Tengah. Bapak Sumadi tidak memiliki sebuah nama untuk usaha panglongnya, berdirinya panglong Bapak Sumadi karena ketidaksengajaan, pada saat itu bapak sumadi memang memiliki kelebihan yaitu membuat sebuah kursi, meja, pintu dan lain-lainnya. Namun terdapat perbedaan pemberian nominal upah kepada pekerja panglong yang diberikan pemilik panglong yaitu pak Sumadi. Alasan yang didapat peneliti dari pak Sumadi yang memberikan upah berbeda kepada Jarkoni dan Hanafi dikarenakan Jarkoni lebih dahulu bekerja di panglong pak Sumadi dari pada Hanafi. Permasalahan yang diangkat dalam penelitian ini adalah Bagaimana sistem Pengupahan Pekerja Panglong dan Bagaimana Tinjauan Hukum Islam Terhadap Pengupahan Pekerja Panglong di Panglong Sumadi Dusun I Ketiau Indah Kelurahan Lempuyang Bandar, Kecamatan Way Pengubuan, Kabupaten Lampung Tengah? Adapun tujuan dari penelitian ini adalah Untuk mengetahui bagaimana sistem Terhadap pengupahan Pekerja Panglong dan Untuk mengetahui bagaimana pandangan hukum Islam terhadap Pengupahan Pekerja Panglong di Panglong Sumadi Dusun I Ketiau Indah Kelurahan Lempuyang Bandar, Kecamatan Way Pengubuan, Kabupaten Lampung Tengah. Penelitian ini adalah penelitian kualitatif dengan pendekatan berfikir deskriptif analisis, alasannya penelitian membutuhkan analisa dalam rangka menemukan hukum terkait dengan tinjauan hukum Islam tentang sistem upah pekerja panglong. Adapun jenis penelitian ini merupakan field research (penelitian lapangan) yang dilakukan pada pengelola dan pemain yang didukung oleh library research (penelitian perpustakaan) sebagai pendukung dalam melakukan penelitian, dengan menggunakan berbagai literatur yang ada di perpustakaan yang relevan dengan masalah yang diangkat untuk diteliti. Berdasarkan hasil penelitian tersebut didapat kesimpulan bahwa Sistem upah yang diberlakukan di panglong pak Sumadi menurut peneliti tidak mencerminkan keadilan dan keseimbangan. Dalam hal ini pak Sumadi tidak memberikan upah yang sama pada pekerjanya yaitu Jarkoni dan Hanafi, pak Sumadi memberikan upah yang lebih besar pada Jarkoni dengan alasan terlebih dahulu bekerja, padahal pekerjaan yang dilimpahkan sama, baik dari segi kesulitan dan bentuknya. Pandangan hukum Islam terhadap sistem pengupahan pekerja panglong tidak dibenarkan syariat Islam, karena Hukum Islam menetapkan prinsip-prinsip yang berpengaruh kepada pelaksanaan perjanjian upa

Risco de Salinização dos Solos das Áreas Irrigadas ao Longo do Rio Montepuez / Risk of Salinization of Soils in Irrigated Areas Along the Montepuez River

A salinização dos solos é um problema frequente nas áreas irrigadas das regiões áridas e semi-áridas. No Distrito de Montepuez ao longo das margens do rio Montepuez, a produção de hortícolas com recuso a água do Rio Montepuez tem sido feita sem o conhecimento prévio da composição físico-química da água e do solo. Desta feita, a pesquisa objetivou analisar o risco de salinização dos solos das áreas irrigadas ao longo do Rio Montepuez, no Bairro de Muica. Para tal, foi analisada a composição fico-química do solo, a qualidade da água e foram descritas as práticas de irrigação com recurso a entrevista estruturada. Para análise da composição físico-química do solo foram coletadas amostras simples de nove pontos e em duas profundidades (0 a 20 cm e 20 a 40 cm). Para analise da qualidade de água foram coletadas duas amostras nos pontos de tomada água.  O local estudado é caracterizado por: prática de rega por bacias de inundação com recurso a uma moto-bomba; os solos de textura media apresentam dificuldades de drenagem; a água usada para irrigação apresenta EC alta e um pH neutro tendendo para alcalinidade. Com tais condições, conclui-se que a área apresenta risco de salinização dos solos

Caractérisation moléculaire de cinq nouveaux allèles-S liés à l’autoincompatibilité chez des cultivars locaux espagnols d’amandier

Almond is a highly heterozygous species with a high number of S-alleles controlling its gametophytic self-incompatibility system (GSI). In this work we have analysed Spanish local almond cultivars for S-RNase allele diversity. By cloning and sequencing five new S-RNase alleles were identified: S31 (804 bp) in 'Pou de Felanitx' and 'Totsol', S32 (855 bp) in 'Taiatona', S33 (1165 bp) in 'Pou d'Establiments' and 'Muel', S34 (1663 bp) in 'Pané-Barquets', and S35 (1658 bp) in 'Planeta de les Garrigues'. The high number of new alleles identified reveals the wide diversity of almond germplasm still existing and requiring characterisation, and points to the possibility of new findings by a wider study focusing on other provenancesL'amandier est une espèce hautement hétérozygote avec un nombre très élevé d'allèles-S qui contrôlent son système d'autocompatibilité gamétophytique (GSI). Dans le présent travail on a analysé des cultivars locaux espagnols pour étudier la diversité des allèles de la S-RNase. Par clonage et séquençage, cinq nouveaux allèles ont été identifiés : S31 (804 bp) chez 'Pou de Felanitx' et 'Totsol', S32 (855 bp) chez 'Taiatona', S33 (1165 bp) chez 'Pou d'Establiments' et 'Muel', S34 (1663 bp) chez 'Pané-Barquets', et S35 (1658 bp) chez 'Planeta de les Garrigues'. Le nombre élevé de nouveaux allèles identifiés révèle la grande diversité encore existante chez le germoplasme de l'amandier et ayant besoin d'être caractérisée, montrant la possibilité d'entreprendre de nouveaux travaux plus approfondis avec des génotypes d'autres provenance

Selection of the best comparator for the risk assessment of GM plants- conventional counterpart vs. negative segregant

Abstract for 12th international Symposium on biosafety of genetically modified organisms The identification of similarities and differences between GM plants and derived food/feed and their comparators plays a central role in risk assessment strategy. Therefore, selecting the right comparators must be one of the top priorities. The question is which control would allow us to better evaluate the potential unintended effects related directly to the transgene and/or DNA rearrangements, discounting the potential effects caused by in vitro culture procedures; since, these are non-controversial procedures also used in conventional breeding. Aiming to answer the previous question we have used Multiplex fluorescence 2D gel electrophoresis technology (DyeAGNOSTICS Refraction-2D) coupled with MS to characterize the proteome of three different rice lines (Oriza sativa L. ssp. Japonica cv Nipponbare): A control conventional counterpart. An Agrobacterium transformed transgenic line. A negative segregant (homozygous negative progeny) from a different transgenic line. We have observed that transgenic and negative segregant plant lines grouped together (only 1 differentially regulated spot - fold difference > 1.5, ANOVA, P1.5, ANOVA, P<0.05, in both transgenic and negative segregant lines comparing to control line). Additionally, the 35 proteins identified (using MS) in this study, were already associated with stress response by other authors. The only feature in common between the transgenic and negative segregant lines is that they have both suffered in vitro culture procedures. Hence, the results obtained indicate that, in this study, different gene disruption and/or DNA rearrangements and the presence/absence of transgene were factors with less impact on rice proteome than the proteomic promoted differences caused by in vitro culture, and eventually the stress caused by this process. This work highlights the importance of continuous revision and upgrade of the guidance criteria to be followed for the selection of suitable comparators in GMO risk assessment

Deciphering Histone Modifications in Rice by Chromatin Immunoprecipitation (ChIP): Applications to Study the Impact of Stress Imposition

The spatial organization of chromatin, the methylome, and histone modifications represents epigenetic layers that greatly intersect each other, influencing genome regulation and allowing high flexibility in stress response. Although changes in specific histone modification marks could be extensively associated with transcriptional regulation of stress-responsive genes, a link between specific epigenetic signatures and plant stress tolerance has not yet been established. This chapter includes some examples of the associations found between fluctuations in these marks and regulation of plant stress-responsive genes. Chromatin immunoprecipitation (ChIP) has been widely used to uncover the landscape of histone modifications. However, ChIP involves multiple steps and requires optimizations targeting the tissue and the plant species. Here, we detail the ChIP procedure currently used in our laboratory, for leaf tissues of young rice seedlings, to decipher the dynamic feature of specific chemical modifications of histones that may influence the expression of stress-responsive genes. We show the success achieved after introducing specific optimizations and highlight the key critical steps and trouble shootings that may occur. A thorough understanding of stress-induced fluctuations of specific histone modifications may unveil new strategies to improve plant adaptation and performance in suboptimal conditions

Short communication. Cloning and sequencing of partial genomic DNA fragments corresponding to the S11 and S12 alleles of the Spanish almond cultivar ''Marcona''

This paper reports the cloning and partial genomic DNA sequencing of two S-RNases (S11 and S12) of almond. DNA from the Spanish almond cultivar Marcona, the most highly appreciated in Spain, was amplified by PCR using the primer pair AS1II and AmyC5R designed for the conserved regions of almond S-alleles. The cloned and sequenced S11 allele of cv. Marcona appears to be identical to that of cvs. Rumbeta and Bertina (which have been previously cloned and sequenced). This is the first time, however, that S12 has been sequenced in almond. The amplified and cloned S12 allele fragment possessed 1080 bp corresponding to the second intron and 506 bp corresponding to the second and third exons. The product of PCR-specific amplification showed that cv. Marcona and the Portuguese cultivar Pestaneta carry the same S12 allele. Knowledge of the sequences of these alleles will be helpful in the design of specific primers for S11 and S12, and could be of use when employing antisense techniques in genetic engineering projects.Este trabajo muestra la clonación y el análisis de secuencias de fragmentos de DNA genómico correspondientes a dos S-RNasas (S11 y S12) de almendro. Estos fragmentos se amplificaron mediante PCR a partir de DNA del cultivar 'Marcona', el más apreciado en el mercado español, utilizando la pareja de cebadores AS1II y AmyC5R, diseñados en regiones conservadas de los alelos S de almendro. El alelo S11 fue clonado y secuenciado en 'Marcona', y es idéntico al clonado y secuenciado previamente en 'Rumbeta' y 'Bertina'. En cambio, es la primera vez que el alelo S12 se secuencia en almendro. El fragmento analizado de este alelo contiene el segundo intrón (1080 pb) y secuencias parciales del segundo y tercer exón (506 pb). La amplificación específica por PCR mostró que el cultivar español 'Marcona' y el portugués 'Pestaneta' poseen el mismo alelo S12. La secuenciación de estos alelos permitirá, no sólo diseñar cebadores específicos para S11 y S12, sino también aplicar posiblemente la tecnología anti-sentido en ingeniería genética

Flows: Building Blocks of Reasoning and Collaborating AI

Recent advances in artificial intelligence (AI) have produced highly capable and controllable systems. This creates unprecedented opportunities for structured reasoning as well as collaboration among multiple AI systems and humans. To fully realize this potential, it is essential to develop a principled way of designing and studying such structured interactions. For this purpose, we introduce the conceptual framework of Flows: a systematic approach to modeling complex interactions. Flows are self-contained building blocks of computation, with an isolated state, communicating through a standardized message-based interface. This modular design allows Flows to be recursively composed into arbitrarily nested interactions, with a substantial reduction of complexity. Crucially, any interaction can be implemented using this framework, including prior work on AI--AI and human--AI interactions, prompt engineering schemes, and tool augmentation. We demonstrate the potential of Flows on the task of competitive coding, a challenging task on which even GPT-4 struggles. Our results suggest that structured reasoning and collaboration substantially improve generalization, with AI-only Flows adding +$21$ and human--AI Flows adding +$54$ absolute points in terms of solve rate. To support rapid and rigorous research, we introduce the aiFlows library. The library comes with a repository of Flows that can be easily used, extended, and composed into novel, more complex Flows. The aiFlows library is available at https://github.com/epfl-dlab/aiflows. Data and Flows for reproducing our experiments are available at https://github.com/epfl-dlab/cc_flows