Prompt-Based Metric Learning for Few-Shot NER

Few-shot named entity recognition (NER) targets generalizing to unseen labels and/or domains with few labeled examples. Existing metric learning methods compute token-level similarities between query and support sets, but are not able to fully incorporate label semantics into modeling. To address this issue, we propose a simple method to largely improve metric learning for NER: 1) multiple prompt schemas are designed to enhance label semantics; 2) we propose a novel architecture to effectively combine multiple prompt-based representations. Empirically, our method achieves new state-of-the-art (SOTA) results under 16 of the 18 considered settings, substantially outperforming the previous SOTA by an average of 8.84% and a maximum of 34.51% in relative gains of micro F1. Our code is available at https://github.com/AChen-qaq/ProML

Traitement des registres de langue dans l’enseignement du français

Le présent article est consacré à la problématique des registres de langue en rapport avec l’enseignement du français. Cette notion clé est d’abord révisée du point de vue de la linguistique pour exposer la complexité terminologique, elle est ensuite examinée sous l’angle de la sociolinguistique en vue de justifier la diversité des usages de la langue liés aux facteurs socio-culturels. Dans l’optique de l’approche communicative, le traitement des registres de langue dans l’enseignement du français doit intégrer l’objectif central de travailler la compétence de communication

Urban fringe renewal with urban catalysts elements: connections in an unconnected area

Based on Santa Coloma as a main case,analyzing how can be update there in this crisis situation to do suitable interventions to achieve a great effect. After analyzing the Santa Coloma area,I pay attention to its urban marginality.It has the territorial marginality,the marginality of the relationship with Barcelona,the marginality of the people and life style and so on. Urban fringe is corresponding the city center, the city of mainstream.The socalled "fringe" can be understand at least contain the following meaning:Urban border space , the fringe people of the crowd , the fringe life style, it can be adjusted on the political significance of urban public about the organization and allocation of resources,it also can be about the relationship of the border between the city and urban development , the relationship between the urban and natural environment. The attention to its urban marginality actual is a determination and also a orientation to the situation of Santa Coloma.Make it easer to find the characteristics of this area,and then find a suitable relationship with Barcelona even with other cities,and also is good for find the form of its renewal. For Santa Coloma,it is an area multicultural,energetic,close to nature and also clutter and messy,they think is a place that easer to live than other city place but lack of sense of local self-identity,maybe also themselves;For “Barcelona person”,Santa Coloma is an area where there is an Ikea and can ride bike but full of immigrants and maybe not safely;And for the Chinese people who live in Barcelona,Fondo is a metro station where can find many of Chinese restaurants and commodities but far from the city center,In addition to this,sometimes in the area of Badalona there are more chooses.So for each group of people,Santa Coloma is not a place very good and essential.But actually,when i have being go there many times,i really think its a attractive place. So for renewal of this fringe area,i think at first the most important thing is to establish a “spiritual center”,a place can make people who live here produce a sense of identity and deposit “collective memory”[2] which is mentioned in the Rossi’s .Second,is make more connections between Santa Coloma and Barcelona even between other cities and Santa Coloma to offer more opportunity and make more possible to let each other to flow.And then,is the connection of inner Santa Coloma. So in this situation of the city fringe renewal i think its good to introduce the concept of “Urban catalysts”[1]which is the concept of the book <american urban architecture-catalysts in the design of cities>,to make a responds and explain to my proposal to the Santa Coloma. And also with the project of 5th student is very interesting,we can see different attitudes to the same place.And also its a comparing with my attitude to this area

Interactive Free-Viewpoint Video Generation

Background Free-viewpoint video (FVV) is processed video content in which viewers can freely select the viewing position and angle. FVV delivers an improved visual experience and can also help synthesize special effects and virtual reality content. In this paper, a complete FVV system is proposed to interactively control the viewpoints of video relay programs through multimedia terminals such as computers and tablets. Methods The hardware of the FVV generation system is a set of synchronously controlled cameras, and the software generates videos in novel viewpoints from the captured video using view interpolation. The interactive interface is designed to visualize the generated video in novel viewpoints and enable the viewpoint to be changed interactively. Results Experiments show that our system can synthesize plausible videos in intermediate viewpoints with a view range of up to 180°

FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction

In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and the corresponding benchmark to evaluate single-view facial 3D reconstruction. By training on FaceScape data, a novel algorithm is proposed to predict elaborate riggable 3D face models from a single image input. FaceScape dataset provides 18,760 textured 3D faces, captured from 938 subjects and each with 20 specific expressions. The 3D models contain the pore-level facial geometry that is also processed to be topologically uniformed. These fine 3D facial models can be represented as a 3D morphable model for rough shapes and displacement maps for detailed geometry. Taking advantage of the large-scale and high-accuracy dataset, a novel algorithm is further proposed to learn the expression-specific dynamic details using a deep neural network. The learned relationship serves as the foundation of our 3D face prediction system from a single image input. Different than the previous methods, our predicted 3D models are riggable with highly detailed geometry under different expressions. We also use FaceScape data to generate the in-the-wild and in-the-lab benchmark to evaluate recent methods of single-view face reconstruction. The accuracy is reported and analyzed on the dimensions of camera pose and focal length, which provides a faithful and comprehensive evaluation and reveals new challenges. The unprecedented dataset, benchmark, and code have been released to the public for research purpose.Comment: 14 pages, 13 figures, journal extension of FaceScape(CVPR 2020). arXiv admin note: substantial text overlap with arXiv:2003.1398

MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model

Multimodal semantic understanding often has to deal with uncertainty, which means the obtained messages tend to refer to multiple targets. Such uncertainty is problematic for our interpretation, including inter- and intra-modal uncertainty. Little effort has studied the modeling of this uncertainty, particularly in pre-training on unlabeled datasets and fine-tuning in task-specific downstream datasets. In this paper, we project the representations of all modalities as probabilistic distributions via a Probability Distribution Encoder (PDE) by utilizing sequence-level interactions. Compared to the existing deterministic methods, such uncertainty modeling can convey richer multimodal semantic information and more complex relationships. Furthermore, we integrate uncertainty modeling with popular pre-training frameworks and propose suitable pre-training tasks: Distribution-based Vision-Language Contrastive learning (D-VLC), Distribution-based Masked Language Modeling (D-MLM), and Distribution-based Image-Text Matching (D-ITM). The fine-tuned models are applied to challenging downstream tasks, including image-text retrieval, visual question answering, visual reasoning, and visual entailment, and achieve state-of-the-art results.Comment: CVPR 2023 accep

Experiments on bright field and dark field high energy electron imaging with thick target material

Using a high energy electron beam for the imaging of high density matter with both high spatial-temporal and areal density resolution under extreme states of temperature and pressure is one of the critical challenges in high energy density physics . When a charged particle beam passes through an opaque target, the beam will be scattered with a distribution that depends on the thickness of the material. By collecting the scattered beam either near or off axis, so-called bright field or dark field images can be obtained. Here we report on an electron radiography experiment using 45 MeV electrons from an S-band photo-injector, where scattered electrons, after interacting with a sample, are collected and imaged by a quadrupole imaging system. We achieved a few micrometers (about 4 micrometers) spatial resolution and about 10 micrometers thickness resolution for a silicon target of 300-600 micron thickness. With addition of dark field images that are captured by selecting electrons with large scattering angle, we show that more useful information in determining external details such as outlines, boundaries and defects can be obtained.Comment: 7pages, 7 figure