Differentiable Instruction Optimization for Cross-Task Generalization

Instruction tuning has been attracting much attention to achieve generalization ability across a wide variety of tasks. Although various types of instructions have been manually created for instruction tuning, it is still unclear what kind of instruction is optimal to obtain cross-task generalization ability. This work presents instruction optimization, which optimizes training instructions with respect to generalization ability. Rather than manually tuning instructions, we introduce learnable instructions and optimize them with gradient descent by leveraging bilevel optimization. Experimental results show that the learned instruction enhances the diversity of instructions and improves the generalization ability compared to using only manually created instructions.Comment: 14pages, 6 figures, accepted for Findings of ACL202

Development of New Functional Ammonium-Based Ionic Liquid Coating Materials for Organic Hazard Mitigation

Chemical warfare agents (CWAs) and toxic industrial chemicals (TICs) are organic compounds that, when released, pose hazards to civilians and first responders. Several technologies exist to decontaminate materials exposed to these compounds, but their physical limitations prevent them from being effective for treating certain types of CWA- or TIC-contacted substrates. Current decontamination technologies cannot be applied to complex or vertical surfaces, which risks long-term exposure to the hazardous organic compounds if they cannot be extracted from the substrate surface or interior. Ionic liquid (IL) gels are a relatively new type of decontamination material that can be applied to complex substrates due to their mechanical strength, non-volatility, and structural modularity. Previous work has shown that IL gels that adopt solid-like morphologies via non-covalent intermolecular forces or polymer networks are effective for removing CWA and TIC simulants from contacted substrates. This thesis discusses the preparation of new IL-based gel systems based on ammonium ILs that can be cured in situ using step-growth polymerization to form IL polymer network/free IL composites. The first-generation materials developed were polymerized ionic liquid (PIL)/IL composites containing cross-linked polyurethane linkages. These coatings proved to be not only thermally and electrochemically stable, but they could also be applied in their monomeric mixture form to substrates contacted by a TIC simulant and subsequently cured into solid, flexible films. The coatings were found to be effective vapor barrier materials for use on rubber and painted steel. In order to prevent the soak-in of these coatings on porous substrates, a series of reactive ammonium IL prepolymers that could also be cured in situ was prepared using RAFT polymerization. The reactive IL prepolymer/IL mixtures could be applied to and cured on porous wood and ceramic with minimal soak-in, and were found to prevent vapor release of the TIC simulant and extract the liquid simulant from the interior of the substrates. Finally, several novel ammonium ILs containing organosulfonate and organophosphonate anions were synthesized and combined with commercial polymers to form IL physical gels for potential hazard mitigation use on human skin. Preliminary studies investigated their absorption into a synthetic skin membrane, Strat-MTM.</p

SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generation

Automatic literature review generation is one of the most challenging tasks in natural language processing. Although large language models have tackled literature review generation, the absence of large-scale datasets has been a stumbling block to the progress. We release SciReviewGen, consisting of over 10,000 literature reviews and 690,000 papers cited in the reviews. Based on the dataset, we evaluate recent transformer-based summarization models on the literature review generation task, including Fusion-in-Decoder extended for literature review generation. Human evaluation results show that some machine-generated summaries are comparable to human-written reviews, while revealing the challenges of automatic literature review generation such as hallucinations and a lack of detailed information. Our dataset and code are available at https://github.com/tetsu9923/SciReviewGen.Comment: ACL findings 2023 (to be appeared). arXiv admin note: text overlap with arXiv:1810.04020 by other author

Hemming for Joining High Strength Steel Sheets

AbstractA high strength steel sheet is used to make the hollow sections for the body structure of automobiles. The hollow sections, which are typically joined by resistance spot welding have insufficient energy absorption because the joins are not continuous. Thus, to overcome this problem, the hollow section is joined using the hemming process. The hemming of the high strength steel sheet was successfully performed using punch with stopper. The high strength steel hollow sections joined by hemming and resistance spot welding were then examined by tensile and fatigue tests. The hollow section with hemmed joins showed better performance in both tests. The overlapping joins of the hemmed hollow section have greater strength as compared to the resistance of spot welding joins

Issues for application of virtual microscopy to cytoscreening, perspectives based on questionnaire to Japanese cytotechnologists

To clarify the issues associated with the applications of virtual microscopy to the daily cytology slide screening, we conducted a survey at a slide conference of cytology. The survey was conducted specifically to the Japanese cytology technologists who use microscopes on a routine basis. Virtual slides (VS) were prepared from cytology slides using NanoZoomer (Hamamatsu Photonics, Japan), which is capable of adjusting focus on any part of the slide. A total of ten layers were scanned from the same slides, with 2 micrometer intervals. To simulate the cytology slide screening, no marker points were created. The total data volume of six slides was approximately 25 Giga Bytes. The slides were stored on the Windows 2003 Server, and were made accessible on the web to the cytology technologists. Most cytotechnologists answered "Satisfied" or "Acceptable" to the VS resolution and drawing speed, and "Dissatisfied" to the operation speed. To the ten layered focus, an answer "insufficient" was slightly more frequent than the answer "sufficient", while no one answered "fewer is acceptable" or "no need for depth". As for the use of cytology slide screening, answers "usable, but requires effort" and "not usable" were about equal in number. In a Japanese cytology meeting, a unique VS system has been used in slide conferences with markings to the discussion point for years. Therefore, Japanese cytotechnologists are relatively well accustomed to the use of VS, and the survey results showed that they regarded VS more positively than we expected. Currently, VS has the acceptable resolution and drawing speed even on the web. Most cytotechnologists regard the focusing capability crucial for cytology slide screening, but the consequential enlargement of data size, longer scanning time, and slower drawing speed are the issues that are yet to be resolved