SciCap+: A Knowledge Augmented Dataset to Study the Challenges of Scientific Figure Captioning

In scholarly documents, figures provide a straightforward way of communicating scientific findings to readers. Automating figure caption generation helps move model understandings of scientific documents beyond text and will help authors write informative captions that facilitate communicating scientific findings. Unlike previous studies, we reframe scientific figure captioning as a knowledge-augmented image captioning task that models need to utilize knowledge embedded across modalities for caption generation. To this end, we extended the large-scale SciCap dataset~\cite{hsu-etal-2021-scicap-generating} to SciCap+ which includes mention-paragraphs (paragraphs mentioning figures) and OCR tokens. Then, we conduct experiments with the M4C-Captioner (a multimodal transformer-based model with a pointer network) as a baseline for our study. Our results indicate that mention-paragraphs serves as additional context knowledge, which significantly boosts the automatic standard image caption evaluation scores compared to the figure-only baselines. Human evaluations further reveal the challenges of generating figure captions that are informative to readers. The code and SciCap+ dataset will be publicly available at https://github.com/ZhishenYang/scientific_figure_captioning_datasetComment: Published in SDU workshop at AAAI2

Banach’s Continuous Inverse Theorem and Closed Graph Theorem

In this article we formalize one of the most important theorems of linear operator theory - the Closed Graph Theorem commonly used in a standard text book such as [10] in Chapter 24.3. It states that a surjective closed linear operator between Banach spaces is bounded.This work was supported by JSPS KAKENHI 22300285Sakurai Hideki - 406-3, Haneo, Naganohara Agatuma, Gunma, JapanOkazaki Hiroyuki - Shinshu University, Nagano, JapanShidama Yasunari - Shinshu University, Nagano, JapanGrzegorz Bancerek. The ordinal numbers. Formalized Mathematics, 1(1):91-96, 1990.Czesław Bylinski. Basic functions and operations on functions. Formalized Mathematics, 1(1):245-254, 1990.Czesław Bylinski. Functions and their basic properties. Formalized Mathematics, 1(1):55-65, 1990.Czesław Bylinski. Functions from a set to a set. Formalized Mathematics, 1(1):153-164, 1990.Czesław Bylinski. Partial functions. Formalized Mathematics, 1(2):357-367, 1990.Czesław Bylinski. Some basic properties of sets. Formalized Mathematics, 1(1):47-53, 1990.Czesław Bylinski. Introduction to real linear topological spaces. Formalized Mathematics, 13(1):99-107, 2005.Noboru Endou, Yasumasa Suzuki, and Yasunari Shidama. Real linear space of real sequences. Formalized Mathematics, 11(3):249-253, 2003.Eugeniusz Kusak, Wojciech Leonczuk, and Michał Muzalewski. Abelian groups, fields and vector spaces. Formalized Mathematics, 1(2):335-342, 1990.Isao Miyadera. Functional Analysis. Riko-Gaku-Sya, 1972.Takaya Nishiyama, Keiji Ohkubo, and Yasunari Shidama. The continuous functions on normed linear spaces. Formalized Mathematics, 12(3):269-275, 2004.Hiroyuki Okazaki, Noboru Endou, and Yasunari Shidama. Cartesian products of family of real linear spaces. Formalized Mathematics, 19(1):51-59, 2011, doi: 10.2478/v10037-011-0009-2.Beata Padlewska and Agata Darmochwał. Topological spaces and continuous functions. Formalized Mathematics, 1(1):223-230, 1990.Jan Popiołek. Real normed space. Formalized Mathematics, 2(1):111-115, 1991.Yasunari Shidama. Banach space of bounded linear operators. Formalized Mathematics, 12(1):39-48, 2004.Wojciech A. Trybulec. Subspaces and cosets of subspaces in real linear space. Formalized Mathematics, 1(2):297-301, 1990.Wojciech A. Trybulec. Vectors in real linear space. Formalized Mathematics, 1(2):291-296, 1990.Zinaida Trybulec. Properties of subsets. Formalized Mathematics, 1(1):67-71, 1990.Edmund Woronowicz. Relations and their basic properties. Formalized Mathematics, 1(1):73-83, 1990.Edmund Woronowicz. Relations defined on sets. Formalized Mathematics, 1(1):181-186, 1990

市販食品中の食品添加物の使用実態と使用の妥当性について

The actual situations for the use of food additives and its validity were investigated on 200 specimens of processed foods sold on the market. The analytical method was used by summing up the indications printed on the each package. The results are as follows ; As a whole, natural occurring substances about coloring, sweetening and thickening agents have been used overwhelmingly, but the use of artificial materials is much less in most specimens. And on some specimens added the enriched agents like vitamins, those addition was less efficient nutritionally, however, other each addition of food additives have been recognized as appropriateness on other most of specimens

レトルトカレー中に含まれる天然クルクミンおよび赤ワイン中ブドウ果皮色素の摂取に対する衛生学的評価

Naturally contained curucumin in pre-cooked carried curry packed in a plastic bag or canned and grape skin color in red wine were determined. The results showed that curucumin in one portion of the curry samples have been contained the amount of correspond to 0.3～6 times of acceptable daily intake (ADI) for a man of 50Kg weight, and the amount of grape skin color in the wine corresponded to 3/4 of the ADI. In contrast , artificial color of food red No. 102 in a pickled ginger tuber (Benishoga) and mixture of food blue No. 1 and yellow No.4 in the syrup for shaved ice have been only contained the amount bellow 1/100 of the ADI