Using Sparse Semantic Embeddings Learned from Multimodal Text and Image Data to Model Human Conceptual Knowledge

Distributional models provide a convenient way to model semantics using dense embedding spaces derived from unsupervised learning algorithms. However, the dimensions of dense embedding spaces are not designed to resemble human semantic knowledge. Moreover, embeddings are often built from a single source of information (typically text data), even though neurocognitive research suggests that semantics is deeply linked to both language and perception. In this paper, we combine multimodal information from both text and image-based representations derived from state-of-the-art distributional models to produce sparse, interpretable vectors using Joint Non-Negative Sparse Embedding. Through in-depth analyses comparing these sparse models to human-derived behavioural and neuroimaging data, we demonstrate their ability to predict interpretable linguistic descriptions of human ground-truth semantic knowledge.Comment: Proceedings of the 22nd Conference on Computational Natural Language Learning (CoNLL 2018), pages 260-270. Brussels, Belgium, October 31 - November 1, 2018. Association for Computational Linguistic

The Effect of Satisfaction, Perceived Value, Image, and Perceived Sacrifice on Public Healthcare Service Institution\u27s Patient Loyalty

This research aims to investigate the simultaneous effect of satisfaction, perceived value, image, and perceived sacrifice on patient loyalty. This study is believed to be the first to develop and test patient loyalty model that includes satisfaction, perceived value, image, and perceived sacrifice. Quantitative research methodology was employed. We performed survey to collect the empirical data. The respondents are 162 patients of two health care service institutions in Bogor and Bekasi, Indonesia. The conceptual model and proposed hypotheses were examined using multiple regressions analysis. The findings showed that image has positive impact on patient loyalty. However, this research also found that satisfaction, perceived value, and perceived sacrifice do not have significant impact on patient loyalty. Thus, the management of public healthcare service institution should consider and manage the image of the institution proactively

The refocusing distance of a standard plenoptic photograph

IEEE International Conference PaperIn the past years, the plenoptic camera aroused an increasing interest in the field of computer vision. Its capability of capturing three-dimensional image data is achieved by an array of micro lenses placed in front of a traditional image sensor. The acquired light field data allows for the reconstruction of photographs focused at different depths. Given the plenoptic camera parameters, the metric distance of refocused objects may be retrieved with the aid of geometric ray tracing. Until now there was a lack of experimental results using real image data to prove this conceptual solution. With this paper, the very first experimental work is presented on the basis of a new ray tracing model approach, which considers more accurate micro image centre positions. To evaluate the developed method, the blur metric of objects in a refocused image stack is measured and compared with proposed predictions. The results suggest quite an accurate approximation for distant objects and deviations for objects closer to the camera device

Applications systems verification and transfer project. Volume 4: Operational applications of satellite snow cover observations. Colorado Field Test Center

The study was conducted on six watersheds ranging in size from 277 km to 3460 km in the Rio Grande and Arkansas River basins of southwestern Colorado. Six years of satellite data in the period 1973-78 were analyzed and snowcover maps prepared for all available image dates. Seven snowmapping techniques were explored; the photointerpretative method was selected as the most accurate. Three schemes to forecast snowmelt runoff employing satellite snowcover observations were investigated. They included a conceptual hydrologic model, a statistical model, and a graphical method. A reduction of 10% in the current average forecast error is estimated when snowcover data in snowmelt runoff forecasting is shown to be extremely promising. Inability to obtain repetitive coverage due to the 18 day cycle of LANDSAT, the occurrence of cloud cover and slow image delivery are obstacles to the immediate implementation of satellite derived snowcover in operational streamflow forecasting programs

On the automated interpretation and indexing of American football

This work combines natural language understanding and image processing with incremental learning to develop a system that can automatically interpret and index American Football. We have developed a model for representing spatio-temporal characteristics of multiple objects in dynamic scenes in this domain. Our representation combines expert knowledge, domain knowledge, spatial knowledge and temporal knowledge. We also present an incremental learning algorithm to improve the knowledge base as well as to keep previously developed concepts consistent with new data. The advantages of the incremental learning algorithm are that is that it does not split concepts and it generates a compact conceptual hierarchy which does not store instances

The Relationship between Social Responsibility and Business Performance: An Analysis of the Agri-Food Sector of Southeast Spain

This study aims to contribute to the existing debate on the impact of corporate social responsibility (CSR) orientation on different measures of business performance through the proposal of a conceptual model. Drawing on stakeholder theory, we conceptualize CSR as a broad and multidimensional construct with seven dimensions: employees, partners, customers, farmers, environment, community, and competition. We also extend the concept of business performance, which includes tangible variables, namely financial performance (FP) and export performance (EXP), as well as intangible variables, namely image and reputation (IR) and the satisfaction of relevant stakeholders (SS). The research context of this study is the agri-food sector in southeastern Spain. This sector has been the focus of attention of numerous researchers due to the relevance that social and environmental aspects have had in its development. To test the proposed model, the partial least-squares technique (PLS-SEM) was applied to data collected by means of a survey from a sample of 107 companies, which represent 81.4% of the turnover of the sector analyzed. The results show that CSR has a positive effect on financial performance, improves the volume and performance of exports, positively affects the corporate image and reputation, and increases the level of satisfaction of relevant stakeholders. Further research should examine the model from the perceptions of other stakeholders (e.g., customers, employees, and suppliers), using a longitudinal research design and exploring other contexts

What do you think this is? "Conceptual uncertainty" in geoscience interpretation

Interpretations of seismic images are used to analyze sub-surface geology and form the basis for many exploration and extraction decisions, but the uncertainty that arises from human bias in seismic data interpretation has not previously been quantified. All geological data sets are spatially limited and have limited resolution. Geoscientists who interpret such data sets must, therefore, rely upon their previous experience and apply a limited set of geological concepts. We have documented the range of interpretations to a single data set, and in doing so have quantified the �conceptual uncertainty� inherent in seismic interpretation. In this experiment, 412 interpretations of a synthetic seismic image were analyzed. Only 21% of the participants interpreted the �correct� tectonic setting of the original model, and only 23% highlighted the three main fault strands in the image. These results illustrate that conceptual uncertainty exists, which in turn explains the large range of interpretations that can result from a single data set. We consider the role of prior knowledge in biasing individuals in their interpretation of the synthetic seismic section, and our results demonstrate that conceptual uncertainty has a critical influence on resource exploration and other areas of geoscience. Practices should be developed to minimize the effects of conceptual uncertainty, and it should be accounted for in risk analysis

Multi modal multi-semantic image retrieval

PhDThe rapid growth in the volume of visual information, e.g. image, and video can overwhelm users’ ability to find and access the specific visual information of interest to them. In recent years, ontology knowledge-based (KB) image information retrieval techniques have been adopted into in order to attempt to extract knowledge from these images, enhancing the retrieval performance. A KB framework is presented to promote semi-automatic annotation and semantic image retrieval using multimodal cues (visual features and text captions). In addition, a hierarchical structure for the KB allows metadata to be shared that supports multi-semantics (polysemy) for concepts. The framework builds up an effective knowledge base pertaining to a domain specific image collection, e.g. sports, and is able to disambiguate and assign high level semantics to ‘unannotated’ images. Local feature analysis of visual content, namely using Scale Invariant Feature Transform (SIFT) descriptors, have been deployed in the ‘Bag of Visual Words’ model (BVW) as an effective method to represent visual content information and to enhance its classification and retrieval. Local features are more useful than global features, e.g. colour, shape or texture, as they are invariant to image scale, orientation and camera angle. An innovative approach is proposed for the representation, annotation and retrieval of visual content using a hybrid technique based upon the use of an unstructured visual word and upon a (structured) hierarchical ontology KB model. The structural model facilitates the disambiguation of unstructured visual words and a more effective classification of visual content, compared to a vector space model, through exploiting local conceptual structures and their relationships. The key contributions of this framework in using local features for image representation include: first, a method to generate visual words using the semantic local adaptive clustering (SLAC) algorithm which takes term weight and spatial locations of keypoints into account. Consequently, the semantic information is preserved. Second a technique is used to detect the domain specific ‘non-informative visual words’ which are ineffective at representing the content of visual data and degrade its categorisation ability. Third, a method to combine an ontology model with xi a visual word model to resolve synonym (visual heterogeneity) and polysemy problems, is proposed. The experimental results show that this approach can discover semantically meaningful visual content descriptions and recognise specific events, e.g., sports events, depicted in images efficiently. Since discovering the semantics of an image is an extremely challenging problem, one promising approach to enhance visual content interpretation is to use any associated textual information that accompanies an image, as a cue to predict the meaning of an image, by transforming this textual information into a structured annotation for an image e.g. using XML, RDF, OWL or MPEG-7. Although, text and image are distinct types of information representation and modality, there are some strong, invariant, implicit, connections between images and any accompanying text information. Semantic analysis of image captions can be used by image retrieval systems to retrieve selected images more precisely. To do this, a Natural Language Processing (NLP) is exploited firstly in order to extract concepts from image captions. Next, an ontology-based knowledge model is deployed in order to resolve natural language ambiguities. To deal with the accompanying text information, two methods to extract knowledge from textual information have been proposed. First, metadata can be extracted automatically from text captions and restructured with respect to a semantic model. Second, the use of LSI in relation to a domain-specific ontology-based knowledge model enables the combined framework to tolerate ambiguities and variations (incompleteness) of metadata. The use of the ontology-based knowledge model allows the system to find indirectly relevant concepts in image captions and thus leverage these to represent the semantics of images at a higher level. Experimental results show that the proposed framework significantly enhances image retrieval and leads to narrowing of the semantic gap between lower level machinederived and higher level human-understandable conceptualisation