Feature Extraction and Duplicate Detection for Text Mining: A Survey

Text mining, also known as Intelligent Text Analysis is an important research area. It is very difficult to focus on the most appropriate information due to the high dimensionality of data. Feature Extraction is one of the important techniques in data reduction to discover the most important features. Proce- ssing massive amount of data stored in a unstructured form is a challenging task. Several pre-processing methods and algo- rithms are needed to extract useful features from huge amount of data. The survey covers different text summarization, classi- fication, clustering methods to discover useful features and also discovering query facets which are multiple groups of words or phrases that explain and summarize the content covered by a query thereby reducing time taken by the user. Dealing with collection of text documents, it is also very important to filter out duplicate data. Once duplicates are deleted, it is recommended to replace the removed duplicates. Hence we also review the literature on duplicate detection and data fusion (remove and replace duplicates).The survey provides existing text mining techniques to extract relevant features, detect duplicates and to replace the duplicate data to get fine grained knowledge to the user

Feature extraction and duplicate detection for text mining: A survey

Text mining, also known as Intelligent Text Analysis is an important research area. It is very difficult to focus on the most appropriate information due to the high dimensionality of data. Feature Extraction is one of the important techniques in data reduction to discover the most important features. Proce- ssing massive amount of data stored in a unstructured form is a challenging task. Several pre-processing methods and algo- rithms are needed to extract useful features from huge amount of data. The survey covers different text summarization, classi- fication, clustering methods to discover useful features and also discovering query facets which are multiple groups of words or phrases that explain and summarize the content covered by a query thereby reducing time taken by the user

Physical, social and intellectual landscapes in the Neolithic: contextualizing Scottish and Irish Megalithic architecture

The broad aim of this study is to examine the way in which people build worlds which are liveable and which make sense; to explore the means by which a social, intellectual order particular to time and place is embedded within the material universe. The phenomenon of monumentality is considered in the context of changing narratives of place and biographies of person and landscape, which are implicated in the making of the self and society and the perception of being in place. Three groups of megalithic mortuary monuments of quite different formal characteristics, constructed and used predominantly during the fourth and third millennia BC, are analyzed in detail within their landscape setting: a series of Clyde tombs on the Isle of Arran in southwest Scotland; a group of cairns in the Black Isle of peninsula in the northeast of the country, which belong primarily to the Orkney-Cromarty tradition; and a passage tomb complex situated in east-central Ireland, among the Loughcrew hills. Individual studies are presented for each of these distinct and diverse landscapes, which consider the ways in which natural and built form interact through the medium of the human body, how megalithic architecture operated as part of local strategies for creating a workable scheme to 'place' humanity in relation to a wider cosmos, and how the interrelation of physical, social and intellectual landscapes may have engendered particular understandings of the world. An attempt is made to write regionalized, localized neolithics which challenge some of the traditional frameworks of the discipline - in particular those concerned with morphological, chronological and economic classification - and modes of representation which, removing subject and monument from a specific material context, establish a spurious objectivity. (DXN 006, 349)

Spatial Aspects of Metaphors for Information: Implications for Polycentric System Design

This dissertation presents three innovations that suggest an alternative approach to structuring information systems: a multidimensional heuristic workspace, a resonance metaphor for information, and a question-centered approach to structuring information relations. Motivated by the need for space to establish a question-centered learning environment, a heuristic workspace has been designed. Both the question-centered approach to information system design and the workspace have been conceived with the resonance metaphor in mind. This research stemmed from a set of questions aimed at learning how spatial concepts and related factors including geography may play a role in information sharing and public information access. In early stages of this work these concepts and relationships were explored through qualitative analysis of interviews centered on local small group and community users of geospatial data. Evaluation of the interviews led to the conclusion that spatial concepts are pervasive in our language, and they apply equally to phenomena that would be considered physical and geographic as they do to cognitive and social domains. Rather than deriving metaphorically from the physical world to the human, spatial concepts are native to all dimensions of human life. This revised view of the metaphors of space was accompanied by a critical evaluation of the prevailing metaphors for information processes, the conduit and pathway metaphors, which led to the emergence of an alternative, resonance metaphor. Whereas the dominant metaphors emphasized information as object and the movement of objects and people through networks and other limitless information spaces, the resonance metaphor suggests the existence of multiple centers in dynamic proximity relationships. This pointed toward the creation of a space for autonomous problem solving that might be related to other spaces through proximity relationships. It is suggested that a spatial approach involving discrete, discontinuous structures may serve as an alternative to approaches involving movement and transportation. The federation of multiple autonomous problem-solving spaces, toward goals such as establishing communities of questioners, has become an objective of this work. Future work will aim at accomplishing this federation, most likely by means of the IS0 Topic Maps standard or similar semantic networking strategies

Active Perception for Autonomous Systems : In a Deep Space Navigation Scenario

Autonomous systems typically pursue certain goals for an extended amount of time in a self-sustainable fashion. To this end, they are equipped with a set of sensors and actuators to perceive certain aspects of the world and thereupon manipulate it in accordance with some given goals. This kind of interaction can be thought of as a closed loop in which a perceive-reason-act process takes place. The bi-directional interface between an autonomous system and the outer world is then given by a sequence of imperfect observations of the world and corresponding controls which are as well imperfectly actuated. To be able to reason in such a setting, it is customary for an autonomous system to maintain a probabilistic state estimate. The quality of the estimate -- or its uncertainty -- is, in turn, dependent on the information acquired within the perceive-reason-act loop described above. Hence, this thesis strives to investigate the question of how to actively steer such a process in order to maximize the quality of the state estimate. The question will be approached by introducing different probabilistic state estimation schemes jointly working on a manifold-based encapsuled state representation. On top of the resultant state estimate different active perception approaches are introduced, which determine optimal actions with respect to uncertainty minimization. The informational value of the particular actions is given by the expected impact of measurements on the uncertainty. The latter can be obtained by different direct and indirect measures, which will be introduced and discussed. The active perception schemes for autonomous systems will be investigated with a focus on two specific deep space navigation scenarios deduced from a potential mining mission to the main asteroid belt. In the first scenario, active perception strategies are proposed, which foster the correctional value of the sensor information acquired within a heliocentric navigation approach. Here, the expected impact of measurements is directly estimated, thus omitting counterfactual updates of the state based on hypothetical actions. Numerical evaluations of this scenario show that active perception is beneficial, i.e., the quality of the state estimate is increased. In addition, it is shown that the more uncertain a state estimate is, the more the value of active perception increases. In the second scenario, active autonomous deep space navigation in the vicinity of asteroids is investigated. A trajectory and a map are jointly estimated by a Graph SLAM algorithm based on measurements of a 3D Flash-LiDAR. The active perception strategy seeks to trade-off the exploration of the asteroid against the localization performance. To this end, trajectories are generated as well as evaluated in a novel twofold approach specifically tailored to the scenario. Finally, the position uncertainty can be extracted from the graph structure and subsequently be used to dynamically control the trade-off between localization and exploration. In a numerical evaluation, it is shown that the localization performance of the Graph SLAM approach to navigation in the vicinity of asteroids is generally high. Furthermore, the active perception strategy is able to trade-off between localization performance and the degree of exploration of the asteroid. Finally, when the latter process is dynamically controlled, based on the current localization uncertainty, a joint improvement of localization as well as exploration performance can be achieved. In addition, this thesis comprises an excursion into active sensorimotor object recognition. A sensorimotor feature is derived from biological principles of the human perceptual system. This feature is then employed in different probabilistic classification schemes. Furthermore, it enables the implementation of an active perception strategy, which can be thought of as a feature selection process in a classification scheme. It is shown that those strategies might be driven by top-down factors, i.e., based on previously learned information, or by bottom-up factors, i.e., based on saliency detected in the currently considered data. Evaluations are conducted based on real data acquired by a camera mounted on a robotic arm as well as on datasets. It is shown that the integrated representation of perception and action fosters classification performance and that the application of an active perception strategy accelerates the classification process

Earth resources: A continuing bibliography with indexes (issue 61)

This bibliography lists 606 reports, articles, and other documents introduced into the NASA scientific and technical information system between January 1 and March 31, 1989. Emphasis is placed on the use of remote sensing and geophysical instrumentation in spacecraft and aircraft to survey and inventory natural resources and urban areas. Subject matter is grouped according to agriculture and forestry, environmental changes and cultural resources, geodesy and cartography, geology and mineral resources, oceanography and marine resources, hydrology and water management, data processing and distribution systems, and instrumentation and sensors, and economic analysis

Semiannual review of research and advanced development, 1 January - 30 June 1969. Volume 2 - /OART/

Supporting research and technology on spacecraft propulsion and electronic system

Earth resources: A continuing bibliography with indexes (issue 58)

This bibliography lists 500 reports, articles, and other documents introduced into the NASA scientific and technical information system between April 1 and June 30, 1988. Emphasis is placed on the use of remote sensing and geophysical instrumentation in spacecraft and aircraft to survey and inventory natural resources and urban areas. Subject matter is grouped according to agriculture and forestry, environmental changes and cultural resources, geodesy and cartography, geology and mineral resources, hydrology and water management, data processing and distribution systems, instrumentation and sensors, and economic analysis