An Information Retrieval Approach for Automatically Constructing Software Libraries

Although software reuse presents clear advantages for programmer productivity and code reliability, it is not practiced enough. One of the reasons for the only moderate success of reuse is the lack of software libraries that facilitate the actual locating and understanding of reusable components. This paper describes a technology for automatically assembling large software libraries which promote software reuse by helping the user locate the components closest to her/his needs. Software libraries are automatically assembled from a set of unorganized components by using information retrieval techniques. The construction of the library is done in two steps. First, attributes are automatically extracted from natural language documentation by using a new indexing scheme based on the notions of lexical affinities and quantity of information. Then a hierarchy for browsing is automatically generated using a clustering technique which draws only on the information provided by the attributes. Thanks to the free-text indexing scheme, tools following this approach can accept free-style natural language queries. This technology has been implemented in the GURU system, which has been applied to construct an organized library of AIX utilities. An experiment was conducted in order to evaluate the retrieval effectiveness of GURU as compared to INFOEXPLORER a hypertext library system for AIX 3 on the IBM RISC System/6000 series. We followed the usual evaluation procedure used in information retrieval, based upon recall and precision measures, and determined that our system performs 15% better on a random test set, while being much less expensive to build than INFOEXPLORER

Automation and hypermedia technology applications

This paper represents a progress report on HyLite (Hypermedia Library technology): a research and development activity to produce a versatile system as part of NASA's technology thrusts in automation, information sciences, and communications. HyLite can be used as a system or tool to facilitate the creation and maintenance of large distributed electronic libraries. The contents of such a library may be software components, hardware parts or designs, scientific data sets or databases, configuration management information, etc. Proliferation of computer use has made the diversity and quantity of information too large for any single user to sort, process, and utilize effectively. In response to this information deluge, we have created HyLite to enable the user to process relevant information into a more efficient organization for presentation, retrieval, and readability. To accomplish this end, we have incorporated various AI techniques into the HyLite hypermedia engine to facilitate parameters and properties of the system. The proposed techniques include intelligent searching tools for the libraries, intelligent retrievals, and navigational assistance based on user histories. HyLite itself is based on an earlier project, the Encyclopedia of Software Components (ESC) which used hypermedia to facilitate and encourage software reuse

Component-based software engineering

To solve the problems coming with the current software development methodologies, component-based software engineering has caught many researchers\u27 attention recently. In component-based software engineering, a software system is considered as a set of software components assembled together instead of as a set of functions from the traditional perspective. Software components can be bought from third party vendors as off-the-shelf components and be assembled together. Component-based software engineering, though very promising, needs to solve several core issues before it becomes a mature software development strategy. The goal of this dissertation is to establish an infrastructure for component-based software development. The author identifies and studies some of the core issues such as component planning, component building, component assembling, component representation, and component retrieval. A software development process model is developed in this dissertation to emphasize the reuse of existing software components. The software development process model addresses how a software system should be planned and built to maximize the reuse of software components. It conducts domain engineering and application engineering simultaneously to map a software system to a set of existing components in such a way that the development of a software system can reuse the existing software components to the full extent. Besides the planning of software development based on component technology, the migration and integration of legacy systems, most of which are non-component-based systems, to the component-based software systems are studied. A framework and several methodologies are developed to serve as the guidelines of adopting component technology in legacy systems. Component retrieval is also studied in this dissertation. One of the most important issues in component-based software engineering is how to find a software component quickly and accurately in a component repository. A component representation framework is developed in this dissertation to represent software components. Based on the component representation framework, an efficient searching method that combines neural network, information retrieval, and Bayesian inference technology is developed. Finally a prototype component retrieval system is implemented to demonstrate the correctness and feasibility of the proposed method

Automated reuseable components system study results

The Automated Reusable Components System (ARCS) was developed under a Phase 1 Small Business Innovative Research (SBIR) contract for the U.S. Army CECOM. The objectives of the ARCS program were: (1) to investigate issues associated with automated reuse of software components, identify alternative approaches, and select promising technologies, and (2) to develop tools that support component classification and retrieval. The approach followed was to research emerging techniques and experimental applications associated with reusable software libraries, to investigate the more mature information retrieval technologies for applicability, and to investigate the applicability of specialized technologies to improve the effectiveness of a reusable component library. Various classification schemes and retrieval techniques were identified and evaluated for potential application in an automated library system for reusable components. Strategies for library organization and management, component submittal and storage, and component search and retrieval were developed. A prototype ARCS was built to demonstrate the feasibility of automating the reuse process. The prototype was created using a subset of the classification and retrieval techniques that were investigated. The demonstration system was exercised and evaluated using reusable Ada components selected from the public domain. A requirements specification for a production-quality ARCS was also developed

Making navigation easier in object-oriented programming systems

It has been reported that non-expert users have difficulties in finding reusable software components in large object-oriented programming systems and there is a need for help tools. The research reported in this thesis addresses this issue. Described in this thesis is the design of a tool called BRRR, which aims to help non-expert users overcome such difficulties. It is developed for Smalltalk-80, the target system of this research.BRRR is a query tool with a browsing capacity. It allows users to find necessary components by query. Its design is based on the 'retrieval by reformulation' paradigm (Williams, 1984) which was originally used in the domain of information retrieval. This paradigm allows users to incrementally specify a query by reformulation. When users specify an initial query, BRRR presents the users with an example component which satisfies the query. The users can then construct further queries by using the information presented by the system. In this way, users who are not familiar with the system or who do not know exactly what they want can be guided towards the appropriate information.During this research, two versions of BRRR were developed: BRRRl and BRRR2. BRRRl was developed initially, based on the 'retrieval by reformulation' principle. After its implementation, a formative, empirical evaluation was conducted on it with a group of users. Based on the findings of the evaluation, BRRR2, an improved version of BRRR1 was developed. BRRR2 incorporates enhanced classification methods and explanation facilities. This new version of the tool was then evaluated empirically with a group of ten users.The empirical evaluation of BRRR2 showed encouraging results. It demonstrates that the 'retrieval by reformulation' approach used in this research could be used successfully in helping users find reusable software components in object-oriented programming systems

Software library for reuse-oriented program development.

Distributed system or reuse-oriented program development system may call for software reuse library (SRL, repository) to serve as a resource provider by the usage of reusable software components. We are trying to solve the problems of storing and classifying, locating/retrieving, and delivering the large number of software components through the SRL in an effective way. In this thesis we report on the design and construction of a prototype software system, DORLM (Distributed Object-based Software Reuse Library Module), used to investigate the integration of DBMS (database management system), IRS (information retrieval system), NLP (natural language process) and CORBA (Common Object Request Broker Architecture) for software reuse and reuse-oriented program development in a distributed computing context. The DORLM provides an effective way to store, retrieve, and deliver reusable software components as an aid of reuse-oriented program development in the distributed environment. Source: Masters Abstracts International, Volume: 40-03, page: 0730. Adviser: R. Kent. Thesis (M.Sc.)--University of Windsor (Canada), 2000

Design of Theoretical Framework: Global and Local Parameters Requirements for Libraries

Library is one of the important aspect in modern reading environment. Theoretical framework is an inevitable and indispensable for each and every library in the field of automated and digital library system. In this original research paper all the parameters have selected on the basis of global recommendations and local requirements for libraries in six theoretical sections. Designing the theoretical framework in the following areas such as (i) Theoretical framework of integrated library system cluster (ii) Theoretical framework of community communication and interaction (iii) Theoretical framework of digital media archiving cluster (iv) Theoretical framework of content management system (v) Theoretical framework of learning content management system (vi) Theoretical framework of federated search system. Integrated library system cluster two things are more important development of ILS and open source ILS software. On the other hand it also crafted the requirement of parameters selection and it can be developed in three ways such as basic parameters settings, theoretical framework for housekeeping operations, and theoretical framework for information retrieval system. Software selection and parameter selection is also an pivotal tasks in the field or theoretical framework of community communication and interaction. Theoretical framework of digital media archiving cluster can be developed in three sections such as selection of software, selection of standards, and metadata selection for all the libraries. Content management system can be developed in three ways such as workflow of content management system, software selection in CMS cluster, and parameters selection in CMS cluster. Development of theoretical framework of learning content management system for libraries in three sections such as Components of Learning Content Management System , Software selection in LCMS cluster, and Parameters selection in LCMS cluster. Software selection and parameters selection is also an important components in the federated search system theoretical framework for the development of single window based interface

Information Analysis Support for Decision-Making in Scientific and Technological Development

This paper presents the development of an information and analytical system to foster scientific and technological development in a given scientific field. In this work, the main software tools for implementing distributed computing, which involves a set of software components for collecting, processing, and analyzing large amounts of data, are considered. In addition, various approaches for task coordination between different sets of software are discussed and techniques for storing large amounts of data are described. The system architecture and database schema are designed and tested. Nowadays, the intellectualization of individual software agents is a key aspect of a new generation of multiagent systems. For this reason, this paper develops an approach that can organize activities of a large number of software agents to increase system intellectualization through swarm intelligence at the level of individual agents. Three remote servers were used to build and test the system deployment, comprising such components as a platform for monitoring and scheduling workflow, data storage, and a graphical user interface that enables data retrieval and interaction on the Internet

QCS: a system for querying, clustering and summarizing documents.

Information retrieval systems consist of many complicated components. Research and development of such systems is often hampered by the difficulty in evaluating how each particular component would behave across multiple systems. We present a novel hybrid information retrieval system--the Query, Cluster, Summarize (QCS) system--which is portable, modular, and permits experimentation with different instantiations of each of the constituent text analysis components. Most importantly, the combination of the three types of components in the QCS design improves retrievals by providing users more focused information organized by topic. We demonstrate the improved performance by a series of experiments using standard test sets from the Document Understanding Conferences (DUC) along with the best known automatic metric for summarization system evaluation, ROUGE. Although the DUC data and evaluations were originally designed to test multidocument summarization, we developed a framework to extend it to the task of evaluation for each of the three components: query, clustering, and summarization. Under this framework, we then demonstrate that the QCS system (end-to-end) achieves performance as good as or better than the best summarization engines. Given a query, QCS retrieves relevant documents, separates the retrieved documents into topic clusters, and creates a single summary for each cluster. In the current implementation, Latent Semantic Indexing is used for retrieval, generalized spherical k-means is used for the document clustering, and a method coupling sentence 'trimming', and a hidden Markov model, followed by a pivoted QR decomposition, is used to create a single extract summary for each cluster. The user interface is designed to provide access to detailed information in a compact and useful format. Our system demonstrates the feasibility of assembling an effective IR system from existing software libraries, the usefulness of the modularity of the design, and the value of this particular combination of modules