Image retrieval by hypertext links

This paper presents a model for retrieval of images from a large World Wide Web based collection. Rather than considering complex visual recognition algorithms, the model presented is based on combining evidence of the text content and hypertext structure of the Web. The paper shows that certain types of query are amply served by this form of representation. It also presents a novel means of gathering relevance judgements

Browsing while reading: effects of instructional design and learners' prior knowledge

One of the key reasons that multimedia, and particularly hypertext systems, are gaining in importance is that they inspire hopes of optimizing learners' processes of knowledge construction. The present study is concerned with the respective influence of individual learner variables (i.e. particularly domain‐specific prior knowledge) on the use of different design attributes. Thirty‐six university students worked through a hierarchically structured two‐part hypertext about the psychology of memory under two experimental browsing conditions (reduced versus free browsing). Results show that deeper‐level comprehension (i.e. structural knowledge) was predicted by the interaction of experimental condition and prior knowledge, but that simply retaining facts was not. Participants with low prior knowledge performed better on the comprehension test if they had worked on the version with reduced access. Moreover, the version with reduced access helped to reduce feelings of disorientation. The measure of disorientation also appeared to be closely linked with the individual's computer experience, self‐concept of computer ability and subject‐related interest. The main implications for educational practice relate to the design of an adaptive multimedia and hypertext learning system and the successful learning with it

Effects of hyperlinks on navigation in virtual environments

Hyperlinks introduce discontinuities of movement to 3-D virtual environments (VEs). Nine independent attributes of hyperlinks are defined and their likely effects on navigation in VEs are discussed. Four experiments are described in which participants repeatedly navigated VEs that were either conventional (i.e. obeyed the laws of Euclidean space), or contained hyperlinks. Participants learned spatial knowledge slowly in both types of environment, echoing the findings of previous studies that used conventional VEs. The detrimental effects on participants' spatial knowledge of using hyperlinks for movement were reduced when a time-delay was introduced, but participants still developed less accurate knowledge than they did in the conventional VEs. Visual continuity had a greater influence on participants' rate of learning than continuity of movement, and participants were able to exploit hyperlinks that connected together disparate regions of a VE to reduce travel time

Generating trails automatically, to aid navigation when you revisit an environment

A new method for generating trails from a person’s movement through a virtual environment (VE) is described. The method is entirely automatic (no user input is needed), and uses string-matching to identify similar sequences of movement and derive the person’s primary trail. The method was evaluated in a virtual building, and generated trails that substantially reduced the distance participants traveled when they searched for target objects in the building 5-8 weeks after a set of familiarization sessions. Only a modest amount of data (typically five traversals of the building) was required to generate trails that were both effective and stable, and the method was not affected by the order in which objects were visited. The trail generation method models an environment as a graph and, therefore, may be applied to aiding navigation in the real world and information spaces, as well as VEs

Quo vadimus? The 21st Century and multimedia

The concept is related of computer driven multimedia to the NASA Scientific and Technical Information Program (STIP). Multimedia is defined here as computer integration and output of text, animation, audio, video, and graphics. Multimedia is the stage of computer based information that allows access to experience. The concepts are also drawn in of hypermedia, intermedia, interactive multimedia, hypertext, imaging, cyberspace, and virtual reality. Examples of these technology developments are given for NASA, private industry, and academia. Examples of concurrent technology developments and implementations are given to show how these technologies, along with multimedia, have put us at the threshold of the 21st century. The STI Program sees multimedia as an opportunity for revolutionizing the way STI is managed

An Exploratory Study of Hypermedia Support for Problem Decomposition

Empirical hypermedia research has concentrated on usability rather than utility, and the research on utility has focused on information access as opposed to problem solving and decision making in organizations. This study, based on problem reduction theory, uses a hypermedia prototype system to support decision processes for solving a financial analysis problem. An exploratory laboratory experiment was conducted to study the feasibility of the prototype for hypermedia support of decision making. The process tracing techniques used suggest that a cognitive map of a decision maker\u27s thought process may be constructed. Results offer a great deal of promise in the use of hypermedia for organizational decision support. The implications of this study for further research are discussed

Hypermedia-based discovery for source selection using low-cost linked data interfaces

Evaluating federated Linked Data queries requires consulting multiple sources on the Web. Before a client can execute queries, it must discover data sources, and determine which ones are relevant. Federated query execution research focuses on the actual execution, while data source discovery is often marginally discussed-even though it has a strong impact on selecting sources that contribute to the query results. Therefore, the authors introduce a discovery approach for Linked Data interfaces based on hypermedia links and controls, and apply it to federated query execution with Triple Pattern Fragments. In addition, the authors identify quantitative metrics to evaluate this discovery approach. This article describes generic evaluation measures and results for their concrete approach. With low-cost data summaries as seed, interfaces to eight large real-world datasets can discover each other within 7 minutes. Hypermedia-based client-side querying shows a promising gain of up to 50% in execution time, but demands algorithms that visit a higher number of interfaces to improve result completeness

Multimedia Information Retrieval

With recent advances in screen and mass storage technology, together with the on-going advances in computer power, many users of personal computers and low end workstations are now regularly manipulating non-textual information. This information may be in the form of drawings, graphs, animations, sound, or video (for example). With the increased usage of these media on computer systems there has not, however, been much work in the provision of access methods to non-textual computer based information. An increasingly common method for accessing large document bases of textual information is free text retrieval. In such systems users typically enter natural language queries. These are then matched against the textual documents in the system. It is often possible for the user to re-formulate a query by providing relevance feedback, this usually takes the form of the user informing the system that certain documents are indeed relevant to the current search. This information, together with the original query, is then used by the retrieval engine to provide an improved list of matched documents. Although free text retrieval provides reasonably effective access to large document bases it does not provide easy access to non-textual information. Various query based access methods to nontextual document bases are presented, but these are all restricted to specific domains and cannot be used in mixed media systems. Hypermedia, on the other hand, is an access method for document bases which is based on the user browsing through the document base rather than issuing queries. A set of interconnected paths are constructed through the base which the user may follow. Although providing poorer access to large document bases the browsing approach does provide very natural access to non-textual information. The recent explosion in hypermedia systems and discussion has been partly due to the requirement for access to mixed media document bases. Some work is reported which presents an integration of free text retrieval based queries with hypermedia. This provides a solution to the scaling problem of browsing based systems, these systems provide access to textual nodes by query or by browsing. Non-textual nodes are, however, still only accessible by browsing - either from the starting point of the document base or from a textual document which matched the query. A model of retrieval for non-textual documents is developed, this model is based on document's context within the hypermedia document base, as opposed to the document's content. If a non-textual document is connected to several textual documents, by paths in the hypermedia, then it is likely that the non-textual document will match the query whenever a high enough proportion of the textual documents match. This model of retrieval uses clustering techniques to calculate a descriptor for non-textual nodes so that they may be retrieved directly in response to a query. To establish that this model of retrieval for non-textual documents is worthwhile an experiment was run which used the text only CACM collection. Each record within the collection was initially treated as if it were non-textual and had a cluster based description calculated based on citations, this cluster based descriptor was then compared with the actual descriptor (calculated from the record's content) to establish how accurate the cluster descriptor was. As a base case the experiment was repeated using randomly created links, as opposed to citations. The results showed that for citation based links the cluster based descriptions had a mean correlating of 0.230 with the content based description (on a range from 0 to 1, where 1 represents a perfect match) and performed approximately six times better than when random links were used (mean random correlation was 0.037). This shows that citation based cluster descriptions of documents are significantly closer to the actual descriptions than random based links, and although the correlation is quite low, the cluster approach provides a useful technique for describing documents. The model of retrieval presented for non-textual documents relies upon a hypermedia structure existing in the document base, since the model cannot work if the documents are not linked together. A user interface to a document base which gives access to a retrieval engine and to hypermedia links can be based around three main categories: browsing only access, use the retrieval engine to support link creation; query only access, use links to provide access to non-text; query and browsing access Although the last user interface may initially appear most suitable for a document base which can support queries and browsing it is also potentially the most complex interface, and may require a more complex model of retrieval for users to successfully search the document base. A set of user tests were carried out to establish user behaviour and to consider interface issues concerning easy access to documents which are held on such document bases. These tests showed that, overall, no access method was clearly better or poorer than any other method. (Abstract shortened by ProQuest.)

Social video: A collaborative video annotation environment to support E-learning

Our social video system allows users to enrich video by additional information like external websites, hypertext, images, other videos, or communication channels. Users are able to annotate whole videos, scenes, and objects in the video. We do not focus on a single user accessing the system but on multiple users watching the video and accessing the annotations others have created. Our web-based prototype differs from classical hypervideo systems because it allows annotation (authoring) and navigation in videos by focusing on collaboration and communication between the users. The prototype is integrated into the online social network Facebook and was evaluated with more than 300 users. The evaluation analyzes the usage of the system with a learning scenario in mind and indicates a learning success of users

The evaluation of educational service integration in integrated virtual courses

The effectiveness of an integrated virtual course is determined by factors such as the navigability of the system. We argue that in a virtual course, which offers different educational services for different learning activities, the integration of services is a good indicator for the effectiveness of a virtual course infrastructure. We develop a set of metrics to measure the degree of integration of a virtual course. We combine structural metrics and an analysis of the student usage of the system in order to measure integration