Development and Evaluation of an Adaptive Hypermedia System Based on Multiple Student Characteristics

Adaptive Educational Hypermedia systems (AEH) are amongst the most recent types of application to provide individualised instruction to students who undertake online courses. Such systems attempt to adapt to how individuals learn by personalizing instruction for each individual student depending upon one or more “characteristics” of the student. Prior knowledge and learning style have been identified as being prominent characteristics in this process but AEH systems implemented to date have generally been limited to only employing one of these characteristics. Such systems have also been limited in that they are specific to a particular course content and cannot be easily adapted to present different learning materials. This thesis describes the development and evaluation of a new AEH system that provides a generic template for different learning materials as well as a student model that incorporates five distinct student characteristics as an aid to learning: primary characteristics are prior knowledge, learning style and the presence or absence of animated multimedia aids (multimedia mode); secondary characteristics include page background preference and link colour preference. The use of multimedia artefacts as a student characteristic (and hence as an independent variable in this study) has not previously been implemented or evaluated. A separate non-AEH system, identical to the AEH system except for the absence of adaptation to individuals, was developed in parallel as a control. The system development consists of a requirements analysis, design and implementation. The design models including use case diagrams, conceptual design, sequence diagrams, navigation design and presentation design are expressed using Unified Modelling Language (UML). The AEH system which was developed in a generic template implemented using Java Servlets, XHTML, XML, JavaScript and HTML. The generic template is a domain-independent AEH system that has functions of both adaptivity and adaptability. The system was evaluated in an experimental research involving 67 undergraduate engineering students in the Department of Electronics at Yogyakarta State University. The learning material of Analogue Electronics was implemented into both the AEH system and non-AEH systems under seven chapter headings. The participants were randomly divided into an experimental group and a control group. During the 9 weeks of experimentation, the students studied the learning material in two randomly allocated groups, an experimental group using the AEH system and a control group using the non-AEH system. A pre-test was administered to measure initial student knowledge. The student achievement was measured at the end of each chapter of material using a chapter test and at the end of the experimentation as a whole using a post-test. Basic statistical analysis of t-test and Mann-Whitney U were conducted to investigate any difference of student achievement between the two groups. A further detailed analysis using multilevel modelling was conducted to investigate any possible effects of the adaptive parameters on the student achievement. A total of 7 hypotheses were tested during data analysis. Research findings are described as follows. Students who learned using the AEH system performed better significantly than those who learned using the NON-AEH system. The implementation of test repetition as a function of knowledge adaptation in the AEH system increased student achievement significantly. This was found to be the prominent effect. When the effect of test repetition was removed, the implementation of learning style and multimedia mode adaptation in the AEH system was still found to have significant effect upon student performance. Students whose learning style and multimedia preferences were matched with the system (AEH or non-AEH) achieved better results. In terms of the relative merit of each contributing factor toward a student’s achievement, the order of the effects was found to be (1) knowledge, (2) multimedia, and (3) learning style. Whilst repeated knowledge testing is an established cause of improved performance, the positive effects on student performance of using multimedia artefacts over choice of learning style is a new finding

PoN-S : a systematic approach for applying the Physics of Notation (PoN)

Visual Modeling Languages (VMLs) are important instruments of communication between modelers and stakeholders. Thus, it is important to provide guidelines for designing VMLs. The most widespread approach for analyzing and designing concrete syntaxes for VMLs is the so-called Physics of Notation (PoN). PoN has been successfully applied in the analysis of several VMLs. However, despite its popularity, the application of PoN principles for designing VMLs has been limited. This paper presents a systematic approach for applying PoN in the design of the concrete syntax of VMLs. We propose here a design process establishing activities to be performed, their connection to PoN principles, as well as criteria for grouping PoN principles that guide this process. Moreover, we present a case study in which a visual notation for representing Ontology Pattern Languages is designed

Geodesign in Pampulha cultural and heritage urban area: Visualization tools to orchestrate urban growth and dynamic transformations

This paper discusses the role of visualization in Geodesign methodology consideringits applications in the case study of the region of Pampulha in Belo Horizonte,Minas Gerais, Brazil. In order to consider the opinion of the participants, their effortswere recorded in different steps of the process, at different stages of Geodesign iterations,and different possibilities of visualization were tested. The methodology of Geodesignwas applied in different applications and with different tools. The goal was to determinewhether different techniques and tools used in the process of Geodesign contributed toimproved understanding of data and problem context, and to derive guidelines for improvedGeodesign techniques and tools

Influencing interaction: Development of the design with intent method

Persuasive Technology has the potential to influence user behavior for social benefit, e.g. to reduce environmental impact, but designers are lacking guidance choosing among design techniques for influencing interaction. The Design with Intent Method, a ‘suggestion tool’ addressing this problem, is introduced in this paper, and applied to the briefs of reducing unnecessary household lighting use, and improving the efficiency of printing, primarily to evaluate the method’s usability and guide the direction of its development. The trial demonstrates that the DwI Method is quick to apply and leads to a range of relevant design concepts. With development, the DwI Method could be a useful tool for designers working on influencing user behavior

Complexity Metrics for Systems Development Methods and Techniques

So many systems development methods have been introduced in the last decade that one can talk about a ¿methodology jungle¿. To aid the method developers and evaluators in fighting their way through this jungle, we propose a systematic approach for measuring properties of methods. We describe two sets of metrics which measure the complexity of single diagram techniques, and of complete systems development methods. The proposed metrics provide a relatively fast and simple way to analyse the descriptive capabilities of a technique or method. When accompanied with other selection criteria, the metrics can be used for estimating the relative complexity of a technique compared to others. To demonstrate the applicability of the metrics, we have applied them to 36 techniques and 11 methods

Identifying key Effective Lifelong Learning Inventory (ELLI) dimensions associated with academic success amongst postgraduate medical students

Many elements have been identified as contributors of academic success amongst medical students but to group these components in order to develop guidelines for intervention strategies is atypical. One such tool which could allow this possibility is the Effective Lifelong Learning Inventory (ELLI) developed by the University of Bristol. ELLI is an online self-assessment instrument which identifies and measures the dimensions of learner development. It comprises of 90 key questions used to measure the seven dimensions of learning power: changing and learning; meaning making; critical curiosity; creativity; learning relationships; strategic awareness and resilience. This study used ELLI to explore learning dimensions as potential drivers for academic success. A small cohort of thirty-three first year postgraduate medical students consented and completed the first ELLI before starting formal classes. Only eighteen of these completed it a second time, 45 days later. The data from the ELLI questionnaires were analysed both for the whole cohort and separately for each academic performance group (defined using grade point averages). The results showed that the students obtained the highest scores for the meaning making or changing and learning dimensions, and the lowest scores for creativity or resilience. After a period of postgraduate study, only the successful students displayed significant improvements in the mean ELLI scores, with increases for all ELLI dimensions apart from resilience. Those who were less successful made declines in more than one dimension. It was concluded that ELLI is an effective instrument for identifying key learning dispositions and it is proposed that an intervention could be developed in the future to improve academic achievement