Trajectories of engagement : a repeated cross-sectional investigation of student perceptions of an online learning environment

Evaluations of online learning environments (OLEs) often present a snapshot of system use. It has been identified in the literature that extended evaluation is required to reveal statistically significant developments in the evolution of system use over time. The research presented here draws on student OLE evaluations surveys run over the period 2004–2011 and include nearly 6800 responses exploring students’ perceptions of importance of, and satisfaction with elements of their OLE. Across the survey period, satisfaction ratings with all OLE elements rose significantly, suggesting a positive student engagement with the OLE over time. The corresponding ratings of importance of OLE elements generally rose significantly, though a number of elements registered no significant difference in the first two years of the survey, suggesting that short period surveys may struggle to reveal statistically significant trends. OLE element use appeared to be closely linked to perceived value. The OLE elements with the highest mean importance and satisfaction ratings related to student access of online learning resources. Other detailed results are also reported. We demonstrate a method for, and one large-scale case study of, quantifying and visualising the trajectories of engagement that students have had with an institutional OLE over time

Academic staff perceptions of the value of the elements of an online learning environment

Based on 276 responses from academic staff in an evaluation of an online learning environment (OLE), this paper identifies those elements of the OLE that were most used and valued by staff, those elements of the OLE that staff most wanted to see improved, and those factors that most contributed to staff perceptions that the use of the OLE enhanced their teaching. The most used and valued elements were core functions, including accessing unit information, accessing lecture/tutorial/lab notes, and reading online discussions. The elements identified as most needing attention related to online assessment: submitting assignments, managing assessment items, and receiving feedback on assignments. Staff felt that using the OLE enhanced their teaching when they were satisfied that their students were able to access and use their learning materials, and when they were satisfied with the professional development they received and were confident with their ability to teach with the OLE.<br /

Online discussion in engineering education : student responses and learning outcomes

A ubiquitous and widely used feature of online learning environments is the asynchronous discussion board. This chapter presents a case study of the introduction and evaluation of student use of an online discussion in an engineering management study unit. We introduced an assessable assignment task based on student use of an online discussion, in response to falling student unit evaluation results after we initially moved the unit to wholly online delivery mode. Both quantitative and qualitative unit evaluation data suggest that students perceive value in the online discussion activities. A regression analysis based on discussion usage data suggests that students derived significant learning outcome benefit toward their final unit grade from making reflective postings in the online discussion.<br /

Students\u27 perceptions of the value of the elements of an online learning environment : looking back in moving forward

In 2003, Deakin University implemented a centralised learning management system (LMS) under the banner of Deakin Studies Online (DSO), as well as implementing policies requiring all its units of study to have at least a basic online presence from 2004. Given the scope of the university\u27s commitment to online education, it was considered essential to evaluate the effectiveness of this investment. Based on more than 5400 responses obtained from students in 2004 and 2005 as part of the DSO evaluation survey, the analysis presented here identifies those elements of the online learning environment (OLE) that are most used and valued by students, those elements of the OLE that students most want to see improved, and, those factors that most contribute to students\u27 perceptions that use of the OLE enhanced their learning experience. The most used and valued elements were core LMS functions, including accessing unit information, accessing lecture/tute/lab notes, interacting with unit learning resources, reading online discussions, contacting lecturers/tutors and submitting assignments online. The OLE elements identified as most needing attention were receiving feedback on assignments; viewing my marks; and reviewing unit progress. Students felt that using DSO enhanced their learning experience when they were adequately supported by unit teachers and technical support services; when they were able to find and use unit information; and when they were able to read the online contributions of other unit members. The retrospective analysis of data collected in the period 2004-2005 has been shaped by a forward-looking agenda. The array of elements available within, and in association with, traditional LMSs which has emerged since that time raises the future challenge of how to maximise and evidence educational value through the optimal combination of elements from the portfolio of e-learning technologies increasingly available to educators. <br /

Staff and student perceptions of an online learning environment : difference and development

Academic staff play a fundamental role in the use of online learning by students. Yet, compared to studies reporting student perspectives on online learning, studies investigating the perspectives of academic staff are much more limited. Perhaps the least common investigations are those that compare the perceptions of academic staff and students using the same online learning environment (OLE). Much research indicates, at least initially, academic staff most value OLE systems as a mechanism for efficient delivery of learning materials to students. Following the mainstreaming of an OLE at Deakin University in 2004, the data from a large, repeated, representative and quantitative survey were analysed to investigate comparative staff and student evaluations of an OLE, and to explore the evidence for development in the use of an OLE by academic staff. Generally, students were found to give higher importance and satisfaction ratings to elements of the OLE than staff. Students were also more likely than staff to agree that the OLE enhanced their learning. A comparison of the mean ratings recorded for staff in 2004 and 2005 showed that both importance and satisfaction ratings of elements of the OLE were almost universally higher after a year of use of the OLE.<br /

Contemporary learning environments: designing e-learning for education in the professions

Designing e-learning environments for quality professional education is a challenge for education designers, as the continuing practice of simply moving courses online can be surprisingly disabling. We argue that as universities strive to educate for excellence in professional practice, design approaches for the e-learning components must be conceptualized in a broader view of a contemporary learning environment involving integrated virtual and physical dimensions. These are comprehensively considered in an integrated way to facilitate learning experiences providing an emphasis on grounded practice. Our paper considers learning environments in the service of a broader understanding of a professional &quot;practicum.&quot; In providing the more flexible, immediate and evolving virtual experiences, e-learning as a feature must take account of a range of education design considerations we model in a framework of elements. These are outlined, and broader issues are illuminated through a comparative case analysis of educational technology developments at Deakin University in the two professional fields of teaching and journalism. The Education Studies Online (ESO) project and the HOTcopy newsroom simulation project exemplify elements of the approach recommended in addressing the challenges of quality professional education. We highlight the generative role of the education designer in adopting an integrative and strategic stance, when creating such environments. Implications for the selection and use of various e-learning resources and corporate e-learning systems become evident as we highlight the dangers of a returning &quot;instructional industrialism&quot; as we risk allowing courses to &quot;move online&quot;, rather than moving towards proposed features of contemporary learning environments. <br /

Creating and sustaining quality e-learning environments of enduring value for teachers and learners

Australian universities continue staking a claim on the future of e-learning, acquiring Learning Management Systems (LMS) as rapidly as universities overseas. Much is published on processes and criteria for selecting the best LMS for an organisation\u27s needs and attempts to establish training and support mechanisms for deploying these systems. Beyond initial efforts to commission these technologies, particularly in the hands of teachers and students, what should happen to ensure these commitments yield real educational value in the long term? The search for and realisation of systemic and substantial new value requires a more profound reconceptualisation of what it means to design and work within contemporary learning environments, incorporating e-learning, in support of excellence in educational outcomes. This demands the foregrounding of the role of the academic teacher in the system in relation to other parties who can make important educational contributions in support of student learning. Central to new strategies is a transformation of the role of academic teacher, but on terms understood by them and supportive of their educational values. Six areas of value creation for teachers and learners are considered in relation to this transformation.<br /

Online learning environments : same place; different demographic space?

This paper presents a large scale, quantitative investigation of the impact of demographic differences on the student experience of using an online learning environment (OLE). Female respondents generally gave higher ratings than males, and gave significantly higher ratings in both importance and satisfaction to a group of OLE elements related to online interaction and community. Postgraduate respondents generally gave lower satisfaction ratings than undergraduate students, though significant differences were few. Results on the basis of mode of enrolment were mixed. The discovery of significant differences between demographic groups highlights the importance of up-to-date and on-going research-based surveys of student perceptions of the OLE. The finding that elements of the institutional OLE are not universally perceived the same way by all students groups also challenges the value of standard, one-size-fits-all institutional policies and templates relating to the use of the OLE.<br /

Designing contemporary learning environments for excellence in public relations

Universities are striving to enhance the quality of the educational experience in the professions in response to external and internal pressures. The professional field of public relations (PR) is not immune to these forces. Previously, enhancements were often pursued through particular initiatives relating to curriculum, pedagogical or assessment redesign at the unit level. While such initiatives are valuable we argue for a strategic, integrated, programmatic approach. This requires the design of learning environments, with integrated virtual and physical dimensions, based on a relevant and meaningful curriculum, and student-centred approaches to learning. These learning environments enable quality learning in fields like public relations with diverse student cohorts studying on- and off-campus. The challenges involved in designing what we term &lsquo;contemporary learning environments&rsquo; are illuminated through a case study of Deakin University&rsquo;s Public Relations Program. Over the last three years redesigning PR online has led to changed curriculum, and pedagogical and assessment practices. We conclude by suggesting that a commitment to continuous quality improvement will be required to ensure the program&rsquo;s learning environment remains relevant to the needs of students studying in the field.<br /

Students\u27 perceptions of the value of the elements of an online learning environment : an investigation of discipline differences

This paper presents a large scale, quantitative investigation of the impact of discipline differences on the student experience of using an online learning environment (OLE). Based on a representative sample of 2526 respondents, a number of significant differences in the mean rating by broad discipline area of the importance of, and satisfaction with, a range of elements of an OLE were found. Broadly speaking, the Arts and Science and Technology discipline areas reported the lowest importance and satisfaction ratings for the OLE, while the Health and Behavioural Sciences area was the most satisfied with the OLE. A number of specific, systematic discipline differences are reported and discussed. Compared to the observed significant differences in mean importance ratings, there were fewer significant differences in mean satisfaction ratings, and those that were observed were less systematic than for importance ratings.<br /