Implementing Direct and Indirect Assessment in the MIS Curriculum

Assessment and continuous improvement have become focus areas for accrediting agencies. The process used to develop assessment plans within a sequence of MIS courses at a major midwestern university is described. The process includes establishing student outcomes, developing assignments that tap into these outcomes, and utilizing both direct and indirect assessment measures. Actionable insights that can be gleaned to improve pedagogy from the use of both direct and indirect measures are described

Are Student Self-Assessments a Valid Proxy for Direct Assessments in Information Systems Programs?

In this report, we describe assessment efforts in the MIS curriculum at a major Midwestern U.S. university. We discuss both direct and indirect assessment measures that may either be used as complements or on a stand-alone basis. Because direct assessment efforts are usually more time consuming and work-intensive, it would be helpful for ongoing program assessment if indirect assessment could be used as an effective alternative, at least on occasion. The validity of student self-assessments has been debated in the assessment literature. This study compares results for common learning outcomes assessed with direct measures and student self –assessments. We find that for certain types of learning outcomes student self-assessments are valid proxies for direct assessment

Predicting Student-Perceived Learning Outcomes and Satisfaction in ERP Courses: An Empirical Investigation

This article uses the Unified Theory of Acceptance and Use of Technology model (UTAUT) as the basis for the research framework to examine factors that influence student-perceived learning outcomes and satisfaction in enterprise resource planning (ERP) courses. Antecedent variables considered are student attitude, performance expectancy, effort expectancy, training (hands-on), course structure, and perceived instructor knowledge. A Structural Equation Model (SEM) using LISREL was employed to test the measurement and structural models using a convenience sample of 102 students enrolled in ERP courses. The results showed that student attitude had the largest significant direct impact on student-perceived learning outcomes and satisfaction. Effort expectancy and performance expectancy had significant direct impacts on attitude. Course structure and training (hands-on) had indirect effects on attitude through effort expectancy and performance expectancy. The findings suggest that, in order to impact student attitude and, thus, impact their perceived learning outcomes and satisfaction, instructors should emphasize the importance of learning about ERP systems and should provide clear directions so that students experience a meaningful interaction with ERP systems. Implications for practitioners and educators are reported

WP6 Comparative Analysis Skills Supply and Demand

This report addresses the regional governance of the skills supply and demand in Glasgow City Region and Aberdeen City and Aberdeenshrie Region. The document describes and analyses how actors in the two Scottish regions understand and face the developmental challenges and how their skills agendas are constructed. The document also focuses on the levels and mechanisms of coordination among actors to implement the regional skills agenda given the socioeconomic context and regional skills (mis)matches

Integrating Soft Skills Assessment through University, College, and Programmatic Efforts at an AACSB Accredited Institution

The growing demand for verification that students are, indeed, learning what they need to learn is driving institutions and programs to develop tools for assessing the level of knowledge and skills of their graduating students. One such tool, the Information Systems Analyst (ISA) certification, is a recently developed instrument for measuring eight skill areas based upon the IS2002 Model Curriculum. While the exam strongly evaluates the technical skill set of Information Systems (IS) majors, in this paper, the authors suggest additional means of addressing and measuring requisite soft skills for Information Technology (IT), accounting, and other business students. In this article, the authors address the concerns voiced by the employers of college graduates regarding the apparent insufficient competency in soft skills and suggest an assurance of learning model for incorporating these skills into curricula. In addition, the authors share activities at the university, college, and program level to integrate the assessment of soft skills at educational institutions

Ascertaining the impact of endogenous and exogenous factors on the performance of students taking non-specialist accounting courses

This study aims to evaluate the potential determinants of academic performance of non-specialist accounting students. Considering both actual and initially expected performance, in conjunction with students’ learning styles and preferences, we use two econometric methods - Ordinal Probit and Ordinary Least Squared - in order to investigate and assess the impact of endogenous and the exogenous factors on the students’ academic achievement. Eventually, based on the results of our estimations, and by dividing the non-specialist students into segments, according to their demographic characteristics, we run a series of simulations to estimate empirically the likelihood of the students to report an academic performance weaker, in line, better, and considerably better than what they expected

Are Student Self-Assessments a Valid Proxy for Direct Assessments in Efforts to Improve Information Systems Courses and Programs? An Empirical Study

Accrediting agencies in the United States require business schools to conduct ongoing assessment directed at continuous improvement of their instruction. Because direct assessment efforts are usually more time consuming and resource-intensive than indirect assessment, it would be helpful if indirect assessment could be used as an effective alternative, at least on occasion. The validity of one indirect method, student self-assessment, has been debated in the research literature. This study compares results of direct measures and student self-assessments for learning outcomes in an Information Systems course. We find student self-assessments are valid proxies for direct assessment when used with some types of learning outcomes but not others. We discuss possible reasons for the difference and the implications for assessment in Information System programs

Becta Review 2005. Evidence on the progress of ICT in education.

Drawing on Becta national surveys of ICT use and implementation within the education system, the Becta Review identified the ways in which ICT could be used to support the DfES 5 year strategy, to introduce greater efficiencies in educational provision and more choice/personalisation of content and delivery