Computer-based exams in schools: Freedom from the limitations of paper?

There is little doubt that the curriculum content and pedagogy in schools is driven by the structure and forms of assessment employed, particularly for summative purposes. When most such assessment was limited to what a student could do with a pen and paper in short ‘exams’ this pushed the content of the curriculum towards small descriptive chunks, and the pedagogy towards memorisation and replication techniques. Over the past two decades alternative forms of assessment supported by the power of computer systems have been conceived and tried. This paper discusses progress towards various forms of computer-based exams and how these may encourage curriculum and pedagogy suited to 21st Century learning. In particular it draws attention to research I have led to investigate the feasibility of a number of forms of computer-based exams for high-stakes summative assessment in secondary education. The result was the successful development and implementation of audiovisual stimuli and response computer-based exams, and digital production exams resulting in portfolios of evidence. Each implemented form of exam was tested for feasibility to ensure a defensible balance of manageability, reliability and validity. I believe that for most highstakes summative assessment in Australian schools it is time to replace the ancient paper-based technology with computer-based technologies

Using digital representations of practical production work for summative assessment

This paper presents the findings of the first phase of a three-year study investigating the efficacy of the digitisation of creative practical work as digital portfolios for the purposes of high-stakes summative assessment. At the same time the paired comparisons method of scoring was tried as an alternative to analytical rubric-based marking because we believed that it was likely that a more holistic approach to scoring would be more appropriate. Researchers created digital representations of the practical submissions of 75 Visual Arts and 82 Design students graduating from secondary school in Western Australia. These digital portfolios were scored using the two methods, with the scores compared to those officially awarded to the physical forms. It was concluded that the digital representations of the Visual Arts submissions had adequate fidelity for the purpose of awarding high-stakes scores particularly using the paired comparisons method. However, the Visual Arts teachers and students were opposed to digitisation. For the Design portfolios teachers and students were supportive of digital submission, but the structure of the portfolios reduced the reliability and validity of scores, particularly from analytical marking

Assessment in senior secondary physical education. Questions of judgement

The ways in which various aspects of senior physical education courses should be assessed and whether some can, or indeed should be incorporated in external examinations, are matters of longstanding professional debate across Australia and internationally. Differences in current practice across Australasia reflect an ongoing lack of consensus about how assessment requirements and arrangements and particularly, examinations in senior physical education, can best address concerns to ensure validity, reliability, equity and feasibility. An issue never far from such debates is that of ‘professional judgement’ and more specifically, whether and how professional judgement does and/or should ‘come into play’ in assessment. This paper reports on research that has explored new approaches to examination assessment and marking in senior physical education, using digital technologies. It focuses specifically on the ways in which ‘professional judgement’ can be deemed to be inherent to two contrasting methods of assessment used in the project: ‘analytical standardsbased’ assessment and ‘comparative pairs’ assessment. Details of each method of assessment are presented. Data arising directly from assessors’ comments and from analysis which explored intermarker reliability for each method of assessment and compared results generated by internal teacher assessment, standards-based and comparative pairs assessment, is reported. Discussion explores whether the data arising can be seen as lending weight to arguments for (i) more faith to be placed in professional judgement and (ii) for the comparative pairs methods to be more widely employed in examination assessment in senior physical education

For Richer or For Poorer? Evidence from Indonesia, South Africa, Spain, and Venezuela

We analyze household income dynamics using longitudinal data from Indonesia, South Africa (KwaZulu-Natal), Spain and Venezuela. In all four countries, households with the lowest reported base-year income experienced the largest absolute income gains. This result is robust to reasonable amounts of measurement error in two of the countries. In three of the four countries, households with the lowest predicted base-year income experienced gains at least as large as their wealthier counterparts. Thus, with one exception, the empirical importance of cumulative advantage, poverty traps, and skill-biased technical change was no greater than structural or macroeconomic changes that favored initially poor households in these four countries

Using pairwise comparisons in the online social moderation of performance assessment

Assessing the performance of a student involves some form of judgement, and where more than one assessor is involved this usually requires some form of moderation to ensure consistent and fair results. Often this involves meetings or communication between assessors, which is referred to as social moderation. This paper reports on a study that investigated the use of online technologies to support a form of social moderation of artworks submitted for assessment in a senior secondary school course in Western Australia. Online systems were used to facilitate communications and provide access to digital representations of the submissions along with assessment tools. In particular a pairwise comparison judging online tool was used. This approach to social moderation was tested in a realistic context involving a sample of 12 teachers from rural schools for whom face-to-face meetings would be difficult. The aim was to investigate whether the use of these online systems would support good moderation outcomes and valuable professional learning for those involved. The study found that this approach to online social moderation was feasible, and participants perceived that it had improved the consistency of their judgements because they had developed an improved understanding of the assessment criteria and standard of work. However, analysis of scores and reliability data suggested some were not adequately consistent, and it was likely that this was due to their inexperience in assessing such work. Therefore some changes to the processes of this form of online social moderation were recommended

Pricing and Reimbursement in U.S. Pharmaceutical Markets

In this survey chapter on pricing and reimbursement in U.S. pharmaceutical markets, we first provide background information on important federal legislation, institutional details regarding distribution channel logistics, definitions of alternative price measures, related historical developments, and reasons why price discrimination is highly prevalent among branded pharmaceuticals. We then present a theoretical framework for the pricing of branded pharmaceuticals, without and then in the presence of prescription drug insurance, noting factors affecting the relative impacts of drug insurance on prices and on utilization. With this as background, we summarize major long-term trends in copayments and coinsurance rates for retail and mail order purchases, average percentage discounts off Average Whole Price paid by third party payers to pharmacy benefit managers as well as average dispensing fees, and generic penetration rates. We conclude with a summary of the evidence regarding the impact of the 2006 implementation of the Medicare Part D benefits on pharmaceutical prices and utilization, and comment on very recent developments concerning the entry of large retailers such as Wal-Mart into domains traditionally dominated by large retail chains and the "commoditization" of generic drugs