Predicting general academic performance and identifying the differential contribution of participating variables using artificial neural networks

oai:flr.journals.publicknowledgeproject.org:article/13Many studies have explored the contribution of different factors from diverse theoretical perspectives to the explanation of academic performance. These factors have been identified as having important implications not only for the study of learning processes, but also as tools for improving curriculum designs, tutorial systems, and students’ outcomes. Some authors have suggested that traditional statistical methods do not always yield accurate predictions and/or classifications (Everson, 1995; Garson, 1998). This paper explores a relatively new methodological approach for the field of learning and education, but which is widely used in other areas, such as computational sciences, engineering and economics. This study uses cognitive and non-cognitive measures of students, together with background information, in order to design predictive models of student performance using artificial neural networks (ANN). These predictions of performance constitute a true predictive classification of academic performance over time, a year in advance of the actual observed measure of academic performance. A total sample of 864 university students of both genders, ages ranging between 18 and 25 was used. Three neural network models were developed. Two of the models (identifying the top 33% and the lowest 33% groups, respectively) were able to reach 100% correct identification of all students in each of the two groups. The third model (identifying low, mid and high performance levels) reached precisions from 87% to 100% for the three groups. Analyses also explored the predicted outcomes at an individual level, and their correlations with the observed results, as a continuous variable for the whole group of students. Results demonstrate the greater accuracy of the ANN compared to traditional methods such as discriminant analyses.  In addition, the ANN provided information on those predictors that best explained the different levels of expected performance. Thus, results have allowed the identification of the specific influence of each pattern of variables on different levels of academic performance, providing a better understanding of the variables with the greatest impact on individual learning processes, and of those factors that best explain these processes for different academic levels

Reflexive learning, socio-cognitive conflict and peer-assessment to improve the quality of feedbacks in online tests

International audienceOur previous works have introduced the Tsaap-notes platform dedicated to the semi automatic generation of multiple choice questionnaire providing feedbacks: it reuses interactive questions asked by teachers during lectures, as well as the notes taken by students after the presentation of the results as feedbacks integrated into the quizzes. In this paper, we introduce a new feature which aims at increasing the number of contributions of students in order to significantly improve the quality of the feedbacks used in the resulting quizzes. This feature splits the submission of an answer into several distinct phases to harvest explanations given by students, and then applies an algorithm to filter the best contributions to be integrated as feedbacks in the tests. Our approach has been validated by a first experimentation involving master students enrolled in a computer science course

Accounting students' IT applicaton skills over a 10-year period

This paper reports on the changing nature of a range of information technology (IT) application skills that students declare on entering an accounting degree over the period from 1996 to 2006. Accounting educators need to be aware of the IT skills students bring with them to university because of the implications this has for learning and teaching within the discipline and the importance of both general and specific IT skills within the practice and craft of accounting. Additionally, IT skills constitute a significant element within the portfolio of employability skills that are increasingly demanded by employers and emphasized within the overall Higher Education (HE) agenda. The analysis of students' reported IT application skills on entry to university, across a range of the most relevant areas of IT use in accounting, suggest that their skills have continued to improve over time. However, there are significant differential patterns of change through the years and within cohorts. The paper addresses the generalizability of these findings and discusses the implications of these factors for accounting educators, including the importance of recognising the differences that are potentially masked by the general increase in skills; the need for further research into the changing nature, and implications, of the gender gap in entrants' IT application skills; and the low levels of entrants' spreadsheet and database skills that are a cause for concern

Collaboration scripts - a conceptual analysis

This article presents a conceptual analysis of collaboration scripts used in face-to-face and computer-mediated collaborative learning. Collaboration scripts are scaffolds that aim to improve collaboration through structuring the interactive processes between two or more learning partners. Collaboration scripts consist of at least five components: (a) learning objectives, (b) type of activities, (c) sequencing, (d) role distribution, and (e) type of representation. These components serve as a basis for comparing prototypical collaboration script approaches for face-to-face vs. computer-mediated learning. As our analysis reveals, collaboration scripts for face-to-face learning often focus on supporting collaborators in engaging in activities that are specifically related to individual knowledge acquisition. Scripts for computer-mediated collaboration are typically concerned with facilitating communicative-coordinative processes that occur among group members. The two lines of research can be consolidated to facilitate the design of collaboration scripts, which both support participation and coordination, as well as induce learning activities closely related to individual knowledge acquisition and metacognition. In addition, research on collaboration scripts needs to consider the learners’ internal collaboration scripts as a further determinant of collaboration behavior. The article closes with the presentation of a conceptual framework incorporating both external and internal collaboration scripts

Reflexive learning, socio-cognitive conflict and peer-assessment to improve the quality of feedbacks in online tests

Our previous works have introduced the Tsaap-notes platform dedicated to the semi automatic generation of multiple choice questionnaire providing feedbacks: it reuses interactive questions asked by teachers during lectures, as well as the notes taken by students after the presentation of the results as feedbacks integrated into the quizzes. In this paper, we introduce a new feature which aims at increasing the number of contributions of students in order to significantly improve the quality of the feedbacks used in the resulting quizzes. This feature splits the submission of an answer into several distinct phases to harvest explanations given by students, and then applies an algorithm to filter the best contributions to be integrated as feedbacks in the tests. Our approach has been validated by a first experimentation involving master students enrolled in a computer science course

Academic and social integration and study progress in problem based learning

The present study explores the effects of problem-based learning (PBL) on social and academic integration and study progress. Three hundred and five first-year students from three different psychology curricula completed a questionnaire on social and academic integration. Effects of a full-fledged PBL environment were compared to (1) effects of a conventional lecture-based learning environment, and (2) effects of a learning environment that combined lectures and other methods aimed at activating students. Lisrel analyses show direct positive effects of the learning environment on study progress: students in PBL obtained more credits compared to students in more conventional curricula. Moreover, the levels of social and academic integration were also higher among students in the PBL curriculum. The links between integration and study progress were less straightforward. Formal social integration positively affected study progress, but informal academic integration was negatively related to study progress

Extensive gene content variation in the <i>Brachypodium distachyon</i> pan-genome correlates with population structure

13 Pags.- 6 Figs. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holderWhile prokaryotic pan-genomes have been shown to contain many more genes than any individual organism, the prevalence and functional significance of differentially present genes in eukaryotes remains poorly understood. Whole-genome de novo assembly and annotation of 54 lines of the grass Brachypodium distachyon yield a pan-genome containing nearly twice the number of genes found in any individual genome. Genes present in all lines are enriched for essential biological functions, while genes present in only some lines are enriched for conditionally beneficial functions (e.g., defense and development), display faster evolutionary rates, lie closer to transposable elements and are less likely to be syntenic with orthologous genes in other grasses. Our data suggest that differentially present genes contribute substantially to phenotypic variation within a eukaryote species, these genes have a major influence in population genetics, and transposable elements play a key role in pan-genome evolution.The work conducted by the US DOE Joint Genome Institute is supported by the Office of Science of the US Department of Energy under Contract no. DE-AC02-05CH11231. D.P. W. and R.A. were funded in part by the National Science Foundation (grant no. IOS–1258126), and the Great Lakes Bioenergy Research Center (Department of Energy Biological and Environmental Research Office of Science grant no. DE– FCO2–07ER64494). TEJ and DLDM were supported by NSF PGRP grant IOS-0922457. P.C. and B.C.M. were funded by Spanish MINECO (CGL2012-39953-C02-01 and CGL2016-79790-P). B.C.M. was partially funded by DGA—Obra Social La Caixa (grant number GA-LC-059-2011) and Spanish MINECO (AGL2013-48756-R, CSIC13-4E-2490). PC was partially funded by Spanish Aragon Government-European Social Fund (Bioflora).Peer reviewe

Competency-based (CanMEDS) residency training programme in radiology: systematic design procedure, curriculum and success factors

Based on the CanMEDS framework and the European Training Charter for Clinical Radiology a new radiology curriculum was designed in the Netherlands. Both the development process and the resulting new curriculum are presented in this paper. The new curriculum was developed according to four systematic design principles: discursiveness, hierarchical decomposition, systematic variation and satisficing (satisficing is different from satisfying; in this context, satisficing means searching for an acceptable solution instead of searching for an optimal solution). The new curriculum is organ based with integration of radiological diagnostic techniques, comprises a uniform national common trunk followed by a 2-year subspecialisation, is competency outcome based with appropriate assessment tools and techniques, and is based on regional collaboration among radiology departments. The application of the systematic design principles proved successful in producing a new curriculum approved by all authorities. The principles led to a structured, yet flexible, development process in which creative solutions could be generated and adopters (programme directors, supervisors and residents) were highly involved. Further research is needed to empirically test the components of the new curriculum

Exploring the impact of cumulative testing on academic performance of undergraduate students in Spain

The final publication is available at Springer via http://dx.doi.org/10.1007/s11092-014-9208-zFrequent testing provides opportunities for students to receive regular feedback and to increase their motivation. It also provides the instructor with valuable information on how course progresses, thus making it possible to solve the problems encountered before it is too late. Frequent tests with noncumulative contents have been widely analysed in the literature with inconclusive results. However, cumulative testing methods have hardly been reported in higher education courses. This paper analyses the effect of applying an assessment method based on frequent and cumulative tests on student performance. Our results show that, when applied to a microeconomics course, students who were assessed by a frequent, cumulative testing approach largely outperformed those assessed with a single final exam.Doménech I De Soria, J.; Blázquez Soriano, MD.; De La Poza, E.; Muñoz Miquel, A. (2015). Exploring the impact of cumulative testing on academic performance of undergraduate students in Spain. Educational Assessment, Evaluation and Accountability. 27(2):153-169. https://doi.org/10.1007/s11092-014-9208-zS153169272Adelman, HS, & Taylor, L. (1990). Intrinsic motivation and school misbehaviour some intervention implications. Journal of Learning Disabilities, 23, 541–550.Biggs, J, & Tang, C. (2007). Teaching for quality learning at university 3rd edn. Open University Press.Boston, C. (2002). The concept of formative assessment. Practical Assessment Research & Evaluation 8.Brown, GA, Bull, J, Pendlebury, M. (1997). Assessing Student Learning in Higher Education, 1st edn. Routledge.Cano, MD. (2011). Students’ involvement in continuous assessment methodologies: a case study for a distributed information systems course. IEEE Transactions on Education, 54, 442–451.Casem, ML (2006). Active learning is not enough. Journal of College Science Teaching, 35.Chen, J, & Lin, TF. (2008). Class attendance and exam performance a randomized experiment. The Journal of Economic Education, 39, 213–227.Chickering, AW, & Gamson, ZF. (1987). Seven principles for good practice in undergraduate education. American Association for Higher Education Bulletin, 39, 3–7.Crooks, TJ. (1988). The impact of classroom evaluation practices on students. Review of Educational Research, 58, 438–481.De Paola, M, & Scoppa, V. (2011). Frequency of examinations and student achievement in a randomized experiment. Economics of Education Review, 30, 1416–1429.Deck, W. (1998). The effects of frequency of testing on college students in a principles of marketing course, PhD thesis, Virginia Polytechnic Institute and State University. Virginia: Blacksburg.Dempster, FN. (1991). Synthesis of research on reviews and tests. Educational Leadership, 48, 71–76.Dochy, F. (2008). The Edumetric Quality of New Modes of Assessment: Some Issues and Prospects. Assessment, Learning and Judgement in Higher Education. Dordrecht: Springer Netherlands.Eikner, AE, & Montondon, L. (2001). Evidence on factors associated with success in intermediate accounting I. Accounting Educators’ Journal 13.Emerson, TLN, & Mencken, KD. (2011). Homework to require or not? online graded homework and student achievement Perspectives on Economic Education Research 7.Fulkerson, F, & Martin, G. (1981). Effects of exam frequency on student performance, evaluations of instructor, and test anxiety. Teaching of Psychology, 8, 90–93.Furnham, A, & Chamorro-Premuzic, T. (2005). Individual differences and beliefs concerning preference for university assessment methods. Journal of Applied Social Psychology, 35, 1968–1994.Gibbs, G, & Simpson, C. (2005). Conditions under which assessment supports students’ learning Learning and Teaching in Higher Education 1 (August 5, 2011)3–31.Haberyan, KA. (2003). Do weekly quizzes improve student performance on general biology exams?. The American Biology Teacher, 65, 110–114.Kling, N, McCorkle, D, Miller, C, Reardon, J. (2005). The impact of testing frequency on student performance in a marketing course. Journal of Education for Business, 81, 67–72.Kuh, GD (2003). What we’re learning about student engagement from NSSE Change 35.Kuo, T, & Simon, A. (2009). How many tests do we really need. College Teaching, 57, 156–160.Leeming, FC. (2002). The exam-a-day procedure improves performance in psychology classes. Teaching of Psychology, 29, 210–212.Lumsden, KG, Scott, A, Becker, WE. (1987). The economics student reexamined Male-female differences in comprehension. Journal of Economic Education, 18, 365–375.Marriott, P. (2009). Students’ evaluation of the use of online summative assessment on an undergraduate financial accounting module. British Journal of Educational Technology, 40, 237–254.Marriott, P, & Lau, A. (2008). The use of on-line summative assessment in an undergraduate financial accounting course. Journal of Accounting Education, 26, 73–90.McNabb, R, Pal, S, Sloane, P. (2002). Gender differences in educational attainment. the case of university students in england and wales. Economica, 69, 481–503.Miller, F. (1987). Test frequency, student performance and teacher evaluation in the basic marketing class. Journal of Marketing Education, 9, 14–19.Nicol, DJ, & Macfarlane Dick, D. (2006). Formative assessment and self-regulated learning, A model and seven principles of good feedback practice. Studies in Higher Education, 31, 199–218.Nowell, C, & Alston, RM. (2007). I thought I got an A! Overconfidence across the economics curriculum. The Journal of Economic Education, 38, 131–142.Race, P (1995). The art of assessing 1 New Academic 4.Scriven, M. (1967). The Methodology of Evaluation, vol 1 (pp. 39–83). Chicago: Rand McNally.Skinner, BF. (1974). About behaviorism. New York: Alfred A Knopf.Taras, M. (2005). Assessment - summative and formative - some theoretical reflections. British Journal of Educational Studies, 53, 466–478.Trotter, E. (2006). Student perceptions of continuous summative assessment. Assessment & Evaluation in Higher Education, 31, 505–521.Yorke, M. (2003). Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice. Higher Education, 45, 477–501

Online peer assessment in higher education: a systematic review of literature in educational practices

Neste artigo procedemos a uma revisão sistemática da literatura sobre Online Peer Assessment (OPA) no Ensino Superior, mediadas por Tecnologias Digitais de Informação e Comunicação (TIC). Identificamos suas características, centrais e opcionais e mapeamos exemplos práticos (procedimentos e TIC) de OPA que poderão ser transversais, adaptáveis e aplicáveis em diversas unidades curriculares e regimes educacionais. Os resultados apontam para a utilização da OPA como uma estratégia que potencia a “avaliação para a aprendizagem”. Os referenciais teóricos subjacentes, os métodos de avaliação e os tipos de TIC utilizadas indicam seu direcionamento para um maior envolvimento e responsabilidade do aluno na sua aprendizagem. Evidenciamos na literatura que se busca desenvolver essas competências, dando ao aluno oportunidades com alguma regularidade para autoavaliar-se e avaliar seus pares por meio de feedback construtivo. Há também evidências de que dar ou produzir feedback é mais benéfico para a aprendizagem do que apenas recebê-lo, como também é cognitivamente mais exigente e envolve os alunos de forma mais ativa e os direciona ao pensamento crítico e a processos metacognitivos. A partir dos resultados alcançados, consideramos que a OPA, enquanto ferramenta cognitiva, contribui para a construção do conhecimento e para a reflexão sobre a aprendizagem. Um desafio que se coloca diz respeito ao desenvolvimento criativo com foco na diversificação e na inovação das práticas de avaliação no sentido de potenciar aprendizagens e resultados acadêmicos, em atenção às necessidades de aprendizagem que se manifestam frente às expectativas da educação atual e futura e às exigências da sociedade.In this research a systematic review of literature about Online Peer Assessment (OPA) in higher education, mediated by Information and Communication Technology (ICT), was carried out. Optional and central characteristics and its practices (procedures and ICT) were identified and mapping. These procedures and practices may be transversal, adaptable and applied in several curriculum units and educational regimes. The results point to the use of OPA as a strategy that enhances “assessment for learning”. The theoretical framework, the methods of assessment and the kinds of ICT used indicate directions for greater involvement and responsibility from the part of the student in his/her learning. Theoretical framework identifies the need to develop students’ skills, providing them with opportunities for self-assessment and peer assessment on a regular basis through constructive feedback. There is also evidence that to give or receive feedback is more beneficial for learning than just receiving it. It is also cognitively more demanding and directs the students to critical thinking and metacognitive processes. From the results obtained, OPA is seen as a cognitive tool, contributing to the building of knowledge and to reflection about learning. Issues for further reflection are also identified such as the creative development of assessment methods with a focus on diversity and innovation in order to enhance students’ learning and academic results, taking into account their learning needs in face of the expectations of current and future education and the demands of society.CIEC - Centro de Investigação em Estudos da Criança, IE, UMinho (UI 317 da FCT), PortugalFundos Nacionais através da FCT (Fundação para a Ciência e a Tecnologia) e cofinanciado pelo Fundo Europeu de Desenvolvimento Regional (FEDER) através do COMPETE 2020 – Programa Operacional Competitividade e Internacionalização (POCI) com a referência POCI-01-0145-FEDER-007562info:eu-repo/semantics/publishedVersio