Assessing university students' prior knowledge : implications for theory and practice

The aim of this dissertation was to explore how different types of prior knowledge influence student achievement and how different assessment methods influence the observed effect of prior knowledge. The project started by creating a model of prior knowledge which was tested in various science disciplines. Study I explored the contribution of different components of prior knowledge on student achievement in two different mathematics courses. The results showed that the procedural knowledge components which require higher-order cognitive skills predicted the final grades best and were also highly related to previous study success. The same pattern regarding the influence of prior knowledge was also seen in Study III which was a longitudinal study of the accumulation of prior knowledge in the context of pharmacy. The study analysed how prior knowledge from previous courses was related to student achievement in the target course. The results implied that students who possessed higher-level prior knowledge, that is, procedural knowledge, from previous courses also obtained higher grades in the more advanced target course. Study IV explored the impact of different types of prior knowledge on students’ readiness to drop out from the course, on the pace of completing the course and on the final grade. The study was conducted in the context of chemistry. The results revealed again that students who performed well in the procedural prior-knowledge tasks were also likely to complete the course in pre-scheduled time and get higher final grades. On the other hand, students whose performance was weak in the procedural prior-knowledge tasks were more likely to drop out or take a longer time to complete the course. Study II explored the issue of prior knowledge from another perspective. Study II aimed to analyse the interrelations between academic self-beliefs, prior knowledge and student achievement in the context of mathematics. The results revealed that prior knowledge was more predictive of student achievement than were other variables included in the study. Self-beliefs were also strongly related to student achievement, but the predictive power of prior knowledge overruled the influence of self-beliefs when they were included in the same model. There was also a strong correlation between academic self-beliefs and prior-knowledge performance. The results of all the four studies were consistent with each other indicating that the model of prior knowledge may be used as a potential tool for prior knowledge assessment. It is useful to make a distinction between different types of prior knowledge in assessment since the type of prior knowledge students possess appears to make a difference. The results implied that there indeed is variation between students’ prior knowledge and academic self-beliefs which influences student achievement. This should be taken into account in instruction.Oppimisen tukeminen arvioinnin avulla - ennakkotiedon merkitys yliopisto-opiskelijoiden oppimisprosessissa Tämän väitöskirjatutkimuksen tarkoituksena oli tutkia, millä tavalla opiskelijoiden opintojaksoa edeltävä ennakkotiedon taso heijastuu oppimistuloksiin eri tieteenaloilla ja mitkä ovat ennakkotiedon arviointiin soveltuvat keinot ja menetelmät. Tutkimuksessa kehitettiin malli ennakkotiedosta, jonka toimivuutta testattiin kolmella eri luonnontieteellisellä alalla, joissa opiskelijoilla oli havaittu olevan vaikeuksia tiettyjen kurssien suorittamisessa. Tutkimuksen keskeisenä tavoitteena oli tarkastella, miten yliopisto-opiskelijoiden korkeatasoista oppimista voidaan tukea ennakkotiedon arvioinnin avulla. Kaikkien neljän osatutkimuksen tulokset osoittivat johdonmukaisesti, että opiskelijoiden ennakkotieto ja sen laatu ennustivat hyvin opintomenestystä. Opiskelijat, joilla oli syvällistä ennakkotietoa ja osaamista jo kurssin alussa, menestyivät paremmin kurssilla ja saivat korkeampia arvosanoja kuin opiskelijat, joiden ennakkotiedon taso oli heikompi. Lisäksi ennakkotiedon taso oli yhteydessä kurssin keskeyttämiseen ja suorittamisnopeuteen. Opiskelijat, joilla oli heikko ennakkotiedon taso, jättivät todennäköisemmin kurssin kesken tai suorittivat kurssin hitaammin uusintakokeiden avulla. Lisäksi tällaiset opiskelijat arvioivat oman pystyvyytensä alhaisemmaksi kuin opiskelijat, joilla oli hyvä ennakkotiedon taso. Kaikkien neljän osatutkimuksen tulokset olivat yhteneväisiä keskenään ja osoittivat, että kehitetty ennakkotiedon malli vaikutti toimivan johdonmukaisesti ja sitä voidaan käyttää perustellusti ennakkotiedon arvioinnin välineenä. Opiskelijoiden ennakkotieto voi olla laadullisesti hyvin erilaista ja täten johtaa myös laadullisesti erilaiseen oppimiseen. Opiskelijoiden ennakkotiedon tasoon tulisikin opetuksessa kiinnittää erityistä huomiota ja tähän arviointi on hyvä väline

All Happy Emotions Are Alike but Every Unhappy Emotion Is Unhappy in Its Own Way : A Network Perspective to Academic Emotions

Quantitative research into the nature of academic emotions has thus far been dominated by factor analyses of questionnaire data. Recently, psychometric network analysis has arisen as an alternative method of conceptualizing the composition of psychological phenomena such as emotions: while factor models view emotions as underlying causes of affects, cognitions and behavior, in network models psychological phenomena are viewed as arising from the interactions of their component parts. We argue that the network perspective is of interest to studies of academic emotions due to its compatibility with the theoretical assumptions of the control value theory of academic emotions. In this contribution we assess the structure of a Finnish questionnaire of academic emotions using both network analysis and exploratory factor analysis on cross-sectional data obtained during a single course. The global correlational structure of the network, investigated using the spinglass community detection analysis, differed from the results of the factor analysis mainly in that positive emotions were grouped in one community but loaded on different factors. Local associations between pairs of variables in the network model may arise due to different reasons, such as variable A causing variation in variable B or vice versa, or due to a latent variable affecting both. We view the relationship between feelings of self-efficacy and the other emotions as causal hypotheses, and argue that strengthening the students' self-efficacy may have a beneficial effect on the rest of the emotions they experienced on the course. Other local associations in the network model are argued to arise due to unmodeled latent variables. Future psychometric studies may benefit from combining network models and factor models in researching the structure of academic emotions.Peer reviewe

Understanding procrastination: A case of a study skills course

Procrastination is consistently viewed as problematic to academic success and students' general well-being. There are prevailing questions regarding the underlying and maintaining mechanisms of procrastination which are yet to be learnt. The aim of the present study was to combine different ways to explain procrastination and explore how students' time and effort management skills, psychological flexibility and academic self-efficacy are connected to procrastination as they have been commonly addressed separately in previous studies. The data were collected from 135 students who participated in a voluntary time management and well-being course in autumn 2019. The results showed that students' ability to organize their time and effort has the strongest association with procrastination out of the variables included in the study. Psychological flexibility also has a strong individual role in explaining procrastination along with time and effort management skills. Surprisingly, academic self-efficacy did not have a direct association with procrastination. Interestingly, our findings further suggest that time and effort management and psychological flexibility are closely related and appear to go hand in hand and, thus, both need to be considered when the aim is to reduce procrastination. The implications of the findings are further discussed.Peer reviewe

Students’ experiences of the factors affecting their study progress : Differences in study profiles

Many factors influence students’ progress in higher education. However, the students’ own voices are seldom heard. Using a qualitative approach, the study explored students’ own experiences of the factors that have influenced their studying. Research has indicated that students’ experiences are often related to their approaches to learning. Therefore, experiences of enhancing and impeding factors were explored here in relation to different study profiles. Altogether 736 open-ended answers were analysed by qualitative context analysis. After establishing the categories of enhancing and impeding factors and creating the student profiles, the differences between the profiles were examined using chi-square tests. The results revealed that the students had experienced a broad variety of factors that influenced their studying. These experiences varied widely with regard to the students’ study profiles. In particular, those in the Students applying a surface approach and Unorganised students applying a deep approach profiles appeared to experience more obstacles in their studies than the students in other profiles. Characteristic of these two profiles was the students’ low ability to organise their studies, that is, manage their time and effort. The study suggests that at least part of the variation in students’ experiences of the factors influencing their progress is explainable by the students’ learning profiles. Whether it would be useful to identify different student profiles rather than concentrate on asking the students directly about their experiences of enhancing and impeding factors is discussed.Many factors influence students’ progress in higher education. However, the students’ own voices are seldom heard. Using a qualitative approach, the study explored students’ own experiences of the factors that have influenced their studying. Research has indicated that students’ experiences are often related to their approaches to learning. Therefore, experiences of enhancing and impeding factors were explored here in relation to different study profiles. Altogether 736 open-ended answers were analysed by qualitative context analysis. After establishing the categories of enhancing and impeding factors and creating the student profiles, the differences between the profiles were examined using chi-square tests. The results revealed that the students had experienced a broad variety of factors that influenced their studying. These experiences varied widely with regard to the students’ study profiles. In particular, those in the Students applying a surface approach and Unorganised students applying a deep approach profiles appeared to experience more obstacles in their studies than the students in other profiles. Characteristic of these two profiles was the students’ low ability to organise their studies, that is, manage their time and effort. The study suggests that at least part of the variation in students’ experiences of the factors influencing their progress is explainable by the students’ learning profiles. Whether it would be useful to identify different student profiles rather than concentrate on asking the students directly about their experiences of enhancing and impeding factors is discussed.Peer reviewe

The complex relationship between emotions, approaches to learning, study success and study progress during the transition to university

The demands and pressures during the first study year at university are likely to arouse a variety of emotions among students. Nevertheless, there are very few studies on the role of emotions in successful studying during the transition phase. The present study adopts a person-oriented and mixed-method approach to explore, first, the emotions individual students experience during the first year at university. Hierarchical cluster analysis was used to group students (n = 43) on the basis of the emotions they described in an interview. Second, the study investigates how the students in the different clusters scored on approaches to learning (as measured on the Learn questionnaire) and how they succeeded (GPA) and progressed (earned credits per year) in their studies. Three emotion clusters were identified, which differed in terms of the deep and surface approaches to learning, study success and study progress: (1) quickly progressing successful students experiencing positive emotions, (2) quickly progressing successful students experiencing negative emotions and (3) slowly progressing students experiencing negative emotions. The results indicate that it is not enough to focus on supporting successful learning, but that attention should also be paid to promoting students' positive emotions and well-being at this time.Peer reviewe

Using individual study profiles of first-year students in two different disciplines to predict graduation time

Despite vast research on transitioning to higher education and student diversity, little longitudinal evidence exists of how individual differences of first-year students predict their graduation times. The present study explored the relation between first-year students' study profiles and graduation times in two different disciplines, by following the same students' (N = 65) study progress for six years using student records data. Profiling students was based on student interviews. Statistical analysis of time to degree completion was conducted using event history analysis. The results revealed that first-study-year study profiles clearly predict graduation times and degree completion. Disciplinary differences existed between graduation times, which may be explained by the different structures of the disciplines. The results imply that individual students need tailored support at different phases of their studies.Peer reviewe

Detecting the Variability in Student Learning in Different Disciplines-A Person-Oriented Approach

This paper examines disciplinary differences in the combinations of approaches to learning (i.e., learning profiles) among students, and how those combinations are related to academic achievement. In addition, the study focuses on how different learning profiles are related to students' self-efficacy beliefs in different disciplines. Data consist of HowULearn survey responses from 4,294 full-time students from six different disciplines. We used a person-oriented approach; that is, the latent profile analysis (LPA) with various functions. The results showed that it is possible to detect different learning profiles of students in different disciplines. The study highlights that students who struggle in almost every discipline have a dissonant learning profile or the deep unorganised profile. Therefore, special attention should be paid to identifying the students with dissonant learning profiles and to support them in recognising their own learning processes. Moreover, students' time and effort management skills should be fostered during university studies.Peer reviewe

Systematic review of learning generic skills in higher education : enhancing and impeding factors

The research field on generic skills in higher education has expanded rapidly. In addition, the importance of generic skills has been highlighted both in educational policy discourses and in practice of higher education. The present study reviews theoretical, methodological, and empirical viewpoints on learning generic skills and synthesizes the empirical evidence about the factors that enhance and impede student learning of generic skills. Altogether 116 articles were included in the analysis. The systematic analysis revealed remarkable variation in concepts, research methods, and operationalization of generic skills. These findings suggest that research in this field is still incoherent. According to the results, contextual factors that enhance or impede higher education students' learning of generic skills were investigated more often than individual factors. Furthermore, the articles included in this review emphasized learning of work-oriented professional skills over higher-order thinking skills. To ensure the development of research on generic skills, it is important to focus on more coherent theorization and operationalization of the various generic skills. More longitudinal studies with methods that genuinely capture actual skills and their development are also needed to advance the field. The results can be used for future discussions on theorization, empirical research, and practical development of student learning of generic skills.Peer reviewe

Exploration of individual study paths of successful first-year students : an interview study

The aim of the present study was to explore the individual profiles of successful, rapidly progressing first-year university students. The participants numbered 38 humanities and law students, who volunteered to be interviewed. The interview data were analysed using abductive content analysis. Two student profiles were distinguished: strenuously progressing students, who were interested and motivated but had to work hard to meet their deadlines and maintain a rapid study pace (applying a defensive pessimism cognitive strategy), and effortlessly progressing students, who had very good self-regulation skills, strong self-efficacy for self-regulation and the most positive experiences of their learning environment. These students applied a deep approach to learning and an optimistic cognitive strategy. The results highlight the complex interplay between motivational and volitional factors, the approaches to learning and the cognitive attributional strategies affecting individual study paths.Peer reviewe

Systematic Review of Learning Generic Skills in Higher Education – Enhancing and Impeding Factors

The research field on generic skills in higher education has expanded rapidly. In addition, the importance of generic skills has been highlighted both in educational policy discourses and in practice of higher education. The present study reviews theoretical, methodological, and empirical viewpoints on learning generic skills and synthesizes the empirical evidence about the factors that enhance and impede student learning of generic skills. Altogether 116 articles were included in the analysis. The systematic analysis revealed remarkable variation in concepts, research methods, and operationalization of generic skills. These findings suggest that research in this field is still incoherent. According to the results, contextual factors that enhance or impede higher education students' learning of generic skills were investigated more often than individual factors. Furthermore, the articles included in this review emphasized learning of work-oriented professional skills over higher-order thinking skills. To ensure the development of research on generic skills, it is important to focus on more coherent theorization and operationalization of the various generic skills. More longitudinal studies with methods that genuinely capture actual skills and their development are also needed to advance the field. The results can be used for future discussions on theorization, empirical research, and practical development of student learning of generic skills.</p