Testing Our Assumptions: The Role of First Course Grade and Course Level in Mathematics and English

Methods that provide an early indicator of factors that affect student persistence are important to colleges and universities. This quantitative research focused on the role of level of entry mathematics and English and also on grades earned in those classes as they relate to persistence after one year. The research showed that by far, the variable most predictive of first-time, full-time students enrolling one year later was earning a grade of “A” in English. Compared to those who did not pass their first English course, students who earned an “A” were three times more likely to persist. The variables which at least doubled the likelihood of persistence included earning an “A” or a “B” in mathematics, a “B” in English, and taking an English course beyond freshman English. While course level taken was significant, the course level effect paled compared with grades earned as a predictor. This effect – of grade earned being more important than course level – included remedial coursework in mathematics and English. In addition, obtaining a high grade in English was equally important for both STEM and non-STEM majors. Finally, students who took both mathematics and English courses their first year were more likely to persist than students who did not take both subjects

An Elective Mathematics Readiness Initiative for STEM Students

This paper reports on the longitudinal results of an online elective mathematics readiness initiative for undergraduate students majoring in science, technology, engineering and mathematics (STEM) at Boise State University. This initiative was put in place in summer of 2010, and over five years has involved 766 total users. It utilized an online commercial system for mathematics learning, focusing mainly on the content associated with preparation for Calculus and preparation for Pre-Calculus. Funding to enable the initiative was derived from the National Science Foundation under a Science, Talent Expansion Program grant. The licenses were issued to students who elected to participate and who then had 77 days of learning available to them. Incentives for participation were provided, including bookstore awards ($100 to$200) if a certain threshold for learning was achieved by the student. These thresholds included from 15 to 20 hours of learning, to 95% completion of course content. This paper reports on the methodology for recruiting students to the initiative, on the longitudinal results of students in subsequent mathematics as a function of effort put into their online mathematic review, on adjustments made to the initiative over time as we learned more about student behavior and motivation, and on student retention of this subset of students in STEM majors

Living with Students: Lessons Learned While Pursuing Tenure, Administration, and Raising a Family

This case study is centered on two faculty-in-residence: one pursuing tenure and raising a young child while living in the residence halls and one an established professor and associate dean raising two teens while living in the residence halls. This case study offers two unique perspectives of faculty-in-residence at various stages in their career, living in residence with their students, working closely with students outside a typical classroom, all while managing professional and familial obligations

A Comparison of Two Engineering Outreach Programs for Adolescents

There is continued growth and development of outreach programs designed to increase pre-college students’ awareness and understanding of engineering as a profession and as a career. These outreach programs vary in format and in the groups targeted for participation but maintain the same fundamental goal of increasing participant knowledge of engineering. Many of these outreach programs also maintain the implicit goal of increasing the participants\u27 knowledge and attitudes toward college. The additional resources and funding that are commonly allocated to support outreach programs frequently involve documenting accountability which motivates evaluation of program impact. Therefore, many outreach events include program evaluation to assess impact on the pre-college participants’ knowledge and perceptions of engineering, but they have not included the assessment of program impact on college attitudes. In this outreach program evaluation study, we examined the impact of two residential engineering outreach events on the participants\u27 engineering perceptions and attitudes and their college attitudes. Our results indicate a number of personal variables were predictors of college attitude, but we failed to expose any variables as indicators of engineering perceptions and attitudes. Analysis of the pre-post survey scores revealed a significant change in engineering perceptions and attitudes (p \u3c .01), but no significant change in college attitude (p =.07). We also exposed a differential impact by outreach event. Results, implications, limitations, and directions for future research are discussed

Coherent Calculus Course Design: Creating Faculty Buy-In for Student Success

This paper recounts the process used and results achieved as first-semester Calculus at Boise State University was transformed over a period of approximately 16 months from a collection of independent, uncoordinated, personalized sections, into a single coherent multi-section course. During the process of this transformation, section size and the instructor pool remained relatively constant; however, profound changes were made across all sections in terms of pedagogy, homework, timing of course content, grade computation and exam content. The motivation for focusing on Calculus I arose from a five-year National Science Foundation Science Talent Expansion Program grant that was awarded in 2010 to a multi-disciplinary team that spanned engineering, mathematics and science. A major grant objective was to raise first-semester, full-time retention of students in STEM majors. The projects supported several yearlong faculty learning communities (FLCs) of about 10 instructors each. With significant involvement from mathematics faculty, the first two FLCs prepared the ground for pedagogical reform of calculus. In 2013-14, a final FLC was created with the express purpose of implementing consistent, student-learning focused strategies across several section of calculus. The specific approach used to design a coherent calculus course was tied to a decision made by the FLC to use identical homework assignments, with common due dates and times. The FLC structure facilitated buy-in and rapid communication and feedback between instructors, who as they came to agreement on the exact homework exercises, also came to agreement on learning goals and content for each individual lesson. Although there was no explicit attempt to have all instructors adopt the same pedagogy or classroom practices, because FLC discussions frequently turned to pedagogy, all members of the FLC chose to adopt a similar pedagogical approach which included devoting class time to solving problems, working in small groups, facilitated by the lead instructor and a learning assistant. In subsequent semesters, all calculus instructors have opted in to the common, coherent approach to the course (except for those teaching online or honors sections). Pass and withdrawal rates pre and post implementation reveal an increase in pass rate of 13.4% and a drop in withdrawal rate of 3.9% as a result of the project. Results from anonymous faculty surveys show that faculty in the project changed their teaching practices in Calculus, that they observed positive effects of this in their classrooms, that they took advantage of the FLC to learn from their colleagues and that their experiences with Calculus will have spillover impacts in their other classes. Results from student surveys show, among other things, that students were aware of the pedagogical difference in terms of their classroom experience, with some expressing discomfort in terms of working in groups to solve problems in class and not receiving a traditional lecture experience and others reporting group work as a valuable aspect

Longitudinal Success of Calculus I Reform

This paper describes the second year of an ongoing project to transform calculus instruction at Boise State University. Over the past several years, Calculus I has undergone a complete overhaul that has involved a movement from a collection of independent, uncoordinated, personalized, lecture-based sections, into a single coherent multi-section course with an activelearning pedagogical approach. The overhaul also significantly impacted the course content and learning objectives. The project is now in its fifth semester and has reached a steady state where the reformed practices are normative within the subset of instructors who might be called upon to teach Calculus I. Gains from the project include a rise in the pass rate in Calculus I, greater student engagement, greater instructor satisfaction, a general shift toward active learning pedagogies, and the emergence of a strong collaborative teaching community. Project leaders are seeking to expand these gains to other areas of the curriculum and to broaden the community of instructors who are fully accepting of the reforms. Common concerns expressed by faculty resistant to the overhaul include suspicion that pass rate gains might reflect grade inflation or weakened standards, and that altering the traditional content of Calculus I might leave students unprepared for Calculus II. External stakeholders also have a vested interest in ensuring students receive a solid preparation in Calculus I. In this paper we develop a response to ensure solid evidence of Calculus II readiness that we hope will be useful to change agents and campus leaders in many other settings. We address concerns about Calculus II readiness by conducting a natural experiment, tracking two cohorts of students through Calculus I and into Calculus II. The “treatment” cohort consists of students who reach Calculus II after passing the reformed Calculus I. The “control” cohort consists of students who reach Calculus II after passing non-reformed Calculus I at Boise State University. The experiment has no designed randomizing, but enrollment data shows that both cohorts spread out across all sections of Calculus II with apparent randomness. Our research question is: “Does the treatment cohort perform any worse than the control cohort in Calculus II?” Data on pass rates and grades in Calculus II will show that the answer is “No.

The Crux: Promoting Success in Calculus II

In the 2013-14 school year, Boise State University (BSU) launched a major overhaul of Calculus I. The details of the reform, described elsewhere, involved both pedagogical and curricular changes. In subsequent years, we developed several assessment tools to measure the effects of the project on students’ grades and retention. The toolkit includes: (1) pass rate and GPA in Calculus I, (2) longitudinal analysis of pass rates and GPA in subsequent courses, (3) impact of Calculus I on retention in STEM and retention at BSU, (4) all of the above comparing students in reformed Calculus vs traditional Calculus, (5) all of the above for underrepresented minorities, women, or other demographic subsets. While these tools were originally developed to study the Calculus I project, they are available for studying the effects of other courses on student academic performance and retention. In this paper, we briefly describe a rebuild of Calculus II, overhauled in the 2015-16 school year following the same general plan as was used for Calculus I. We then present the results of applying the full toolkit to the new Calculus II course. Pass rate and GPA improvements in Calculus II were evident immediately after scale up in the spring of 2016. Sufficient time has now passed so that we can apply the full set of assessment tools built for Calculus I to measure the effectiveness of the Calculus II transformation on academic performance in post-requisite coursework and on student retention in STEM

Calculus Reform: Increasing STEM Retention and Post-Requisite Course Success While Closing the Retention Gap for Women and Underrepresented Minority Students

Boise State University (BSU) implemented an across-the-board reform of calculus instruction during the 2014 calendar year. The details of the reform, described elsewhere (Bullock, 2015), (Bullock 2016), involve both pedagogical and curricular reform. Gains from the project have included a jump in Calculus I pass rate, greater student engagement, greater instructor satisfaction, a shift toward active learning pedagogies, and the emergence of a strong collaborative teaching community. This paper examines the effects of the reform on student retention. Since the curricular reform involved pruning some content and altering course outcomes, which could conceivably have negative downstream impacts, we report on student success in post-requisite mathematics and engineering coursework. To explore the effects of the Calculus reform on retention we focused on whether or not students are retained at the university immediately subsequent to the year in which they encounter Calculus I. We divided 3002 student records into two groups: those who encountered the new version of Calculus and those who had the traditional experience. We then compared retention rates for the two groups. We found that the new Calculus course improved retention (relative to the old) by 3.4 percentage points; a modest, but statistically significant (p = 0.020) result. University retention rates for women, under-represented minorities (URM), and Pell-eligible students were also computed. All three subgroups showed gains, with URM leading with 6.3 percentage points of improved retention (p = 0.107) We then considered retention within STEM as a measure of how the Calculus reform influenced students. For the same groups of students, we computed the rate at which STEM majors were retained in STEM. Once again we found a modest overall gain of 3.3 percentage points (p = .078). We found strong effects on women and underrepresented minorities (URM). The new Calculus course improved retention for both of these groups by more than 9 percentage points, a large effect. At this university, under the old Calculus, women used to lag men in STEM retention by about 8 percentage points. After the Calculus reform this gap nearly vanished, shrinking to 0.5 percentage points. Under the old Calculus, STEM retention of URM students used to lag that of non-URM. After the Calculus reform the gap flipped, so that underrepresented minority students are now retained in STEM at higher rates than non-URM. As a final result we examined student success in courses that typically follow Calculus I. Here the metric is pass rate, and we compared pass rates between the students who took the new Calculus against those who took the old. For additional comparison we also included students who transferred into post-Calculus course work. Once again the reformed Calculus course led to better results

Redshirt in Engineering: A Model for Improving Equity and Inclusion

The NSF-funded Redshirt in Engineering Consortium was formed in 2016 with the goal of enhancing the ability of academically talented but underprepared students coming from low-income backgrounds to successfully graduate with engineering degrees. The Consortium takes its name from the practice of redshirting in college athletics, with the idea of providing an extra year and support to help promising engineering students complete a bachelor’s degree. The Consortium builds on the success of three existing “academic redshirt” programs and expands the model to three new schools. The Existing Redshirt Institutions (ERIs) help mentor and train the new Student Success Partners (SSP), and SSPs contribute their unique expertise to help ERIs improve existing redshirt programs. This Work in Progress paper describes the history of the Redshirt in Engineering Consortium; the Redshirt model as a framework for addressing issues related to diversity, equity, and inclusion in engineering; and initial lessons learned from the implementation of the model across unique institutional contexts