|
|
||||||||
HOW WE LEARN

Division of Basic Biomedical Sciences, School of Medicine, Department of Biology, College of Arts and Sciences, Office of Medical Education, School of Medicine, University of South Dakota, Vermillion, South Dakota
Address for reprint requests and other correspondence: B. E. Goodman, Univ. of South Dakota School of Medicine, 414 E. Clark St., Vermillion, SD 57069 (e-mail: bgoodman{at}usd.edu)
Abstract
The teaching faculty for this course sought to address their own concerns about the quality of student learning in an impersonal large lecture biology class for majors, the difficulties in getting to know each student by name, and difficulties in soliciting answers and reactions from the students during the lecture. Questions addressed by this study were, Do active-learning activities in a small and personal lecture setting enhance student learning more than active-learning activities in large impersonal lectures? and Are students more satisfied with an educational experience in a small and personal lecture setting? Based on faculty perceptions of how they best relate to their students, the prediction was that the students in the experimental group with small lecture classes and increased direct contact with the teaching faculty would learn physiological principles better than the students in the control group in the large impersonal lecture portion of the course. One of the laboratory sections of this large enrollment biology course was randomly selected to be taught with separate small lectures by the teaching faculty. In addition, the teaching faculty participated in the laboratory with these students during their experiments correlated with the lecture material. The students in both groups were compared by pre- and posttests of physiological principles, final course grades, and class satisfaction surveys.
Key words: student learning; active learning
BIOLOGY 164 (Principles of Organismal Physiology) has been one of the four core courses required for biology majors at the University of South Dakota since the inception of the new biology core curriculum in the fall semester of 2000. Biology 164 is taught during the spring semester generally to first- and second-year undergraduate students who have just completed Biology 163 (Principles of Cellular and Molecular Biology). Many of the students have also completed Biology 161 (Principles of Genetics and Evolution) and Biology 162 (Principles of Organismal Diversity and Ecology); however, students who are premeds but not biology majors are not required to take the 161 and 162 courses. Most of the students enrolled in Biology 164 have either completed one or two semesters of general chemistry, and some may be enrolled in organic chemistry. Since the Department of Biology has the highest number of undergraduate majors in the College of Arts and Sciences at the University of South Dakota, the annual offerings of Biology 164 have attracted between 75 and 150 students. The course is taught via three 50-min lectures to the entire group of students and an up to 3-h laboratory session with fewer than 24 students each week. The lab sessions are taught by biology graduate teaching assistants (TAs) with support from an upper-level biology undergraduate teaching intern. The lecture hall seats
300 students in a theatre-style classroom with a front podium, computer, and data projector and two aisles. It is not possible for an instructor to walk between the rows of students while they are seated at the desks.
The teaching faculty for this course (B. E. Goodman and K. L. Koster) sought to address their own concerns about 1) the quality of student learning in the impersonal large lecture classroom, 2) difficulties in getting to know the students by name, and 3) getting answers and reactions from the students during the lecture time by designing an educational experiment with potential for statistical significance that could be implemented with an appropriate control group. P. L. Redinius served as the consultant for the initial experimental design and the statistical analysis. Large lecture classes (130200 students) with weekly laboratories are the norm at this institution for the four introductory courses for biology majors (Biology 161 through 164) and the general education courses for nonmajors (Biology 101 and 103). Thus the questions addressed by this study were, Do active-learning activities in a small and personal lecture setting enhance student learning more than active-learning activities in large impersonal lectures? and Are students more satisfied with an educational experience in a small and personal lecture setting? Based on faculty perceptions of how they best relate to their students, the prediction was that the students in the experimental group with small lecture classes and increased direct contact with the teaching faculty would learn physiological principles better than the students in the control group in the large impersonal lecture portion of the course.
At the time of this educational experiment, B. E. Goodman was teaching the animal physiology portion of Biology 164 for the third time and K. L. Koster was teaching the plant physiology portion for the second time, although she taught the same material in the previous version of the general biology course for 7 yr. Both Goodman and Koster are experienced teachers and tenured faculty members at the University of South Dakota. The animal physiology portion is
75% of the course time, is taught as a broad survey of the general principles of physiology via an overview-style systems approach, and has laboratory activities closely correlated with the lecture material. The plant physiology portion is
25% of the course time, addresses general principles of plant physiology stressing similarities and differences between plant and animal physiology, and also has laboratory activities designed to correlate well with the lecture material. The textbook used for the course was Life: The Science of Biology (4).
The course philosophy is introduced to the students on the first day of class as a team effort among the students, faculty, and TAs to improve student learning of physiological principles. The faculty members encourage students to ask or e-mail questions at any time. To enhance student learning, various individual and group activities are incorporated throughout the course. These activities have included (see Fig. 1 for some examples) 1) think-pair-share activities during lecture time; 2) an individual report with references about a specific cardiovascular or respiratory disease; 3) formative assessment activities that include writing a question or an answer about the material, stating what was clear/not clear, or writing what new information was learned; 4) case studies during lecture with questions and the answers solicited from the students; and 5) designing, running, interpreting, and presenting a cooperative group experiment to investigate human physiology using the Biopac instruments in the laboratory.
|
6070% multiple choice questions that mostly test Blooms taxonomy levels of knowledge and comprehension and 30% short discussion questions that are likely to test higher levels of Blooms taxonomy (analysis, synthesis, and evaluation). Multiple choice questions are computer-graded and the short discussions are generally graded by the teaching faculty with some assistance by the TAs using a grading rubric. The course objectives for Biology 164 are 1) students will be able to understand and interpret the general principles of physiology; 2) students will compare and contrast the basic concepts of animal physiology with those of plant physiology; 3) students will recognize the physiological and pathophysiological relevance of various systems to organismal life and success; and 4) students will develop and use the scientific method in a collaborative group via the Biopac research project. In a recent publication, Cuseo (1) has synthesized research that relates to the consequences of large class size on teaching, learning, and retention to evaluate its implications for the success of undergraduate students (particularly first year students). According to Cuseo, there are at least eight deleterious outcomes of teaching students in large-sized classes. These include 1) increased faculty reliance on lecture; 2) less active student involvement; 3) reduced frequency of instructor interaction with and feedback to the students; 4) lower depth of student thinking while in class; 5) lower Blooms taxonomy level of learning objectives and learning strategies; 6) lower levels of academic achievement of students; 7) lower level of course satisfaction with learning; and 8) lower student evaluations at the end of the course. Some of these proposed outcomes have been partially addressed by our study and will be discussed later.
METHODS
During the Spring 2003 offering of Biology 164, an educational experiment was designed and implemented to evaluate whether the active-learning activities used in the course would be more effective for student learning in the large lecture class format or in a separate small lecture class. Thus one of the laboratory sections (Tuesday afternoon with 20 students, 18 of whom participated in the experiment, including 1 who did not complete the posttest and satisfaction survey due to illness) was randomly selected at the beginning of the course to be the experimental group and the rest of the class was the control group (with 87 students who began and completed the course). The experimental group signed consent forms for the Institutional Review Board-approved exempt experiment entitled "Active Teaching of Biology in Small vs. Large Class Settings." One student in the original Tuesday laboratory who could not attend the small enrollment lectures transferred to another section and two other students attended the Tuesday laboratories but not the separate lectures and were not included in either the experimental or the control groups. The rest of the experimental group had separate lecture times (taught by the same faculty members) and the teaching faculty participated with them in all laboratory activities with the assistance of one of the biology graduate TAs. The separate lecture times were chosen based on the students schedules and consisted of the first hour of the laboratory time on Tuesday afternoons and two 50-min lectures from 5:00 to 6:00 PM on Wednesday and Thursday afternoons. The students in the experimental group wore name tags for a short time at the beginning of the course until they could be identified by the faculty member and were called on by name in class. However, the same lecture material and the same active-learning activities were used in the small separate lectures and in the large lecture class. The most common kinds of active learning exercises used in both lectures were think-pair-share activities; open-ended questions; and minicase studies with open-ended questions. In addition, handouts were available to both groups of students with the individual student learning objectives for each chapter listed (for example, see Fig. 1), and the PowerPoint presentations of graphs and figures used during the lecture time were available to all students via web access. Sometimes the first offering of the lecture was to the experimental group and sometimes it was to the control group depending on the day of the week.
Students in both groups were given a pretest of comprehension-level multiple choice and essay-type questions about physiological principles during the first laboratory of the course and a posttest of the same questions during the last laboratory of the course (see Fig. 2 for the entire 12-question test). Tests were not graded and returned to the students after the pretest, and there was no direct discussion of the test material during the course. Tests were graded by B. E. Goodman after the completion of the course using a grading sheet for the multiple choice questions and a rubric for the essay questions. Neither the identity of the student nor whether the test was the pretest or the posttest was known when the essay questions were graded. Since thepre- and posttests were identified with the names of the students (on the front of the test but not on the part that was hand graded), a comparison of group mean changes in pre- vs. posttest scores and correlation with course final grades were both possible. In addition to the pre- and posttest analysis of student learning, students in both groups were asked to fill in a custom-designed class satisfaction survey with questions using a Likert scale (scale of 5 choices for each answer) for answers. The class satisfaction survey (see Fig. 3 and Table 1) was designed by B. E. Goodman with the assistance of P. L. Redinius who served as the educational psychology and statistical consultant. Data were collected from pre- and posttest scores, student final course scores, and the 24-item, 5-point Likert course satisfaction surveys.
|
|
|
The purpose of the data collection was to compare both student learning and student satisfaction with the small vs. the large lecture formats, both of which incorporated active learning components. First, the student knowledge results will be reported followed by student satisfaction.
Group means were calculated for pretest, posttest, and for final course scores. Table 2 shows the results.
|
A one-way ANOVA was calculated to determine the contribution of group membership to pretest scores, posttest scores, and final course grades.
Table 3 shows there was not a statistically significant difference between group means in the posttest scores. The P values approached significance in detecting differences in course grade and pretest scores. Thus experimental small class group success in the course grade cannot be confidently attributed to the intervention.
|
2 analysis was conducted to identify which satisfaction scale items demonstrated a difference between the control large lecture and the experimental small class groups (see Table 1). This section will begin with the satisfaction scale items rated statistically significantly higher by the experimental group, followed by the satisfaction survey items rated statistically significantly higher by the control group. The survey items with statistically significant differences that were scored higher by the experimental small class group include 1) "The number of students in the lecture portion of the course was appropriate for learning." (P < 0.01), 2) "The number of students in the laboratory portion of the course was appropriate for learning." (P = 0.05), and 3) "Conducting experiments and preparing laboratory reports helped me to learn about the scientific method and to apply physiological concepts." (P = 0.014).
One satisfaction survey item was rated statistically significantly higher by the large lecture control group, "The number of students in the lecture portion of the course was distracting to my learning." (P < 0.01).
DISCUSSION
The experimental small class group was randomly chosen based on those students who signed up for a particular laboratory session before the first day of the course. It is possible, based on pretest scores and final course grades, that the average Tuesday afternoon laboratory student was a stronger (or weaker) student than the average student in the large lecture class. There is no known reason why this would be the case, but potential conflicting classes may have had an impact on a students choice of laboratory time. However, the differences in pretest and posttest scores did not reach a level of statistical significance between groups. If the intervention of the small class group with personal attention from the teaching faculty had improved student learning, one would expect that both posttest scores and course grades might be significantly higher for the experimental group. Thus, at least in this introductory biology course taught with many active learning opportunities, a small-size lecture class and personal attention from teaching faculty did not significantly improve student learning.
The student satisfaction surveys did find some significant differences between the experimental small class group and the large lecture control group. More students in the experimental group thought that the number of students in the lecture portion of the small class was appropriate for learning and more students in the control group thought that the number of students in the lecture portion of the large class was distracting to learning. Thus the students did appreciate being in a smaller class to learn even if there was no evidence that their learning was actually enhanced by being in the smaller class. It is interesting to note that students in the experimental group appreciated learning about scientific method and applying physiological concepts that they achieved by conducting experiments and preparing laboratory reports significantly more than the students in the control group. An explanation for this difference could be that having the expert teaching faculty facilitating their work in the laboratory might have helped them understand physiological concepts better than having only a biology graduate TA in the lab. If simply being in the small lecture/laboratory with the teaching faculty did help them learn better (as they perceived), then the assessment tools used in the course must not have accurately evaluated enhanced long-term student learning. The number of students in the laboratory portions of the course were not very different, with 20 students in the experimental lab (only 18 were in the separate lectures due to scheduling conflicts) and a range of 9 to 18 students in the labs for the control group in the large lecture portion of the course. Thus it is difficult to explain why students in the experimental group appreciated the size of enrollment in their laboratory significantly more than the students in the control group.
Literature about the effects of class size in college courses on student learning and student preferences for courses highlights some interesting aspects. Litke (3) reviewed the literature on teaching and learning in large college classes and investigated student attitudes toward effective and ineffective teaching strategies in the large classes. The author states that many faculty members believe that increased class size equals decreased student learning and satisfaction. However, student views of large classes may differ from faculty perceptions. Students state that the quality of instruction (not the size) determines a successful class and that a good teacher can teach any size class (3). A second perception is that large classes need to be taught differently than small classes (3). To address this perception, Litke provides suggestions to faculty to make large classes "feel smaller." A final perception of faculty is that student ratings of instructors are lower in large classes; however, this perception is not necessarily true (3). Thus according to Litke, five key areas of concern about large classes are: their impersonality, the extent of active learning, how to solicit class participation, effects on student evaluation, and predominant reliance on lectures. All five of these areas are addressed in the article with helpful suggestions. In addition, student views on teaching and learning in large classes were solicited via surveys from 134 students in a course on communication theory at California State University at Northridge (Northridge, CA) (3). There was a clear preference among the students for smaller classes, but 33% of the students were favorable to large classes. Students reported that they can learn in large classes and that quality teaching is possible in large classes with numerous active and engaging learning opportunities.
Williams et al. (7) published an extensive meta-analysis of student performance on objectively scored general education tests compared with section size for 305 sections from 24 different courses with section sizes of 13 to 1,006 students at Brigham Young University. Only courses that met in a regular lecture format and had a common test across sections were included in the study. Fifteen different content areas were represented, and student performance on 16,230 tests was analyzed. Their results suggested that for college-level students, class size may have less effect on student learning than thought by some faculty. The data indicated that increasing class size from 30 to 40 to several hundred did not affect college student achievement. However, the authors did question whether there was a possibility that class size has less impact on student recall of facts than on student development of thinking and problem-solving skills. This possibility was not investigated or analyzed by the authors (7).
Other studies have analyzed college student preferences for small vs. large classes and how those preferences affect student ratings of faculty. Many faculty and departments feel that undergraduate students need to experience small classes sometime during their academic training; thus generally after the anonymity of the large first- and second-year classes, upper-division students take smaller classes. Feigenbaum and Friend (2) compared student preferences for small vs. large psychology classes at State University of New York at Stony Brook (Stony Brook, NY). They asked first-year compared with upper-division students to state preferences for 16 class structures that differed in class size (small with discussion or large without), workload (moderate or heavy), type of exam (multiple choice or essay), and average grade in class (C or B). They found that students taking large classes generally adapt to them and prefer them to small classes. In fact, in their study, upper-division students preferred classes with moderate workloads and easier grading, implying that workload and a good GPA become more important as students advance. Thus their results essentially contradicted the way courses are normally taught at the college level in that first-year students preferred small classes and upper-division students preferred large classes (2). While this may be an approach to education for numerous students, our goals have always been to interest students in lifelong learning and to help students learn physiological concepts by understanding instead of memorizing.
Toby (6) studied chemistry students in small vs. large classes at Rutgers (New Brunswick, NJ) to see if class size was related to student evaluations of faculty. Students (>35,000) overall ratings of instructors from 420 classes taught by 36 different professorial chemistry faculty over a 5-yr period were analyzed compared with class sizes that varied from a few to several hundred students. The student pool included majors and nonmajors, first-year students through seniors, and graduate students. For 25 faculty, the larger the class, the lower the instructor ratings; for 8 faculty, instructor ratings were independent of class size; and for 3 faculty there was no correlation between instructor rating and any tested variable. Thus class size was important for student ratings of some faculty and was irrelevant for others. Toby also noticed a time effect on instructor ratings for the teaching of several faculty in several large courses, indicating that teaching large classes successfully might require skills that some instructors have developed early in their careers and that others require more time to develop (6).
To evaluate agreement or disagreement between this study and the deleterious outcomes of large class size teaching proposed by Cuseo (1), we will clarify for which outcomes there may be new information from our study. In our study, comparing small vs. large classes for Cuseos eight deleterious outcomes reveals 1) increased faculty reliance on lectureour lecture component was the same; 2) less active student involvementall of our students do small group think-pair-share activities, etc.; 3) reduced frequency of instructor interaction with and feedback to the studentsTAs interact with both groups of our students but teaching faculty provide more face-to-face feedback to those in the experimental group; 4) lower depth of student thinking while in classhigher level active-learning activities found in both classes (but students may feel more or less vulnerable in the small class); 5) lower Blooms taxonomy level of learning objectives and learning strategiesour course and system learning objectives are mostly at the comprehension level or higher (see Fig. 1), student study strategies were not evaluated; 6) lower levels of academic achievement of studentsthe mean course grades were the same; 7) lower level of course satisfaction with learningour students in the small class appreciated the value of fewer students and our students in the large class thought there were distractions in the lecture hall; and 8) lower student evaluations at the end of the coursethis aspect was not evaluated using the standard University course evaluation forms; however, there were no significant differences in this on the custom-designed class satisfaction survey. Based on his analysis of the literature, Cuseo (1) discusses how to provide more effective education to todays undergraduates; what an optimal class size is; how administrative decision making can take into account enhancing student learning by providing a variation of class sizes to each student each term; providing instructional delivery resources to maximize small group and individual learning opportunities to students in large classes; and how institutional mission, priorities, and values might need to be readjusted to value teaching that enhances student learning.
In our study, the teaching faculty used the same lectures and the same active-learning activities in both the large lecture class with small separate laboratory sections taught by graduate TAs and the small group lecture/lab classes taught by a graduate TA assisted by the teaching faculty. Our results indicate that while the students may have appreciated that the size of the small class was appropriate for learning and the size of the large class was distracting to learning, there were no significant differences in either pre- vs. posttest results or course grades for the students in the experimental group compared with those in the control group. This could either mean that with active learning techniques, large lecture classes can "feel smaller" and thus enhance student learning just as well as small, personal classes, or that we studied the wrong parameters to identify differences in long-term understanding of physiological principles.
Acknowledgments
We greatly appreciate the contributions of the late Dr. Patrick Redinius to the experimental design and interpretation of this study.
Footnotes
Received for publication September 28, 2004. Accepted for publication February 5, 2005.
References
This article has been cited by other articles:
![]() |
R. G. Carroll, M. L. Matyas, A. E. Atwater, V. Doze, R. Faircloth, P. Finkenstadt, B. Goodman, E. J. Henriksen, B. Horwitz, R. Looft-Wilson, et al. APS undergraduate brainstorming summit report Advan Physiol Educ, December 1, 2007; 31(4): 380 - 386. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |