Adv Physiol Educ BIOPAC complete lab solutions
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Advan. Physiol. Edu. 28: 199-209, 2004; doi:10.1152/advan.00025.2004
1043-4046/04 $5.00
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (2)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Luckie, D. B.
Right arrow Articles by Krha, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Luckie, D. B.
Right arrow Articles by Krha, M.
ADV PHYSIOL EDUC 28:199-209, 2004
© 2004 American Physiological Society

TEACHING IN THE LABORATORY

Infusion of collaborative inquiry throughout a biology curriculum increases student learning: a four-year study of "Teams and Streams"

Douglas B. Luckie1,2, Joseph J. Maleszewski3, Sarah D. Loznak4 and Marija Krha1,2

1 Lyman Briggs School of Science, Michigan State University, East Lansing, Michigan 48825
2 Department of Physiology, Michigan State University, East Lansing, Michigan 48825
3 College of Human Medicine, Michigan State University, East Lansing, Michigan 48825
4 College of Osteopathic Medicine, Michigan State University, East Lansing, Michigan 48825

Address for reprint requests and other correspondence: D. B. Luckie, W-29 Holmes Hall, Lyman Briggs School of Science, Michigan State Univ., East Lansing, MI 48825-1107 (E-mail: luckie{at}msu.edu)


    Abstract
 TOP
 Abstract
 Introduction
 RESULTS
 DISCUSSION
 GRANTS
 REFERENCES
 
Are traditional laboratories in the core introductory biology courses teaching physiology majors the art and trade of science, or simply leaving them with a memory of trivial experiments done for unknown reasons? Our students, a population dominated by premed and physiology majors, think the latter and have encouraged us to challenge this model, and it turns out scientists and education researchers agree with our students (4, 31, 32). In an effort to remedy this, we began a long-term redesign of the introductory biology sequence to become what is now a sequence of inquiry laboratories we term "Teams and Streams" (TS). In these TS inquiry labs, student research teams pose a scientific question/hypothesis, propose an experimental design, perform multi-week investigations and then present their findings in various forms (web, interviews, and papers). The response to this classroom laboratory design has been overwhelmingly positive. In a qualitative study of student opinion (where 260 student responses were studied), surveys conducted at the end of semesters where traditional scripted labs were used (n = 70 comments) had predominately negative opinions (80% negative responses), whereas the reverse was true for students (n = 190 comments) who participated in courses using the TS inquiry labs (78% positive responses). In a quantitative assessment of content knowledge, students who participated in new TS inquiry labs (n = 245) outscored their peers in traditional labs (n = 86) on Medical College Admission Test-style standardized exams (59.3 ± 0.8% vs. 48.9 ± 1.3%, respectively; P < 0.0001). We believe these quantitative data support the qualitative findings and suggest the TS inquiry lab approach increases student learning.

Key words: laboratory; cooperative; undergraduate; research


    Introduction
 TOP
 Abstract
 Introduction
 RESULTS
 DISCUSSION
 GRANTS
 REFERENCES
 
SCIENCE IS CLASSICALLY defined as the pursuit of new knowledge and scientists practice this process every day by employing techniques (both conventional and novel) in their laboratories (28). However, when science students (especially in introductory courses) work in the classroom laboratory, they rarely experience this process (24, 27, 32, 39, 44). It is not unusual for a college freshman to change their science major after their first semester (20, 24, 44), reasoning, "I don’t think I could do that stuff, like in my 101 lab, for my career." It is difficult to explain to the student why the experience in that classroom lab has little in common with the fun in a real lab. The current standard of educating undergraduate students in the art of laboratory biology generally involves issuing a laboratory manual and charging the students with replicating a "science experiment" that thousands of other students have done before them (4, 36, 50). The assessment of learning that follows is often based on whether they replicated the experiment well or not and if they wrote a good lab report. The fact that hundreds of similar papers for each lab written by students from past semesters are floating around campus, further complicates this assessment. The thought behind this traditional teaching method is to expose students to a variety of techniques in the hopes they will come to understand and appreciate them later, but many of the students don’t stick around for "later" (24, 44).

In introductory biology classes in the Lyman Briggs School of Science at Michigan State University, our students have encouraged us to challenge (and indeed change) this model.1 When we asked students what they liked least about their laboratory experience we consistently received answers like: "labs are boring and time consuming." Students told us that it wasn’t how they imagined science would be (39). Upon reflection, we agreed that "real science" was very different then the way we taught it (24, 32, 38). Why couldn’t we teach all of the important techniques and allow them to think and problem solve like a real scientist, even at this introductory level?

On the basis of this feedback, we changed our classroom laboratory curriculum. Our goal was to allow students to develop a biological question and then devise a series of experiments that would enable them to gather evidence to support or refute their hypothesis (2, 11, 12, 21, 25, 26, 35). We also made it a goal to increase the cognitive level targeted by our assessments, which had previously been directed at assessing primarily the "Knowledge" level as defined by Bloom (3). New assessments were created with an eye to go beyond this level and perhaps approach Application, Analysis, and Synthesis (Table 1). We also strived to create a formula that followed the mantra, "Less Teaching, More Learning." We knew the new approach would have the best chance to be sustainable if we could decrease the workload of the teacher(s) while at the same time increasing the learning of the student (10, 43, 51). As we developed rigorous goals for the students’ experiments as well as their learning, we soon realized that the burden of this project would likely be too great for one student to bear alone (35, 49). With the help of cooperative learning experts like Karl Smith and others (19, 46), we decided that group work would give us more flexibility, be more like "real science," and enable us to raise the bar and expect a higher level of learning and research from the students (5, 8, 25, 26, 40). After all, scientists rarely work in isolation. What we strived to create were structured learning teams that experienced active and cooperative inquiry during independent research projects (13, 17, 47).


View this table:
[in this window]
[in a new window]
 
Table 1. Bloom’s taxonomy

 
Revisions in Curriculum
We started examining the traditional cookbook laboratory sequence first only in the Cell and Molecular Biology Course (Introductory Biology II), later these revisions were applied throughout the biology curriculum of Lyman Briggs, a residential college at Michigan State University (MSU).2 The innovations tested in this study were in the laboratory while the lecture was unchanged. The classroom laboratory had previously been divided into numerous 3-hour scripted lab experiments that students performed individually. The schedule of the laboratories mirrored that of the lecture topics and was just as brief and diverse. Although we, as instructors, "saw" the relationship between all the labs, the students did not (42, 44, 45, 49, 50). To them it was just a buffet of a different topic every week. The first few traditional labs were cell biology-related and dealt with macromolecules and carbohydrate chemistry, hormones and plant tissue culture, enzymes kinetics, and light and dark reactions in photosynthesis (Table 2). The labs during the second half of the semester were more molecular biology-related and had been recently revised to involve the students in a slightly more proactive version of learning standard techniques in molecular biology (Escherichia coli transformation, Plasmid miniprep, and DNA restriction analysis) (53). For the purposes of simplicity and space in this report, we will only focus on the first half of the semester, what we now call Stream I. For more information and details on the innovations beyond what is discussed here, view this website (http://surf.to/teamstreams/).


View this table:
[in this window]
[in a new window]
 
Table 2. Before: Traditional curricular design and assessment strategy of Introductory Biology before redesign

 
Developing Long-Term Independent Research Experiences, or "Streams"
Semesters at MSU are 15 weeks in length, so we decided to divide the laboratory sequence into two 7-week streams. In our revision of the laboratory curriculum of Stream I, we wanted students to choose their own topics and design their own long-term research projects (12, 15, 25, 26, 30, 36, 41, 47, 52). We decided the first stream would need 1 week of orientation (1516, 21, 28), followed by 6 weeks of laboratory time, in which the students would be exposed to new material, equipment, and techniques, and then implement them in their unique research projects. But how would we get students to learn proper techniques and still allow them independence?

For us, the answer was to divide the six weeks into three two-week blocks on each topic. The first week of each block is devoted to having the student group perform one of our best traditional cookbook labs on that topic, while the second week was reserved for independent research (Table 3). The traditional lab served to train the students in techniques and assays, and its results could be utilized as initial experiments (controls, in fact) for their independent investigations (1316, 21, 28). The second week was "open" and allowed students to apply the methods learned in the previous week to test their own research questions (1, 6, 7, 23). For example, in the first traditional lab week, the student team would follow a lab guide and perform various chemical assays on carbohydrate solutions of glucose, fructose, xylose, etc. They would test known sugars for structural characteristics like aldehyde vs. ketone groups, polysaccharide vs. monosaccharide status etc, as well as then characterize an unknown sugar. After this traditional lab, during week 2, students would create their own protocols and plans and could utilize any of these techniques/assays (or find/create their own) to perform experiments to help answer their research question. The equipment and reagents used in cookbook labs are all that were made available, yet students were permitted to do more with the help of scientists on campus. Time was not limited except by the due date of each draft of their paper. Thus each student group would follow a structured schedule where they complete a traditional lab on carbohydrate macromolecules, followed by a week of independent research, next perform a traditional lab on photosynthesis and a week of independent inquiry, and again, one week of a structured lab on enzymes, followed by an open research week (Table 3). While this restructuring of the curriculum was laudable by itself, the most important requirement we implemented was that all the different experiments performed and the manuscript created by the research team, needed to focus on just one research question (and a first draft of the entire research plan for all six weeks be submitted at the end of the first week of class!). Some of the 130 titles of student research plans include: "Differences in Carbohydrates, Polyphenoloxidase, and Photosynthesis Between Pinus strobus and Malus domestica"; "The Chemical Difference Between Pancrease and Lipram"; "A Description of How a Pluot is Similar to a Plum Through Carbohydrate, Pigment and Enzyme Activity Tests." (See more online http://surf.to/teamstreams/)


View this table:
[in this window]
[in a new window]
 
Table 3. After: TS Inquiry curricular design and assessment strategy of Stream I after redesign described in this study

 
Creating Cooperative Groups With Individual Roles, Also Known As "Teams"
During the first day in the classroom laboratory, students meet their group and immediately choose roles for the rest of Stream I. Although each student in the group (typically 4 people) is expected to help out in all tasks to complete the assignment, each student has a primary role. These roles were titled: Primary Investigator (PI), Protocol Expert (PE), Data Recorder (DR), and Laboratory Technician (LT). For example, the PI is responsible for primary organization of the team as well as oversight of the experiment as a whole. It is the job of the primary investigator to be responsible for implementing troubleshooting techniques throughout the investigations. The PE, on the other hand, is responsible for overseeing the creation of scientific protocols for each week’s independent investigation (what experiments/steps you plan to do) as well as is responsible for construction of websites (when necessary), and other computer related activities and so on. These individual roles help to organize the team and give each person a job in the group (5, 19, 46).

In addition, to foster group identity and ownership, they name their teams and are given a permanent home in the lab (5, 19, 34, 46). We wanted their lab bench to mimic those in our own laboratories, in both appearance and functionality, which is also a recommendation of the NRC and others (4, 31, 32, 48, 54). They were provided with their own lab bench for the semester and appropriate modern molecular biology lab instruments (including a computer, digital camera, microfuge, pipetmen, vortex, spectrophotometer, etc.). These benches were essentially "time shares" where during any particular assigned lab time the same students returned to their bench, yet during other labs that bench was another groups’ property.

Assessment of the student group’s performance in their research project was designed, like in real science, to be highly dependent on their capacity to communicate their findings via a publication. In addition to attendance, the students were charged with presenting their research via interviews and authoring of several drafts culminating in the submission of a final manuscript formatted for publication in a scientific journal of their choosing. This process required the groups to come together and prepare for labs, record data diligently during labs, study the prose used in scientific journals (i.e., American Journal of Physiology, Nature, Journal of Molecular Biology, etc.) and then emulate it. The difficulty in grading a group project is, of course, dissecting out individual performance (5, 19, 46). How do we assign individual grades from a group assignment? Not unlike the division of the group into specialty roles that were responsible for particular lab tasks (above), different members in the group were also assigned the responsibility for authoring different sections of the paper for each draft. This "individual authorship" responsibility rotated, i.e., for Draft 1, the PI authored the Introduction and Methods, for Draft 2, PI authors/revises Results and Figures, etc. Hence each student is responsible for their sections as well as the paper as a whole. As a final method of getting the group involved in all the sections, we require that each student sign a "group responsibility contract" attesting to the fact that each of them has read through, and edited the entire paper to their satisfaction. They agree that it is complete, accurate, original, and cohesive and that they accept their grade will be a 50:50 mix of their individual section and the full manuscript scores.

Revisions In Assessment
As indicated above, changes in the way the students were taught in the entire course were accompanied by changes in the way student learning was assessed (Table 3). New assessments such as: interviews, concept mapping, and peer reviews were introduced in an attempt to evaluate student learning at higher cognitive levels than previously (1, 5, 3133, 37, 48). In addition, the quizzes and exams were modified to include more short answer responses rather than just multiple-choice responses. Evaluation of a student’s laboratory research results as well as their understanding has always been dominated by writing in our courses, yet how we implemented writing assignments changed. We will specifically focus on those revisions that directly impact the laboratory portion of the course in this section (writing, interviews, and peer review).

Scientific Writing
In our old curriculum, that was replete with cookbook laboratories, student performance was primarily assessed through individual lab reports. Since all lab reports were written nearly weekly and individually about each topic, there were numerous reports to grade every week. In addition, because many lab reports from past semesters were available on campus, much effort had to be focused on looking for signs of plagiarism. As a result of both the magnitude of papers and concern for plagiarism, the scoring of each report was rather superficial and thus the formative feedback and evaluation of student writing and learning was minimal. Under these circumstances the students had to work hard to create numerous reports about the same topics their roommate and older sibling may have done before (39, 44, 50), student comment: "I’m just doing the exact same thing every student did before me." Simultaneously, much of the instructor’s time and effort was wasted trying to detect plagiarism (which is now admittedly less of an issue with services like www.turnitin.com). Clearly this was not the optimal scenario in assessing learning, but we don’t consider it unusual in the realm of introductory biology at large universities (4, 31, 32).

In our new curriculum, student groups write only one paper about Stream I and only about their research project. They are not expected to write anything about the cookbook labs they perform unless it is relevant to their own research (i.e., as control experiments). In addition, instead of writing multiple reports about different topics, the student group composes multiple drafts of their manuscript for one topic, their own. This approach allows them to choose what themes and subjects to discuss in their own writing, and to experience multiple drafts with revisions suggested by the instructors and their peers (through peer review). In addition, the possibility of plagiarism diminishes significantly. Given that every student group’s research topic tends to be unique, all the resulting manuscripts are quite diverse. Students also create a final website to report their findings, and next semester’s students read the research published by prior cohorts for inspiration, but because that work has already been done, new projects must be developed (just like in the real research world).

In the first week of the semester, the student groups write about their research projects and initially submit a "Draft 1." In this draft, the students spell out what they propose to do in their six-week research project and what results they predict they will find from the experiments they plan to do on the topic. This Draft 1 serves as a proposal but is written in the format of a final manuscript being prepared for publication. In this draft, the RESULTS section includes the students’ predictions, and the DISCUSSION contains their interpretations of the expected results. Of course, the above necessitates that students learn about scientific writing. This is done with a weekly dissection of primary literature in recitation section of the course. We feel the first week of the semester is the ideal time to place this large burden on the student group. It requires them to read all the labs, meet and discuss potential research projects, study up on the topic, take on roles in the group and write and edit a full manuscript. This initial workload occurs right when the rest of classes on campus are still just reading through their syllabus in lecture and present no competition for student time and effort. In fact, we have found that if the group workload at the start of the project isn’t heavy, overachievers will not see the value of working in a group and will start asking for the opportunity to do the project solo (19, 25). Front loading the course in this manner also helps prepare student groups for the research project well in advance (15, 32). It requires students to page-through the manual and plan experiments thus organizing the content/concepts in their mind before beginning their lab experience (2, 10, 11, 28, 29, 37, 43).

We believe this approach has more creativity, collaboration, better writing experience and is more like real science (12, 17, 25, 26, 30, 31, 32). We consider it closer to the optimal scenario and believe it is somewhat unique in the realm of introductory biology at large universities (4, 31, 32). We, as instructors, also find it less burdensome to run this type of curriculum then the traditional one (45, 51). Scientists need no special training for this sort of teaching since it is just like the work they do in their own laboratory. Hence, it succeeds in supporting our mantra of "Less Teaching, More Learning."

Student Interviews
After student research teams have completed and submitted their Draft 1 manuscript, we require the group to pass a formal interview with the professor before being allowed to proceed in the laboratory. All four students in a group schedule a 60-minute meeting with the professor to sit down to discuss their idea and plans (28). This event by itself is amazing. The fact that this new curriculum allows an instructor to have small group meetings with every student in the course is quite novel (2, 12). Previously our class was composed of at least 100 individuals where there really was no way to set up 100 meetings. But now the class is composed of 25 teams and over about the first 10 days of the course, the professor gets to meet and discuss research with all of his or her students.

The interviews are often very predictable. In most cases, while the group is rather excited about the topic they have chosen to investigate, they need to think about what is practical in the time allotted, what controls and replicates are needed, and so on. Also any supplies they need are identified and the group is encouraged to find and buy simple things on their own (groceries, plants, etc.). Once a group has "passed" the interview, they are given an interview receipt with comments that will then alert TAs in the lab that this group is permitted to begin their independent research. These interviews go on during all of week 2 (when lab is just a traditional cookbook experiment) and into week 3 as the deadline for their first independent research day approaches. This moment, early in the semester, is once again a time in the course that helps the student see that the activities of this class are going to be different then what they may have expected. Sitting down with the professor and discussing their scientific research project is an excellent model of what should happen in introductory biology (4, 48, 52). We believe this approach moves closer to the optimal experience for undergraduates and is quite exciting for the instructor (another experience that may be too rare). We also believe interviewing is perhaps one of the best assessment approaches and this gives the students an opportunity to go beyond the Knowledge level as defined by Bloom and approach Application, Analysis and perhaps Synthesis levels (Tables 13).

We have incorporated several diverse formal assessments that attempt to provide both the student and the instructor with periodic (formative) feedback, as well as final (summative) evaluation of learning. These assessments work to assay both the individual’s and group’s ability to implement the scientific method. Unfortunately, neither in the previous traditional laboratory sequence (all cookbook labs), nor in the new TS Inquiry sequence have we directly assessed skills or mastery of techniques. However, we are currently working on ways to add some simple performance-based assessments ("mini-practicals") to better evaluate individual accountability in learning how to operate equipment and solve basic questions in the laboratory. In addition to these formal assessments, the teaching assistants provide valuable informal assessments through their questions and mentoring in the lab that dynamically evaluate teams and provide continuous personalized feedback. In this paper, we will not attempt to consider the numerous valuable learning moments (and assessments) that occur in the day-to-day operation of the classroom laboratory but our teaching assistant to research group ratio in the lab often approaches 1:1. Hence our TAs tend to "adopt" and mentor a student research group, knowing their project, their successes/failures, and their aptitude which helps to further personalize the teaching and make it closer to Socratic (45).

Peer Review of Manuscripts
After student groups submit Draft 1 of their research paper, feedback comes from the instructor level (i.e., the Prof). Yet, in addition to feedback from the Instructor, Draft 2 is also peer reviewed by each individual in another research group. The reviewers are graded upon how well they follow the guidelines on a peer-review worksheet (that requires them to evaluate both the science and the writing), yet their evaluation of Draft 2 is not used in the grading of the manuscript. As they follow the format of the peer-review worksheet, they are asked to read a section of the paper and then briefly explain what the research question is, or how the method is being done, etc. When they review either a poorly constructed draft or an excellent one, they gain an opportunity to reflect on their own experiment and writing and how well it might hold up under the same scrutiny. Of course, they soon find out when receiving the reviews of their own paper. This peer review process is quite effective at both alerting a student to problems in their own manuscript, and allowing a student to view another group’s writing/thinking (and thus become more reflective about their learning). If a student experiences only reading and rereading his or her own paper, eventually it becomes difficult to see what needs revising. In addition, having students review each other’s papers may once again succeed in supporting our mantra of "Less Teaching, More Learning." We believe the peer-review assignment also helps give the students an opportunity to go beyond the Knowledge level as defined by Bloom (3) and approach Analysis and perhaps Evaluation levels (Tables 1 and 3).


    RESULTS
 TOP
 Abstract
 Introduction
 RESULTS
 DISCUSSION
 GRANTS
 REFERENCES
 
We have attempted to assess the impact of this new curriculum on student learning with both qualitative and quantitative approaches. In designing this study, some of the questions we heard from our colleagues in the field of education and human subjects were qualitative and general: e.g., "Have you asked these students what they think?" On the other hand, some of the questions we heard from our science colleagues were more quantitative and specific: e.g., "Will these students do better on the MCAT?"

Qualitative Survey Results
To assess the students’ perspective on the course’s laboratory, we studied MSU Student Instructional Rating System forms from semesters using the traditional laboratories compared to those implementing the new Teams & Streams (TS) approach. Here are some of the comments we routinely read in student feedback forms in semesters where the traditional laboratories were used.

In semesters utilizing the TS inquiry laboratories, we still found some brief negative reviews, but overall student feedback has changed for the better in tone and frequency.

In addition to comments from student feedback surveys, we studied the frequency of positive (+) vs. negative (–) feedback on the topics of the "lab" or "class" from student surveys over semesters using traditional structured laboratories versus those semesters using TS (Table 4). First, not surprisingly, we found semesters using the TS approach had a greater number of student comments concerning the topic of the laboratory: 74 comments from TS students vs. 5 from traditional students. In addition TS students made a greater number of positive comments about the laboratory portion of the class: 78% positive vs. 20% from students who performed traditional labs. Interestingly, while the students didn’t like the traditional labs, in those same semesters the data indicates the students did like the topic of biology and their class. Some 80% of the comments about the "class" (lecture/class/teacher) were positive. These student responses concerning the "class" were similar to those from students who participated in the TS courses (90% positive).


View this table:
[in this window]
[in a new window]
 
Table 4. Student feedback about laboratory and classroom

 
Quantitative Results
In response to the data our scientific colleagues requested, we developed and administered a standardized exam (called the MAT) during the final week of five semesters from 2000–2003. Our MAT exam is built from Medical College Admissions Test (MCAT) practice test questions developed, validated and purchased from the Association of American Medical Colleges. This MCAT-style exam was a 40-question multiple choice test, comprised with relevant and rich passage-style questions (9, 18, 22, 29). Review it online (http://surf.to/teamstreams/).

Students from semesters that used the TS inquiry approach in the classroom laboratory have significantly higher scores on the MAT exam (Figs. 1 and 2). As shown in Fig. 1A, the average TS student MAT exam score was 60% (S’01= 56.9 ± 1.3, n = 80; F’02= 61.5 ± 1.5, n = 77; S’03= 59.5 ± 1.5, n = 88), while that of traditional students was 50% (S’00= 49.4 ± 1.6, n = 55; F’01= 48.3 ± 2.2, n = 31).



View larger version (16K):
[in this window]
[in a new window]
 
Fig. 1. Medical Assessment Test (MAT) student score results from five sampled semesters. A: in chronological order (left to right) is a comparison of the average class score on the MAT post-test for semesters Spring 2000 (n = 55), Spring 2001 (n = 80), Fall 2001 (n = 31), Fall 2002 (n = 77), and Spring 2003 (n = 88). Course instructors varied in semesters shown and these results are from semesters in which the MAT instrument was used as a summative evaluation in the last week of classes. The teams and streams (TS) laboratories were first introduced in Spring 2001 and in Fall 2001 the instructor reverted to the traditional labs. TS laboratories were used again in Fall 2002 and Spring 2003. Light gray shading represents traditional labs and dark gray shading indicates TS labs. Error bars are means ± SE. B: comparison of the means and 95% confidence intervals of the same data with an expanded y-axis. x- and y-axes are the same data as in Fig. 1A. Letters A–E are semesters Spring 2000 (n = 55), Spring 2001 (n = 80), Fall 2001 (n = 31), Fall 2002 (n = 77), and Spring 2003 (n = 88), respectively. A and C are significantly different than B, D, and E, ANOVA. P < 0.0001.

 


View larger version (28K):
[in this window]
[in a new window]
 
Fig. 2. MAT results from different subtopics of the exam from five sampled semesters. In chronological order (left to right) is a comparison of the average class score on the MAT subcategories and the number of questions for each category is indicated as (n). The categories are as follows: "DNA" stands for DNA structure and function, n = 10 questions; "CS&F" is cell structure and function, n = 16 questions; "RESP" is respiration, n = 4 questions; "ONCO" is oncogenes and cancer, n = 6 questions; and "MICRO" stands for microbiology, n = 4 questions. Within each subtopic are the post-test scores for students who took exam during sampled semesters: Spring 2000 (n = 55 students), Spring 2001 (n = 80 students), Fall 2001 (n = 31 students), Fall 2002 (n = 77 students), and Spring 2003 (n = 88 students), respectively. The TS laboratories were first introduced in Spring 2001 and in Fall 2001 we reverted to the traditional labs. TS laboratories were used again in Fall 2002 and Spring 2003. Light gray shading represents traditional labs and dark gray shading indicates TS labs. Error bars are means ± SE.

 
In pooled comparisons, students who participated in new TS inquiry labs (n = 245) outscored their peers in traditional labs (n = 86) on MCAT-style standardized exams: 59.3 ± 0.8% vs. 48.9 ± 1.3%, respectively (P < 0.0001). Hence, statistically the pooled TS data sets are significantly higher than the traditional data sets. ANOVA analysis of data from individual semesters in 5 separate sets (not pooled) also found a significant difference between TS student and traditional student scores P < 0.0001. Yet, the 95% confidence intervals show different semesters using TS are not statistically different from each other (the same for the two traditional semesters) (Fig. 1B). The performance of students from TS courses increased and moved the MAT scores distribution curve to the right from a prior distribution that skewed and gathered students at a lower performance level (Fig. 3).



View larger version (21K):
[in this window]
[in a new window]
 
Fig. 3. MAT performance distribution comparing TS students (n = 245) vs. pooled traditional lab students (n = 86) from the semesters sampled. To compare the score distribution of the 86 students sampled from classes utilizing traditional cookbook labs to the 245 students who participated in classes utilizing the TS inquiry labs, the number of students was represented as the percentage of total and the MAT scores were sorted into bins of those who scored between 20.01–25% (label "25"), 25.01–30% ("30"), 30.01–35% ("35"), and so on. No students scored lower than a 20.01% on the MAT exam. Students in courses with traditional labs (labeled "students") are represented by light gray shading and those in courses with TS labs ("TS students") are indicated by dark gray shading.

 

    DISCUSSION
 TOP
 Abstract
 Introduction
 RESULTS
 DISCUSSION
 GRANTS
 REFERENCES
 
While the curricular revisions reported in this study are not unique among reports in the literature, our scientific colleagues have yet to be convinced. The majority of undergraduate laboratory experiences in the US are traditional scripted cookbook ones (4, 3132). We hope as new publications report more assessments of their curricular interventions via both qualitative and quantitative tests, our peers in science may begin to examine these findings with more interest.

Qualitative Findings
Human subjects studies have several variables and are quite difficult to control, thus in our experimental design to remove the instructor-dependent variable we utilized three experienced professors who have won student and university teaching awards in varying sequence. We were not able to perform interviews (55), yet over the four years we tracked student opinion using an end-of-course evaluation process. In addition to the study of specific comments from student surveys, we recorded the frequency of positive and negative feedback on the topics of the lab or class.

As indicated earlier, students who participated in the TS inquiry laboratories had many more positive comments about the laboratory portion of the class: 78% positive compared with 20% positive from students who participated in traditional labs. Yet, the same students who did not enjoy their traditional cookbook labs, in fact enjoyed their instructor and the rest of their biology class. We believe this suggests these students were not unusually resistant to the topic of biology, and in fact recognized that they experienced an excellent course but for the cookbook laboratories. Their written comments sometimes verbalized this opinion. On the other hand, we noticed a trend where a significant percentage of students from the traditional classes did not include any written comments whatsoever on their surveys. They did fill out Leikert scales in response to specific questions on the survey, but wrote no explanations in the large area soliciting extended responses. The fact that this phenomenon did not occur with students from TS inquiry courses may indicate the laboratory experience engaged the students more and made them more active participants with a feeling of ownership in the course.

Quantitative Findings
In designing this study, we believed that to convince our colleagues in physiology to engage in significant change, longer studies over multiple semesters and with "content" exams would be necessary. While better content exams and better experimental designs will be necessary to convince scientists that "it works," we consider this study a first step in that direction. As mentioned earlier, our MAT exam is built from Medical College Admissions Test (MCAT) practice test questions. The questions were selected to match topics from lecture, but they do have a great deal of overlap with the topics relevant to lab. While these questions do test at the lower end of the Bloom taxonomy (3), we predicted better learning at the higher levels would also lead to more meaningful learning at the basic levels. In addition, in our case the MAT also had an affective element. Our freshman are motivated to make a real attempt to do well on MCAT questions, given the majority are premed. We also designed this study to have more than just pre- and post- intervention data. After we fully implemented the first TS inquiry labs in Spring of 2001, we reverted to traditional labs when teaching the same course in Fall 2001. The TS inquiry approach was then fully implemented again and has continued as the default curriculum ever since. Hence, we believe the experimental design and the resulting data are more robust as a result.

We found that the students that participated in the TS inquiry laboratory have significantly higher scores on the MAT exam. While this may not seem surprising, the capacity to detect an increase in student performance on content exams is not common in the literature. Education researchers often must be satisfied to report that their innovations do not have a negative impact on the performance of students in the experimental section (i.e., no significant difference). In our findings, both with individual semester and pooled comparisons, students who participated in new TS inquiry labs outscored their peers in traditional labs on MAT exams (pooled results: 59.3 ± 0.8% vs. 48.9 ± 1.3%, respectively; P < 0.0001). We believe these quantitative data support the qualitative findings and suggest this TS inquiry lab approach increases student learning. The fact that our TS students performed better on knowledge and application-level questions from the MCAT is good, yet we predict the greatest separation would occur at questions directed to higher cognitive levels (54). This has yet to be demonstrated and would require better instruments and ideally expert panel interviews like those described by Wright et al. (55). Although we have not yet developed an exam to assess experimental design and critical thinking skills (we are reviewing a quantitative reasoning exam developed at James Madison University) our direct assay of content knowledge still shows a respectable increase in student learning.

Less Teaching, More Learning?
We define our use of the term "less teaching" as moving the burden of active effort from the teacher to the student. Given that active and collaborative construction of knowledge "works" (19) and represents a student-centered classroom, having instructors do all the work does not make sense. Laboratory instructors in particular can spend numerous hours before and after the 3-hour cookbook lab, preparing for and then completing the "research" of the students. The evidence suggests this scenario results in both more effort by the instructor and less learning by the students (19). In the lecture setting the paradigm is for the instructor to actively engage and perhaps entertain passive students. Engaged instructors continually ramp up their effort to increase learning in their classroom, with good results, yet we believe eventually this high level of effort cannot be maintained (45). Thus in our revisions we applied the cognitive and educational knowledge in the literature to seek a synergism between constructivism/active learning and the practicalities of instructor time and effort. The goal of our design is that the student does more of the work, and as a result, does more learning.

We believe this simple TS inquiry format is modular and adaptable to any other laboratory topics or science disciplines. Other instructors could just pick their own favorite labs and proceed. Of course, there is a good amount of organization to be done before the student research projects in the laboratory begin. Teams have to be generated, students have to be mandated to read the laboratory manual, teams need to be helped by instructors in coming up with ideas for their independent investigations and so on. Even so, once you become accustomed to the preparation necessary, we believe this approach fulfills the mantra of "Less Teaching, More Learning." We found the day-to-day operation of the laboratory to be much easier and even less costly than the traditional "different laboratory each week" paradigm (53).

Controlled Chaos
The laboratory section of a science course must have originally been designed to be an innovative "active-learning" section for science students. The cookbook or scripted labs themselves likely began as adventurous inquiry experiences that evolved to be cookbook because that was the way to be sure the lab "worked" every time. We believe for meaningful learning to occur, the learners must be confronted with events that shake loose the naive ideas or concepts the students already embrace (1, 4, 5, 11). Chaos is critical. Instructors need to resist the temptation to fix the experiment for the student, or fix the lab so it works perfectly. Just as veteran instructors know it is best to answer a student’s question with another question, the laboratory should require increasingly greater thinking to succeed. The students will naturally desire ease in the lab and for experiments to succeed every time (so do scientists), but the real learning occurs when the experiment fails (2, 12, 24, 32). This TS inquiry approach is designed to create a safe environment for controlled chaos. We value when a student experiment fails and use it as our opportunity to help them troubleshoot and revise their plans. In our experience, the students that learn the most and really master the critical thinking and techniques are the ones that fail initially.

On a related topic, we believe that student potential has been far underestimated by university instructors (25, 38, 50). At first, we were apprehensive that it would be too challenging for a team of students who had never worked together to produce a rough draft of their final paper (which included "predicted" results and interpretations) during the first week of classes. But, much to our surprise, the students not only rose to the occasion, but came up with ideas for research projects that we could have only dreamed of (see list of some research project titles, or view a documentary film online http://surf.to/teamstreams/).

We claim the success of this curriculum is also evidenced by the increased complexity of our student’s experimental design, data analysis, and primary literature cited. This is showcased by the examples where colleagues in the Department of Physiology as well as across campus to use additional expertise, equipment and assays to answer their research questions. Year after year, with every form of assessment we use, our data and experience supports university students can do it all. Our teaching assistants see a significant change in the way students talk about their research and even the laboratory equipment in the room. We believe the students have made a personal connection to the science, in a way such that it isn’t just something to be memorized for a quiz, but rather is a tool that helps them answer their own questions (1, 5, 11, 33).

What We Have Learned
Challenging introductory biology courses represent our best chance to prepare students before they enter the upper-level courses of the physiology sequence. Students are ready to do amazing things when they come to "college"; if we don’t challenge them early and often, they quickly "learn" that classes in college are no different than high school, just more facts to memorize and forget (4, 39, 45, 50). We conclude that bringing "activity" back to the laboratory portion of a science course in the form of inquiry does increase learning in many domains (5, 11, 35, 36). The revised curriculum also changed the attitude of students and instructors alike. Another group that benefits from the TS inquiry approach is, in fact, the teaching assistants (42). They learn quite a bit more about teaching and about the process of science in this new format than in the traditional one. Both groups find the laboratory portion of the courses more relevant and like "real science" because it is real science (2, 12, 13, 54). The large class size does not impede the use of this approach; in fact, this approach allows large classes to shrink fourfold through the use of groups. At large research universities like MSU, this approach in the classroom laboratory segues very nicely into the undergraduate research experiences available across campus in the many laboratories (24, 32, 44). This TS inquiry curriculum serves nicely to move students from a comfortable zone existing as anonymous passive "receivers of facts" to a less comfortable domain where they are active "investigators of ideas."


    GRANTS
 TOP
 Abstract
 Introduction
 RESULTS
 DISCUSSION
 GRANTS
 REFERENCES
 
This work was supported by Cystic Fibrosis Foundation Grant CFFPF-LUCKIE98I0 (to D. B. Luckie) for our physiology cystic fibrosis research program and by Grant ASA-0206924 (to D. B. Luckie) from the National Science Foundation for our education research program.


    Acknowledgments
 
We thank Ashish Shah and Drs. John Wilterding, Jim Zablotny, Jim Smith, Chuck Elzinga, Diane Ebert-May, Merle Heideman, Joyce Parker, John Merrill, Janet Batzli, Karl Smith, Seth Hootman, Tom Adams, Mimi Sayed, and Duncan Sibley for helpful discussions about teaching and learning and assistance during this study. We also thank the many teaching assistants who promoted and implemented these renovations in curriculum and made a fantastic environment for learning in the classroom laboratories.


    Footnotes
 
1 Lyman Briggs School of Science is a residential undergraduate science program established at Michigan State University in 1967. It is a residential college modeled after those at Oxford University that has a focus of educating undergraduates in a "liberal science" curriculum defined as a solid foundation in the sciences and a significant liberal education in the history, philosophy, and sociology of science. Back

2 Introduction to Cell and Molecular Biology is a five-credit sophomore-level course. It is the second in a core two-semester sequence for science majors (and the last before a two-semester physiology sequence). It is taught in sections of ~100 students with accompanying recitation and laboratory sections led by the professor or teaching assistants. Students attend two lectures, one recitation (50 minutes each), and two laboratory sections (6 hours) each week. Back

Received for publication June 18, 2004. Accepted for publication August 30, 2004.


    REFERENCES
 TOP
 Abstract
 Introduction
 RESULTS
 DISCUSSION
 GRANTS
 REFERENCES
 

  1. Ausubel D. The Acquisition and Retention of Knowledge: A Cognitive View. Boston, MA: Kluwer, 2000.
  2. Baxter-Magolda MB. Creating Contexts for Learning and Self-Authorship. Nashville, TN: Vanderbilt University, 1999.
  3. Bloom BS (editor). Taxonomy of Educational Objectives: Book 1, Cognitive Domain. New York: Longman, 1956.
  4. Boyer Commission on Education of Undergraduates in the Research University. Reinventing Undergraduate Education: A Blueprint for America’s Research Universities. Washington, DC: Carnegie Foundation for the Advancement of Teaching, 1998.
  5. Brown AL and Campione JC. Guided discovery in a community of learners. In: Classroom Lessons: Integrating Cognitive Theory and Classroom Practice, edited by McGilly K. Cambridge, MA: MIT Press, 1994, p. 229–270.
  6. Chaplin SB. Guided development of independent inquiry in an anatomy/physiology laboratory. Adv Physiol Educ 27: 230–240, 2003.
  7. Chapman BS. Emphasizing concepts and reasoning skills in introductory college molecular cell biology. Int J Sci Educ 23: 1157–1176, 2001.
  8. Driver R, Asoko H, Leach J, Mortimer E, and Scott P. Constructing scientific knowledge in the classroom. Educ Res 23: 5–12, 1994.
  9. Ebert-May D, Batzli J, and Lim H. Disciplinary research strategies for assessment of learning. Bioscience 53: 1221–1228, 2003.
  10. Felder RM and Brent R. Navigating the bumpy road to student-centered instruction. Coll Teach 44: 43–47, 1996.
  11. Fosnot CT. Constructivism: a psychological theory of learning. In: Constructivism: Theory, Perspectives and Practice Teachers, edited by Fosnot CT. New York: College Press Columbia University, chapt. 2, 1996, p. 8–33.
  12. Fisher KM. Inquiry teaching in biology. In: Inquiring Into Inquiry Learning and Teaching in Science, edited by Minstrell J and van Zee EH. Washington, DC: American Association for the Advancement of Science, 2000, p. 258–280.
  13. Goodwin L, Miller JE, and Cheetham RD. Teaching freshmen to think. Does active learning work? Bioscience 41: 719–722, 1991.
  14. Grant BW and Vatnick I. A multi-week inquiry for an undergraduate introductory biology laboratory. J Coll Sci Teaching 28: 109–112, 1998.
  15. Green WJ, Elliott C, and Cummins RH. "Prompted" inquiry-based learning in the introductory chemistry laboratory. J Chem Educ 81: 239–247, 2004.
  16. Halpern DF. Thought and Knowledge: An Introduction to Critical Thinking. Mahawah, NJ: Lawrence Erlbaum Assoc., 1993.
  17. Heady JE. Teaching embryology without lectures and without traditional laboratories–an adventure in innovation. J Coll Sci Teaching 23: 87–91, 1993.
  18. Hestenes D, Wells M, and Swackhamer G. Force concept inventory. Physics Teacher 30: 141–158, 1992.
  19. Johnson DW, Johnson RT, and Smith KA. Active Learning: Cooperative Learning in the College Classroom. Edina, MN: Interaction Book, 1991.
  20. Kahle JB and Lakes MK. The myth of equality in science classrooms. J Res Sci Teaching 20: 131–140, 1983.
  21. King A. Inquiry as a tool in critical thinking. In: Changing College Classrooms: New Teaching and Learning Strategies for an Increasingly Complex World, edited by Halpern DF and Associates. San Francisco, CA: Jossey-Bass, 1994, p. 13–38, 1994.
  22. Klymkowsky MW, Garin-Doxas K, and Zeilik M. Bioliteracy and teaching efficacy: what biologists can learn from physicists. Cell Biol Educ 2: 155, 2003.
  23. Kolkhorst FW, Mason CL, DiPasquale DM, Patterson P, and Buono MJ. An inquiry-based learning model for an exercise physiology laboratory course. Adv Physiol Educ 25: 45–50, 2001.
  24. Krajcik J, Blumenfeld P, Marx R, and Soloway E. Instructional, curricular, and technological supports for inquiry in science classrooms. In: Inquiring Into Inquiry Learning and Teaching in Science, edited by Minstrell J and van Zee EH. Washington, DC: American Association for the Advancement of Science, 2000, p. 283–315.
  25. Lawson AE, Rissing SW, and Faeth SH. An inquiry approach to nonmajors biology. J Coll Sci Teaching 19: 340–346, 1990.
  26. Maret TJ and Ziemba RE. Statistics and hypothesis testing in biology. J Coll Sci Teaching 26: 283–285, 1997.
  27. McKeachie WP, Pintrich L, Yi-Guang, and Smith D. Teaching and Learning in the College Classroom: A Review of the Research Literature. Ann Arbor, MI: Regents of the University of Michigan, 1986.
  28. Modell HI. Preparing students to participate in an active learning environment. Adv Physiol Educ 270: S69–S77, 1996.
  29. Mulford DR and Robinson WR. An inventory for misconceptions in first-semester general chemistry. J Chem Educ 79: 739–744, 2002.
  30. Myers MJ and Burgess AB. Inquiry-based laboratory course improves students’ ability to design experiments and interpret data. Adv Physiol Educ 27: 26–33, 2003.
  31. National Research Council. How People Learn: Brain, Mind, Experience, and School: Expanded Edition, edited by Bransford JD, Brown AL, and Cocking RR. Washington, DC: National Academy Press, 2000.
  32. National Research Council. Bio 2010: Transforming Undergraduate Education for Future Research Biologists. Washington, DC: National Academy, 2003.
  33. Novak JD, Mintzes JJ, and Wandersee JH. Learning, teaching and assessment: a human constructivist perspective. In: Assessing Science Understanding: A Human Constructivist View. edited by Mintzes JJ, Wandersee JH, and Novak JD. San Diego: Academic, 2000, p. 1–13.
  34. Ortez RA. Investigative research in nonmajor freshman biology classes. J College Science Teaching 23: 296–300, 1994.
  35. Osbourne R and Wittrock MC. The generative learning model and its implications for science education. Studies Sci Educ 12: 59–87, 1985.
  36. Pintrich PR. A process-oriented view of student motivation and cognition. In: Improving Teaching and Learning through Research: New Directions for Institutional Research, edited by Stakr J and Mets L. San Francisco: Jossey Bass, vol. 57, 1988, p. 65–79.
  37. Posner GJ, Strike KA, Hewson PW, and Gertzog WA. Accomodation of a scientific conception: toward a theory of conceptual change. Science Education 66: 211–227, 1982.
  38. Pukkila PJ. Introducing student inquiry in large introductory genetics classes. Genetics 166: 11–18, 2004.
  39. Rigden JS and Tobias S. Point of view: too often, college-level science is dull as well as difficult. Chronicle Higher Education, A52, 1991.
  40. Ritchie D and Volkl C. Effectiveness of two generative learning strategies in the science classroom. J Sci Mathematics Educ 100: 83–89, 2000.
  41. Rivers DB. Using a course-long theme for inquiry-based laboratories in a comparative physiology course. Adv Physiol Educ 26: 317–326, 2002.
  42. Russell CP and French DP. Factors affecting participation in traditional and inquiry-based laboratories: a description based on observations and interviews. J College Science Teaching 31: 225–229, 2002.
  43. Sadler PM. Psychometric models of student conceptions in science: reconciling qualitative studies and distractor-driven assessment instruments. J Res Sci Teach 35: 265–296, 1998.
  44. Seymour E and Hewitt NM. Talking About Leaving: Why Undergraduates Leave The Sciences. Boulder, CO: Westview, 1997.
  45. Spence L. The case against teaching. Change 00: 11–19, 2001.
  46. Springer L, Stanne ME, and Donovan SS. Effects of small-group learning on undergraduates in science, mathematics, engineering, and technology: a meta-analysis. Rev Educational Research 69: 21–51, 1999.
  47. Sundberg MD and Moncada GJ. Creating effective investigative laboratories for undergraduates. Bioscience 44: 698–704, 1994.
  48. Svinicki M. New directions in learning and motivation. In: Teaching and Learning on the Edge of the Millennium: Building on What We Have Learned, edited by Svinicki M. San Francisco, CA: Jossey-Bass, 1999, p. 5–27.
  49. Tien LT, Roth V, and Kampmeier JA. Implementation of a peer-led team learning instructional approach in an undergraduate organic chemistry course. J Res Science Teaching 39: 606–632, 2002.
  50. Tobias S. Revitalizing Undergraduate Science: Why Some Things Work and Most Don’t. Tucson, AZ: Research Corporation, 1992.
  51. Uno G. Handbook on Teaching Undergraduate Science Courses: A Survival Training Manual. Pacific Grove, CA: Thomson Learning, 2002.
  52. Wilke RR. The effect of active learning on student characteristics in a human physiology course for nonmajors. Adv Physiol Educ 27: 207–223, 2003.
  53. Wilterding JH and Luckie DB. Increasing student-initiated active learning with investigative ’streams:’ A molecular biology example. J College Science Teaching 31: 303–307, 2002.
  54. Woodhull-McNeal A. Teaching introductory science as inquiry. College Teaching 37: 3–7, 1989.
  55. Wright JC, Millar SB, Koscuik SA, Penberthy DL, Williams PH, and Wampold BE. A novel strategy for assessing the effects of curriculum reform on student competence. J Chem Ed 75: 986–982, 1998.



This article has been cited by other articles:


Home page
Adv. Physiol. Educ.Home page
Z. D. Balkanci and B. Pehlivanoglu
An overview of undergraduate physiology education in Turkish medical faculties
Advan Physiol Educ, December 1, 2008; 32(4): 322 - 328.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (2)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Luckie, D. B.
Right arrow Articles by Krha, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Luckie, D. B.
Right arrow Articles by Krha, M.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Visit Other APS Journals Online
Copyright © 2004 by the American Physiological Society.