Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Asking the Wrong Questions About American Science Education: Insights from a Longitudinal Study of High School Biotechnology Lab Instruction

Dave Micklos, Lindsay Barone
doi: https://doi.org/10.1101/2021.11.29.470152
Dave Micklos
*DNA Learning Center, Cold Spring Harbor Laboratory and InnovATEBIO National Biotechnology Education Center
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: micklos@cshl.edu
Lindsay Barone
+Wisconsin Partnership Program, University of Wisconsin-Madison
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

SUMMARY

The discussion of American science education is often framed by the questions: Why do American precollege students do poorly on international science assessments and what we are doing wrong? Rather we need to ask: Why do so many international students come to US universities for science, what are we doing right in science, and how do we stay ahead in science education? Poor scores on international assessments belie the fact that the U.S. has the best science education system in the world. Our study of 6,200 high school teachers in 1998 and 2018 documented striking success in retooling classrooms for labbased instruction in biotechnology and provided a pre-COVID-19 snapshot of what is right with American biology education. However, it also highlights the need revitalize our precollege teaching resource with a renewed National Science Foundation commitment to in-service training.

BACKGROUND

Every several years there is general angst and hand-wringing over American students’ relatively poor performance on the science component of either of two international assessments. U.S. fourth graders ranked 9th and eighth graders ranked 11th in the 2019 Trends in International Math and Science Study (TIMSS)1, while 15-year-old students ranked 18th in the 2018 Programme for International Student Assessment (PISA)2. These results beg the question: “What is wrong with American science education?”

However, a better question would be, “What do the results actually reflect?” Nine of the top ten scorers on PISA study—Beijing/Shanghai, Singapore, Macao, Estonia, Japan, Finland, Korea, Hong Kong, and Taipei—have centrally-controlled education systems operating in the equivalent of a single large city and/or serving an ethnically homogeneous population. The disparity in the scores of U.S. students reflects both the heterogeneity of the U.S. population and school system—in which 50 state, 13,452 public school districts, and 32,461 private schools exercise local control over curricula3. Good scores on standardized tests—international or otherwise—reflect effective test preparation, but do not reflect good preparation for science or support of scientific enterprise.

Heterogeneity may seem a curse on international test performance, but it is a blessing for academic freedom and intellectual curiosity. Despite the U.S.’s lackluster performance on international assessments, the world beats a path to American colleges and universities. In 2019, there were 1,075,406 international students enrolled in U.S. higher education; only about a third as many U.S. students temporarily studied abroad4. Foreign students represented 5.5% of total students enrolled in 20195, and 39% of all doctorates awarded in in science and engineering6.

Something about our heterogeneous school system works, both in preparing students and in nurturing new scientific ideas. By almost any measure, the U.S. remains the world leader in basic and applied research. Individuals affiliated with U.S. institutions or companies have received 47% of all Nobel Prizes in physics, chemistry, and physiology or medicine7 and 51% of all patents awarded by the U.S. Patent and Trademark Office8. U.S. scholars were the largest share of top cited authors published in the 2020 H5 citation index of the top five life science journals9.

The Research Edge

Early and frequent student participation in experiments is likely the critical factor in producing good American science. The U.S.’s emphasis on hands-on science means that the better of its heterogeneous schools function as a feeder system for academic and industry research. This science prep system is virtually absent elsewhere in the world—including countries that score well on TIMSS and PISA—as experiments are never an efficient means for rote learning or memorizing facts.

There is strong evidence that participation in research improves Science, Technology, Engineering, and Math (STEM) persistence and academic performance10. While the traditional “apprentice” system reaches relatively few hand-picked students, the President’s Council of Advisors on Science and Technology11 recommended “replacing standard laboratory courses with discovery-based research courses.” Thus, broadening access to early research experiences has become the holy grail of American collegiate science education, with course-based undergraduate research experiences (CUREs) reaching large numbers of students in the context of for-credit courses. Freshman students who completed a research sequence at the University of Texas at Austin had 23% higher retention in STEM and 17% higher six-year graduation rate than closely matched controls12. These effects were consistent across racial groups, and there is mounting evidence for pronounced positive effects of CUREs for underrepresented minorities13,14,15. This is significant, because the six-year graduation rate is 23% lower at URM-serving institutions than at mainstream institutions16,17. There is every reason to believe that research experiences have similar impacts on high school students. Using the standardized Survey of Undergraduate Research Experiences (SURE-III)18, we found that high school students participating in DNA barcoding research scored the same or higher on 12 of 21 learning gains as did college student researchers (Figure 1).

Figure 1:
  • Download figure
  • Open in new tab
Figure 1:

Comparative SURE-III learning gains between high school and college students.

The research experience—identifying a problem, using science tools and methods, persevering to overcome difficulties, collaborating with others, and presenting your work—embodies life skills and a way of looking at the world that is useful beyond science. So, making students ready for research also makes them ready for college, ready for careers, and ready for life. They also learn skills and competencies that prepare them for the jobs of the future.

The best American high schools realize this and support an array of science electives with lab components. Notably, good schools aspire to implement the rigorous college curriculum of Advanced Placement (AP) Biology, which requires students to complete 12 key experiments. Biology is the most popular of all AP sciences (Figure 2), with 260,816 students taking the AP Biology test in 201919.

Figure 2:
  • Download figure
  • Open in new tab
Figure 2:

Students taking AP science tests in 2019.

Good schools go well beyond offering AP sciences. For example, virtually all of the 124 school districts on Long Island and many in the New York metropolitan area have high school research programs. These schools accounted for 20% of 2020 finalists in the prestigious Regeneron Science Search20. Schools with AP and research programs also tend to infuse inquiry-based labs into their regular science courses. Students from these science-active schools are competitive for admission to the best science universities. They also arrive at college ahead of their peers, ready to participate in early research opportunities— including CUREs that involve an increasing number of freshman students.

The Biotech Revolution

The DNA Learning Center (DNALC) of Cold Spring Harbor was founded in the mid-1980s, when advances in molecular genetics and biotechnology were changing the face of biology. With funding primarily from the NSF, universities and research institutes stepped in to update high school teachers on new lab techniques. The rapid adoption of hands-on biotech labs in American high schools was catalyzed by the inclusion of two required gene manipulation experiments—DNA restriction analysis and transformation— in the AP Biology curriculum.

The DNALC became a major proponent of hands-on learning in biotechnology. Equipped with our popular lab text DNA Science and mobile Vector Vans, we could set up cost-effective regional training in molecular genetics at virtually any high school or university. From 1987 to 1996, with NSF and other support, the DNALC instructed 1,931 high school faculty at five-day workshops taught in 39 states. With separate NSF funding, San Francisco State University replicated the DNA Science Workshop throughout the state of California—reaching an additional 600 faculty. The DNA Science curriculum was also the basis for teacher training workshops administered by the North Carolina Biotechnology Center, University of Wisconsin, and University of Florida that reached 760 participants. All told, over 3,200 high school biology teachers were trained using the DNA Science curriculum during this period. Follow-up studies of teachers 17 months after training by the DNALC found that 40% had attempted the two recommended AP Biology labs (Supplemental Table). The rapid uptake of molecular genetics labs in American high schools was also evidenced by rapidly increasing numbers of students who used teaching kits provided by Carolina Biological Supply Company—a major educational science supply house (Figure 3).

View this table:
  • View inline
  • View popup
  • Download powerpoint
SUPPLEMENTAL TABLE:

Impacts of DNALC Teacher Training 1987-1995

Figure 3:
  • Download figure
  • Open in new tab
Figure 3:

High school students using biotech kits from Carolina Biological Supply Company 1988-2018.

RESULTS

In 1998, we did a purposive study of 4,100 high school teachers nationwide to gauge the impact of the decade of in-service training done by us and other academic groups. Respondents reported providing 321,826 student exposures to six biotechnology labs in the previous academic year—DNA restriction, transformation, recombination, plasmid isolation, polymerase chain reaction (PCR), and DNA sequencing. Forty-four percent of the teachers reported receiving funding to support biotech instruction, averaging $17,365 each, and 16% of respondents’ schools had started biotech electives. This documented a rapid implementation of new biotech labs and retooling of high school biology classrooms for the gene age.

Responding faculty were highly accomplished and professional educators, with an average of 19 years’ teaching experience in science. Nearly two-thirds had attended at least one professional meeting (65%) and spent at least 16 hours on professional development activities (61%) in the past year. Eighty-one percent were involved in curriculum development, primarily with their own school districts. The respondents were also involved in science-related extracurricular activities—including science field trips (53%), science fairs and competitions (36%), after-school student research (26%), and joint activities with research scientists (24%).

We re-administered the same survey in 2018, to re-take the pulse of biotech lab instruction—this time with 2,100 respondents. We found an equally experienced group of teachers, although slightly younger and with an increased majority of females (69%) (Table 1).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1:

Teacher demographics, 1998 and 2018.

Key Findings

  • More students participated in biotech labs in 2018. However, fewer faculty were involved in biotech lab teaching, and the pace of integrating new labs slowed. Scaled for the differing cohort sizes, the number of student exposures to hands-on biotech labs increased 26%, to 406,354. The number of teachers who taught at least one of the labs (in the previous year) decreased from 68% in 1998 to 57% in 2018. Although more 2018 teachers offered newer labs on PCR and DNA sequencing, only a third as many students were exposed to these methods as were to then-current methods of transformation and restriction analysis in 1998 (Table 2).

  • Although fewer 2018 teachers reported funding for biotech programs, per-teacher funding increased by 56%. Forty-four percent of 1998 teachers received funding to support biotech instruction, averaging $17,365 (adjusted for inflation), while 34% of 2018 teachers received an average of $27,098 in funding.

  • Biotech electives have doubled, but they are not equally distributed and are not well aligned with the school-to-work movement. Schools offering lab-based biotechnology electives increased from 16% in 1998 to 35% in 2018. However, 64% of schools with electives were located in zip codes above the U.S. median household income. Only 35% of faculty at these schools in 2018 used curriculum materials provided by industry, and even fewer (11%) used materials produced by NSF’s Advanced Technological Education program. Only 22% of these schools had articulation agreements with colleges.

  • Although 2018 faculty were more academically prepared, with 7% more having graduate degrees, they were less involved in professional and extracurricular activities. Significantly fewer of 2018 teachers belonged to professional societies, including NABT, NSTA, and state science teachers’ associations (Figure 4). While 65% of 1998 teachers had attended one or more professional meetings in the past year, 60% of 2018 teachers had attended none. Significantly fewer 2018 teachers participated with their students in extracurricular activities—including after-school research, science fairs, field trips and joint activities with scientists. Significantly more of the 2018 cohort (41%) said they had done none (Figure 5).

  • Over the last 20 years, teachers continued to believe in-service training is important. However, 2018 teachers perceived that training opportunities have declined. Teachers in both cohorts rated summer institutes (5 days or more) and workshops at professional meetings as the most important contributors to their own expertise in biotech lab instruction (Figure 6). Thirty-nine percent of 2018 faculty thought there were fewer opportunities for training at workshops and summer institutes than in the past, compared to 27% who think there were more.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2:

Implementation of six biotechnology labs, 1998 and 2018.

Figure 4:
  • Download figure
  • Open in new tab
Figure 4:

Teacher membership in professional societies, 1998 and 2018.

Figure 5:
  • Download figure
  • Open in new tab
Figure 5:

Teacher participation in extracurricular activities, 1998 and 2018

Figure 6:
  • Download figure
  • Open in new tab
Figure 6:

Contributors to teacher innovation in the classroom, 1998 and 2018.

We wondered if this perceived decline was real, so we used keywords to search a database of NSF grants21 for potential biology teacher training activities. Searches produced 7,159 unique hits, which we then audited to find 926 projects whose abstracts or titles mentioned any type of training that may have been taken by secondary biology teachers. This included projects in biology, biotechnology, or genetics—as well as general science topics. When we plotted these on a graph, we found that the number of active teacher training grants shrank 75% between its peak in 1994 and 2018 (Figure 7).

Figure 7:
  • Download figure
  • Open in new tab
Figure 7:

Active NSF science teacher training grants 1984-2018.

DISCUSSION

The decline in NSF funding for teacher training coincided with an increased emphasis on “systemic initiatives.” A debate about the fundamental value of NSF’s traditional portfolio of teacher-training institutes came to the fore during 1995 meetings of a National Academy of Sciences committee tasked to examine in-service training for high school biology teachers22. A vocal minority of the committee criticized traditional NSF summer institutes as “pulling out” the best teachers and leaving the rest behind. The NSF programs of systemic reform, which began in 1990, seemed a logical antidote. These shifted the responsibility for in-service training from content experts at universities and research institutes to state and local school authorities. The content experts had hewed to the NSF priority for innovation, which favored new advancements and experimentation. Local school systems focused on pedagogy and content aimed at “all” teachers. This local training was not necessarily well received by teachers accustomed to the authority and rigor of their previous experiences at NSF summer institutes. A review of 25 state systemic initiatives by SRI International found that professional development activities reached only about 20% of math and science teachers, even though they consumed about one-third of funding. It concluded that “there are few, if any, places that are models of ‘systemic’ professional development, i.e. involving all teachers in high-quality learning on a routine basis…”23

The final blow to NSF’s commitment to in-service teacher training came in 2012 with the cancellation of the Teacher Enhancement Program, which had funded the majority of summer institutes that flourished in the 1980s and 1990s. Since then, the Division of Research and Learning has devoted the lion’s share of pre-college education funding to research on the education process. Under this regime, in-service teacher training can only be funded as a component of an educational research program—it is valueless on its own.

After mobilizing scientific research during WWII, Vannevar Bush imagined an “endless frontier”24 for American science and provided a template for the National Science Foundation Authorization Act of 195025. NSF sponsorship of summer institutes for secondary science and math teachers began in 1954. By 1965, approximately 146,000 teachers had received training at more than 2,500 institutes, typically of 6-8 weeks’ duration26,27. Support for teacher institutes waned in the 1970s and reached a nadir during in 1982, during the first Reagan administration. The advent of the Teacher Enhancement Program in 1984, marked a return to NSF’s tradition of supporting summer science, albeit with shorter and more costeffective institutes of 1-3 weeks. This program nurtured the biology teachers who responded to the challenge of bringing advances in biotechnology into American classrooms.

That generation of biology pioneers has retired, and the biotech revolution they created in American biology classrooms has lost momentum. Little has been done to rebuild their culture of lifelong learning. Our study suggests that teachers’ professionalism and extracurricular involvement with students contracted along with NSF’s commitment to in-service training. Furthermore, lab instruction shrunk to near zero nationwide during the COVID-19 pandemic. As we emerge from a year of isolation, biology teachers will be anxious for opportunities to re-connect with science and their peers. We need to ask, “How we can we help science teachers return to research-driven instruction and to keep up with quickening advances in biological sciences?” The answer is clear.

It is the moment for NSF to take the lead in re-establishing an “esprit de corps” and culture of lifelong learning among American science teachers. NSF must renew its commitment to in-service training as a critical contributor to teachers’ professional development and classroom innovation. Now is the time for every person concerned with science and science education in this country to send two clear messages to policy makers:

  1. Reinstate NSF’s mandate for teacher training, and implement an extensive program of summer institutes and academic-year workshops at professional meetings.

  2. Provide state and local support for teacher training and attendance at professional meetings.

ACKNOWLEDGEMENTS

Our thanks to:

  • John Kruper, who helped plan the initial teacher study, based on insights from his doctoral research on early cohorts of teacher trainees.

  • DNALC staff members who designed and administered the national teacher surveys at two time points—Susan Lauter, Judy Cumella-Korabik, and Valerie Meszaros—and who trained teachers under NSF grants 1986-2018—Mark Bloom, Uwe Hilgert, and Bruce Nash.

  • Linnea Fletcher and Celeste Carter, who provided valuable feedback throughout the study.

This research was supported by grants from the National Science Foundation’s Advanced Technological Education (ATE) Program: DUE-1744708, DUE-1839544, and DUE-1901984.

REFERENCES

  1. 1.↵
    National Center for Education Statistics. (2021). TIMSS 2019 U.S. results. https://nces.ed.gov/timss/
  2. 2.↵
    Organisation for Economic Co-operation and Development. (2018). Programme for International Student Assessment. https://www.oecd.org/pisa/PISA-results_ENGLISH.png
  3. 3.↵
    National Center for Education Statistics. (2020). Table 214.10: Number of public school districts and public and private elementary and secondary: Selected years, 1869-70 through 2018-19. https://nces.ed.gov/programs/digest/d20/tables/dt20_214.10.asp?current=yes
  4. 4.↵
    Institute of International Education. (2021). Enrollment trends. https://opendoorsdata.org/data/international-students/enrollment-trends/
  5. 5.↵
    Institute of International Education. (2021). U.S. study abroad for academic credit trends. https://opendoorsdata.org/data/us-study-abroad/u-s-study-abroad-for-academic-credit-trends/
  6. 6.↵
    National Science Foundation. (2020). Doctorate recipients, by broad field of study and citizenship status: Selected years, 1994–2019. https://ncses.nsf.gov/pubs/nsf21308/table/17
  7. 7.↵
    List of Nobel laureates by university affiliation. (2021, November 26). In Wikipedia. https://en.wikipedia.org/wiki/List_of_Nobel_laureates_by_university_affiliation
  8. 8.↵
    U.S. Patent and Trade Office. (2021). U.S. patent statistics chart calendar years 1963–2020. https://www.uspto.gov/web/offices/ac/ido/oeip/taf/us_stat.htm.
  9. 9.↵
    Clarivate. (2021). Web of Science. http://www.webofknowledge.com
  10. 10.↵
    Auchincloss, L. C., Laursen, S. L., Branchaw, J. L., Eagan, K., Graham, M., Hanauer, D. I., Lawrie, G., McLinn, C. M., Pelaez, N., Rowland, S., Towns, M., Trautmann, N. M., Varma-Nelson, P., Weston, T. J., & Dolan, E. L. (2014). Assessment of course-based undergraduate research experiences: A meeting report. CBE—Life Sciences Education, 13(1), 29–40. https://doi.org/10.1187/cbe.14-01-0004
    OpenUrl
  11. 11.↵
    President’s Council of Advisors on Science and Technology. (2012). Engage to excel: Producing one million additional college graduates with degrees in science, technology, engineering, and mathematics. https://eric.ed.gov/?id=ED541511
  12. 12.↵
    Rodenbusch, S. E., Hernandez, P. R., Simmons, S. L., & Dolan, E. L. (2016). Early engagement in coursebased research increases graduation rates and completion of science, engineering, and Mathematics degrees. CBE—Life Sciences Education, 15(2). https://doi.org/10.1187/cbe.16-03-0117
  13. 13.↵
    Chang, M.J., Sharkness, J., Hurtado, S., Newman, C.B. (2014). What matters in college for retaining aspiring scientists and engineers from underrepresented racial groups. Journal of Research in Science Teaching, 51(5), 555–580.
    OpenUrl
  14. 14.↵
    Jones, M.T., Barlow, A.E.L., Villarejo, M. (2010). Importance of undergraduate research for minority persistence and achievement in biology. The Journal of Higher Education, 81(1), 82–115.
    OpenUrlCrossRefWeb of Science
  15. 15.↵
    Nagda, B.A., Gregerman, S.R., Jonides, J., von Hippel, W., & Lerner, J.S. (1998). Undergraduate student-faculty research partnerships affect student retention. The Review of Higher Education, 22(1), 55–72.
    OpenUrlCrossRef
  16. 16.↵
    Cunningham, A., Park, E., Engle, J. (2014). Minority-serving institutions: Doing more with less. https://www.ihep.org/publication/minority-serving-institutions-doing-more-with-less/
  17. 17.↵
    Tomas Bustillos, L. (2012). Rethinking remedial education: The role of MSIs in serving under-prepared students in the 21st century. http://files.eric.ed.gov/fulltext/ED539711.pdf
  18. 18.↵
    Lopatto, D. (2004). Survey of undergraduate research experiences (SURE): First findings. Cell Biology Education, 3(4), 270–277.
    OpenUrlCrossRefPubMed
  19. 19.↵
    College Board. (2019). Student score distributions, AP Exams—May 2019. https://secure-media.collegeboard.org/digitalServices/pdf/research/2019/Student-Score-Distributions-2019.pdf
  20. 20.↵
    Society for Science & the Public. (2021). 2020 Regeneron STS finalists. https://www.societyforscience.org/regeneron-sts/2020-finalists/
  21. 21.↵
    National Science Foundation Awards Advanced Search. https://nsf.gov/awardsearch/advancedSearch.jsp
  22. 22.↵
    National Research Council. (1996). The role of scientists in the professional development of science teachers. Washington, DC: The National Academies Press. https://doi.org/10.17226/2310.
  23. 23.↵
    Zucker, A.A., Shields, P.M., Adelman, N.E., Corcoran, T.B., Goertz, M.E. (1998). A report on the evaluation of the National Science Foundation’s Statewide Systemic Initiatives (SSI) Program. Menlo Park: SRI International.
  24. 24.↵
    Bush, V. (1945). Science, the endless frontier: A report to the President. Washington DC: Government Printing Office.
  25. 25.↵
    National Science Foundation Authorization Act of 1973. Pub.L. No.99-372.
  26. 26.↵
    National Science Foundation. (1966). Program activities of the National Science Foundation. https://www.nsf.gov/pubs/1965/annualreports/ar_1965_sec2.pdf
  27. 27.↵
    Kreighbaum, H., Lawson, H. (1969). An investment in knowledge: The first dozen years of the National Science Foundation’s summer institutes program to improve secondary school science and mathematics teaching, 1954-1965. New York: New York University Press.
Back to top
PreviousNext
Posted November 29, 2021.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Asking the Wrong Questions About American Science Education: Insights from a Longitudinal Study of High School Biotechnology Lab Instruction
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Asking the Wrong Questions About American Science Education: Insights from a Longitudinal Study of High School Biotechnology Lab Instruction
Dave Micklos, Lindsay Barone
bioRxiv 2021.11.29.470152; doi: https://doi.org/10.1101/2021.11.29.470152
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Asking the Wrong Questions About American Science Education: Insights from a Longitudinal Study of High School Biotechnology Lab Instruction
Dave Micklos, Lindsay Barone
bioRxiv 2021.11.29.470152; doi: https://doi.org/10.1101/2021.11.29.470152

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Scientific Communication and Education
Subject Areas
All Articles
  • Animal Behavior and Cognition (4658)
  • Biochemistry (10313)
  • Bioengineering (7636)
  • Bioinformatics (26240)
  • Biophysics (13481)
  • Cancer Biology (10648)
  • Cell Biology (15360)
  • Clinical Trials (138)
  • Developmental Biology (8463)
  • Ecology (12776)
  • Epidemiology (2067)
  • Evolutionary Biology (16794)
  • Genetics (11372)
  • Genomics (15430)
  • Immunology (10580)
  • Microbiology (25087)
  • Molecular Biology (10172)
  • Neuroscience (54233)
  • Paleontology (398)
  • Pathology (1660)
  • Pharmacology and Toxicology (2883)
  • Physiology (4326)
  • Plant Biology (9213)
  • Scientific Communication and Education (1582)
  • Synthetic Biology (2544)
  • Systems Biology (6761)
  • Zoology (1458)