A systematic review of empirical studies: Outcomes from programs informed by STEM reforms and policies

Evi Konstantinidou; Maria Evagorou

doi:10.29333/ejmste/15795

Full Text (PDF)

Evi Konstantinidou ¹ ^* , Maria Evagorou ¹

More Detail

¹ Department of Education, University of Nicosia, Nicosia, CYPRUS^* Corresponding Author

Abstract

The study aims to identify trends in STEM education policies and reforms during the last twenty-three years to understand how STEM education has developed and explain the paradox between suggested policies and outcomes in STEM education. A total of 1,493 articles were identified from the database search. After the initial analysis, 27 articles were included in the review and analyzed using qualitative content analysis and open coding. First, the need to approach STEM education as an interdisciplinary, integrated approach, focusing on problem solving by the students emerged. Furthermore, the reforms described in the published papers are happening either outside of the formal school time, or on a small scale and are not systematic efforts to address STEM education concerns at local, national or international level. The gap is identified on putting in practice, on a large scale, integrated STEM education. Implications and suggestions for action are discussed.

Keywords

STEM education
STEM policies
STEM reforms

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Article Type: Research Article

EURASIA J Math Sci Tech Ed, Volume 21, Issue 1, January 2025, Article No: em2558

https://doi.org/10.29333/ejmste/15795

Publication date: 02 Jan 2025

Article Views: 162

Article Downloads: 80

Open Access References How to cite this article

References

Achieve. (2013). Next generation science standards. The National Academies Press.
Ali, R., Bhadra, J., Siby, N., Ahmad, Z., & Al-Thani, N. J. (2021). A STEM model to engage students in sustainable science education through sports: A case study in Qatar. Sustainability, 13(6), Article 3483. https://doi.org/10.3390/su13063483
Allen, S., & Peterman, K. (2019). Evaluating informal STEM education: Issues and challenges in context. In A. C. Fu, A. Kannan, & R. J. Shavelson (Eds.), Evaluation in informal science, technology, engineering, and mathematics education. New directions for evaluation (pp. 17-33). https://doi.org/10.1002/ev.20354
Anwar, S., Menekse, M., Guzey, S., & Bryan, L. A. (2022). The effectiveness of an integrated STEM curriculum unit on middle school students’ life science learning. Journal of Research in Science Teaching, 59(7), 1204-1234. https://doi.org/10.1002/tea.21756
Asghar, A., Ellington, R., Rice, E., Johnson, F., & Prime, G. M. (2012). Supporting STEM education in secondary science contexts. Interdisciplinary Journal of Problem-Based Learning, 6(2), Article 4. https://doi.org/10.7771/1541-5015.1349
Bartels, S. L., Rupe, K. M., & Lederman, J. S. (2019). Shaping preservice teachers’ understandings of STEM: A collaborative math and science methods approach. Journal of Science Teacher Education, 30(6), 666-680. https://doi.org/10.1080/1046560X.2019.1602803
Berisha, F., & Vula, E. (2021). Developing pre-service teachers conceptualization of STEM and STEM pedagogical practices. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.585075
Berisha, F., & Vula, E. (2023). Introduction of integrated STEM education to pre-service teachers through collaborative action research practices. International Journal of Science and Mathematics Education, 22, 1127-1150. https://doi.org/10.1007/s10763-023-10417-3
Berlin, D. F., & White, A. L. (2012). A longitudinal look at attitudes and perceptions related to the integration of mathematics, science, and technology education. School Science and Mathematics, 112(1), 20-30. https://doi.org/10.1111/j.1949-8594.2011.00111.x
Bray-Clark, N., & Bates, R. (2003). Self-efficacy beliefs and teacher effectiveness: Implications for professional development. Professional Educator, 26(1), 13-22.
Breiner, J. M., Harkness, S. S., Johnson, C. C., & Koehler, C. M. (2012). What is STEM? A discussion about conceptions of STEM in education and partnerships. School Science and Mathematics, 112(1), 3-11. https://doi.org/10.1111/j.1949-8594.2011.00109.x
Brown, R. E., & Bogiages, C. A. (2019). Professional development through STEM integration: How early career math and science teachers respond to experiencing integrated STEM tasks. International Journal of Science and Mathematics Education, 17, 111-128. https://doi.org/10.1007/s10763-017-9863-x
Bursal, M., & Paznokas, L. (2006). Mathematics anxiety and preservice elementary teachers’ confidence to teach mathematics and science. School Science and Mathematics, 106(4), 173-180. https://doi.org/10.1111/j.1949-8594.2006.tb18073.x
Carnevale, A. P., Smith, N., & Melton, M. (2011). STEM: Science technology engineering mathematics. Georgetown University Center on Education and the Workforce.
Cheng, L., Antonenko, P. P., Ritzhaupt, A. D., & MacFadden, B. (2021). Exploring the role of 3D printing and STEM integration levels in students’ STEM career interest. British Journal of Educational Technology, 52(3), 1262-1278. https://doi.org/10.1111/bjet.13077
Chiang, F. K., Zhang, Y., Zhu, D., Shang, X., & Jiang, Z. (2022). The influence of online STEM education camps on students’ self-efficacy, computational thinking, and task value. Journal of Science Education and Technology, 31(4), 461-472. https://doi.org/10.1007/s10956-022-09967-y
Colclasure, B. C., Durham Brooks, T., Helikar, T., King, S. J., & Webb, A. (2022). The effects of a modeling and computational thinking professional development program on STEM educators’ perceptions toward teaching science and engineering practices. Education Sciences, 12(8), Article 570. https://doi.org/10.3390/educsci12080570
Corin, E. N., Sonnert, G., & Sadler, P. M. (2020). The role of dual enrollment STEM coursework in increasing STEM career interest among American high school students. Teachers College Record, 122(2), 1-26. https://doi.org/10.1177/016146812012200210
Cotabish, A., Dailey, D., Robinson, A., & Hughes, G. (2013). The effects of a STEM intervention on elementary students’ science knowledge and skills. School Science and Mathematics, 113(5), 215-226. https://doi.org/10.1111/ssm.12023
Crawford, A. J., Hays, C. L., Schlichte, S. L., Greer, S. E., Mallard, H. J., Singh, R. M., Clarke, M. A., & Schiller, A. M. (2021). Retrospective analysis of a STEM outreach event reveals positive influences on student attitudes toward STEM careers but not scientific methodology. Advances in Physiology Education, 45(3), 427-436. https://doi.org/10.1152/advan.00118.2020
Cunningham, C. M., Lachapelle, C. P., Brennan, R. T., Kelly, G. J., Tunis, C. S. A., & Gentry, C. A. (2020). The impact of engineering curriculum design principles on elementary students’ engineering and science learning. Journal of Research in Science Teaching, 57(3), 423-453. https://doi.org/10.1002/tea.21601
Dan, Z. S., & Gary, W. K. W. (2018). Teachers’ perceptions of professional development in integrated STEM education in primary schools. In Proceedings of the IEEE Global Engineering Education Conference, EDUCON (pp. 472-477). IEEE. https://doi.org/10.1109/EDUCON.2018.8363268
Dare, E. A., Ellis, J. A., & Roehrig, G. H. (2018). Understanding science teachers’ implementations of integrated STEM curricular units through a phenomenological multiple case study. International Journal of STEM Education, 5, Article 4. https://doi.org/10.1186/s40594-018-0101-z
Dickman, A., Schwabe, A., Schmidt, J., & Henken, R. (2009). Preparing the future workforce: Science, technology, engineering and math (STEM) policy in K-12 education. Public Policy Forum. https://eric.ed.gov/?id=ED510327
El Nagdi, M., & Roehrig, G. (2020). Identity evolution of STEM teachers in Egyptian STEM schools in a time of transition: A case study. International Journal of STEM Education, 7, Article 41. https://doi.org/10.1186/s40594-020-00235-2
EU STEM Coalition. (2016). STEM skills for a future-proof Europe. EU STEM Coalition, The Netherlands. http://www.aede-france.org/ERASMUS-DAY-EU-STEM-Brochure.html
EU. (2019). PISA 2018 and the EU: Striving for social fairness through education. Publications Office of the European Union.
European Commission COM. (2020). Communication from the commission to the European parliament, the council, the European economic and social committee and the committee of the regions. https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52020DC0625
European Schoolnet and Texas Instrument. (2018). STEM education policies in Europe–Scientix observatory report. Scientix. http://www.eun.org/resources/detail?publicationID=1481
Evagorou, M. (2024). Engaging kindergarten pre-service teachers in the design and implementation of STEM lessons. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1277835
Evagorou, M., & Konstantinidou, E. (2023). STEM policy brief. https://icse.eu/wp-content/uploads/2023/06/Deliverable-6.1-March-2023.pdf
Evagorou, M., & Nisiforou, E. F. I. (2020). Engaging pre-service teachers in an online STEM fair during COVID-19. Journal of Technology and Teacher Education, 28(2), 179-186. Retrieved December 18, 2024 from https://www.learntechlib.org/primary/p/216234/
Evagorou, M., Puig, B., Bayram, D., & Janeckova, H. (2024). Addressing the gender gap in STEM education across educational levels. Publications Office of the European Union. https://doi.org/10.2766/260477
Falloon, G., Powling, M., Fraser, S., & Hatisaru, V. (2022). Shaping science, technology, engineering and mathematics curriculum in Australian schools: An ecological systems analysis. Australian Journal of Education, 66(2), 171-195. https://doi.org/10.1177/00049441221083347
Gao, X., Li, P., Shen, J., & Sun, H. (2020). Reviewing assessment of student learning in interdisciplinary STEM education. International Journal of STEM Education, 7, Article 24. https://doi.org/10.1186/s40594-020-00225-4
Gough, D., Oliver, S., & Thomas, J. (2017). An introduction to systematic reviews. SAGE.
Guzey, S. S., Moore, T. J., & Harwell, M. (2016). Building up STEM: An analysis of teacher-developed engineering design-based STEM integration curricular materials. Journal of Pre-College Engineering Education Research, 6(1), Article 2. https://doi.org/10.7771/2157-9288.1129
Hernandez, P. R., Bodin, R., Elliott, J. W., Ibrahim, B., Rambo-Hernandez, K. E., Chen, T. W., & de Miranda, M. A. (2014). Connecting the STEM dots: Measuring the effect of an integrated engineering design intervention. International Journal of Technology and Design Education, 24(1), 107-120. https://doi.org/10. 1007/s10798-013-9241-0
Hoeg, D. G., & Bencze, L. J. (2017). Values underpinning STEM education in the USA: An analysis of the next generation science standards. Science Education, 101 (2), 278-301. https://doi.org/10.1002/sce.21260
Irez, S., & Han, C. (2011). Educational reforms as paradigm shifts: Utilising Kuhnian lenses for a better understanding of the meaning of, and resistance to, educational change. International Journal of Environmental & Science Education, 6(3), 251-266.
Johnson, C. C. (2012). Implementation of STEM education policy: Challenges, progress, and lessons learned. School Science and Mathematics, 112(1), 45-55. https://doi.org/10.1111/j.1949-8594.2011.00110.x
Johnson, C. C., & Sondergeld, T. A. (2023). Outcomes of an integrated STEM high school: Enabling access and achievement for all students. Urban Education, 58(8), 1772-1798. https://doi.org/10.1177/0042085920914368
Johnson, C. C., Mohr-Schroeder, M. J., Moore, T. J., & English, L. D. (Eds.). (2020). Handbook of research on STEM education. Routledge. https://doi.org/10.4324/9780429021381
Keller, M. M., Neumann, K., & Fischer, H. E. (2017). The impact of physics teachers’ pedagogical content knowledge and motivation on students’ achievement and interest. Journal of Research in Science Teaching, 54(5), 586-614. https://doi.org/10.1002/tea.21378
Kelley, T. R., & Knowles, J. G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3(1), Article 11. https://doi.org/10.1186/s40594-016-0046-z
Kelley, T. R., Knowles, J. G., Holland, J. D., & Han, J. (2020). Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice. International Journal of STEM Education, 7, Article 14. https://doi.org/10.1186/s40594-020-00211-w
Kitchen, J. A., Chen, C., Sonnert, G., & Sadler, P. (2022). The impact of participating in college-run STEM clubs and programs on students’ STEM career aspirations. Teachers College Record, 124(2), 117-142. https://doi.org/10.1177/01614681221086445
Kitchen, J. A., Sonnert, G., & Sadler, P. M. (2018). The impact of college- and university-run high school summer programs on students’ end of high school STEM career aspirations. Science Education, 102(3), 529-547. https://doi.org/10.1002/sce.21332
Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele, UK, Keele University, 33(2004), 1-26.
Knowles, J., Kelley, T., & Holland, J. (2018). Increasing teacher awareness of STEM careers. Journal of STEM Education, 19(3). Retrieved December 17, 2024 from https://www.learntechlib.org/p/184661/
Koirala, H. P., & Bowman, J. K. (2003). Preparing middle level preservice teachers to integrate mathematics and science: Problems and possibilities. School Science and Mathematics, 103(3), 145-154. https://doi.org/10.1111/j.1949-8594.2003.tb18231.x
Konstantinidou, E., & Scherer, R. (2022). Teaching with technology: A large-scale, international, and multilevel study of the roles of teacher and school characteristics. Computers & Education, 179, Article 104424. https://doi.org/10.1016/j.compedu.2021.104424
Labov, J. B., Reid, A. H., & Yamamoto, K. R. (2010). Integrated biology and undergraduate science education: A new biology education for the twenty-first century? CBE–Life Sciences Education, 9(1), 10-16. https://doi.org/10.1187/cbe.09-12-0092
Lamberg, T., & Trzynadlowski, N. (2015). How STEM academy teachers conceptualize and implement STEM education. Journal of Research in STEM Education, 1(1), 45-58. https://doi.org/10.51355/jstem.2015.8
Li, W., & Chiang, F.-K. (2019). Preservice teachers’ perceptions of STEAM education and attitudes toward STEAM disciplines and careers in China. In P. Sengupta., M.-C. Shanahan., & B. Kim (Eds.), Critical, transdisciplinary and embodied approaches in STEM education (pp. 83-100). Springer. https://doi.org/10.1007/978-3-030-29489-2_5
Li, Y., Wang, K., Xiao, Y., & Froyd, J. E. (2020). Research and trends in STEM education: A systematic review of journal publications. International Journal of STEM Education, 7, Article 11. https://doi.org/10.1186/s40594-020-00207-6
Liu, J. (2024). Gender-STEM stereotypes: A cross-cultural, mixed-methods exploration of women’s STEM pathways between the UK and China [Doctoral dissertation, University of Glasgow].
Menon, D., Shorman, D. A., Cox, D., & Thomas, A. (2023). Preservice elementary teachers conceptions and self-efficacy for integrated STEM. Education Sciences, 13(5), Article 529. https://doi.org/10.3390/educsci13050529
Metzler, J., & Woessmann, L. (2012). The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation. Journal of Development Economics, 99(2), 486-496. https://doi.org/10.1016/j.jdeveco.2012.06.002
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), Article e1000097. https://doi.org/10.1371/journal.pmed.1000097
Mullis, I. V. S., Martin, M. O., Foy, P., Kelly, D. L., & Fishbein, B. (2020). TIMSS 2019 international results in mathematics and science. Boston College, TIMSS & PIRLS International Study Center. https://timssandpirls.bc.edu/timss2019/international-results/
Nadelson, L. S., & Seifert, A. L. (2017). Integrated STEM defined: Context, challenges, and the future. The Journal of Educational Research, 110(3), 221-223. https://doi.org/10.1080/00220671.2017.1289775
NAE/NRC. (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research. The National Academies Press. https://doi.org/10.17226/18612
National STEM School Education Strategy. (2015). Education Council, Australian Government. http://www.educationcouncil.edu.au/site/DefaultSite/filesystem/documents/National%20STEM%20School%20Education%20Strategy.pdf
Nite, S. B., Capraro, M. M., Capraro, R. M., & Bicer, A. (2017). Explicating the characteristics of stem teaching and learning: A metasynthesis. Journal of STEM Teacher Education, 52(1) Article 6. https://doi.org/10.30707/JSTE52.1Nite
NRC. (2007). Taking science to school: Learning and teaching science in grades K-8. The National Academies Press.
OECD. (2019). Social impact investment 2019: The impact imperative for sustainable development. Organization for Economic Co-operation and Development.
Osborne, J., & Dillon, J. (2008). Science education in Europe: Critical reflections (vol. 13). The Nuffield Foundation.
Patrinos, H. A., Velez, E., & Wang, C. Y. (2013). Framework for the reform of education systems and planning for quality. The World Bank. https://openknowledge.worldbank.org/server/api/core/bitstreams/04763542-fe7a-5823-b657-3a3e6489ce61/content
Rennie, L. J., Venbille, G. J., & Wallace, J. (2012). Knowledge that counts in a global community: Exploring the contribution of integrated curriculum. Routledge. https://doi.org/10.4324/9780203817476
Revák, I. M., Csernoch, M., Szilágyi, K. C., Dávid, Á., Tóth, B. K., Malmos, E., Sütő, É., & Kurucz, D. (2024). A systematic review of STEM teaching-learning methods and activities in early childhood. Eurasia Journal of Mathematics, Science and Technology Education, 20(8), em2481. https://doi.org/10.29333/ejmste/14779
Rinke, C. R., Gladstone-Brown, W., Kinlaw, C. R., & Cappiello, J. (2016). Characterizing STEM teacher education: Affordances and constraints of explicit STEM preparation for elementary teachers. School Science and Mathematics, 116(6), 300-309. https://doi.org/10.1111/ssm.12185
Ryu, M., Mentzer, N., & Knobloch, N. (2019). Preservice teachers’ experiences of STEM integration: Challenges and implications for integrated STEM teacher preparation. International Journal of Technology and Design Education, 29, 493-512. https://doi.org/10.1007/s10798-018-9440-9
Satchwell, R. E., & Loepp, F. L. (2002). Designing and implementing an integrated mathematics, science, and technology curriculum for the middle school. Journal of Industrial Teacher Education, 39(3), 41-66.
Scherer, R., Howard, S. K., Tondeur, J., & Siddiq, F. (2021). Profiling teachers’ readiness for online teaching and learning in higher education: Who’s ready? Computers in Human Behavior, 118, Article 106675. https://doi.org/10.1016/j.chb.2020.106675
Selcen Guzey, S., Harwell, M., Moreno, M., Peralta, Y., & Moore, T. J. (2017). The impact of design-based STEM integration curricula on student achievement in engineering, science, and mathematics. Journal of Science Education and Technology, 26, 207-222. https://doi.org/10.1007/s10956-016-9673-x
Takeuchi, M., Sengupta, P., Shanahan, M.-C., Adams, J. D., & Hachem, M. (2020). Transdisciplinarity in STEM education: A critical review. Studies in Science Education, 56(2), 213-253. https://doi.org/10.1080/03057267.2020.1755802
Tan-Wilson, A., Rezaeiahari, M., Stamp, N., Button, E., & Khasawneh, M. T. (2020). An undergraduate STEM interdisciplinary research program: Factors predictive of students’ plans for careers in STEM. Journal of STEM Education: Innovations and Research, 21(2).
Thibaut, L., Ceuppens, S., De Loof, H., De Meester, J., Goovaerts, L., Struyf, A., Boeve-de Pauw, J., Dehaene, W., Deprez, J., De Cock, M., Hellinckx, L., Knipprath, H., Langie, G., Struyven, K., Van de Velde, D., Van Petegem, P., & Depaepe, F. (2018). Integrated STEM education: A systematic review of instructional practices in secondary education. European Journal of STEM Education, 3(1), Article 02. https://doi.org/10.20897/ejsteme/85525
Trilles, S., & Granell, C. (2020). Advancing preuniversity students’ computational thinking skills through an educational project based on tangible elements and virtual block-based programming. Computer Applications in Engineering Education, 28(6), 1490-1502. https://doi.org/10.1002/cae.22319
Velasco, R. C. L., Hite, R., & Milbourne, J. (2022). Exploring advocacy self-efficacy among K-12 STEM teacher leaders. International Journal of Science and Mathematics Education, 20(3), 435-457. https://doi.org/10.1007/s10763-021-10176-z
Wang, X. (2013). Why students choose STEM majors: Motivation, high school learning, and postsecondary context of support. American Educational Research Journal, 50(5), 1081-1121. https://doi.org/10.3102/0002831213488622
Watt, H. M., Richardson, P. W., & Devos, C. (2013). (How) does gender matter in the choice of a STEM teaching career and later teaching behaviours? International Journal of Gender, Science and Technology, 5(3), 187-206. https://genderandset. open.ac.uk/index.php/genderandset/article/view/331
Xu, L., Fang, S. C., & Hobbs, L. (2023). The relevance of STEM: A case study of an Australian secondary school as an arena of STEM curriculum innovation and enactment. International Journal of Science and Mathematics Education, 21(2), 667-689. https://doi.org/10.1007/s10763-022-10267-5

How to cite this article

APA

Konstantinidou, E., & Evagorou, M. (2025). A systematic review of empirical studies: Outcomes from programs informed by STEM reforms and policies. Eurasia Journal of Mathematics, Science and Technology Education, 21(1), em2558. https://doi.org/10.29333/ejmste/15795

Vancouver

Konstantinidou E, Evagorou M. A systematic review of empirical studies: Outcomes from programs informed by STEM reforms and policies. EURASIA J Math Sci Tech Ed. 2025;21(1):em2558. https://doi.org/10.29333/ejmste/15795

AMA

Konstantinidou E, Evagorou M. A systematic review of empirical studies: Outcomes from programs informed by STEM reforms and policies. EURASIA J Math Sci Tech Ed. 2025;21(1), em2558. https://doi.org/10.29333/ejmste/15795

Chicago

Konstantinidou, Evi, and Maria Evagorou. "A systematic review of empirical studies: Outcomes from programs informed by STEM reforms and policies". Eurasia Journal of Mathematics, Science and Technology Education 2025 21 no. 1 (2025): em2558. https://doi.org/10.29333/ejmste/15795

Harvard

Konstantinidou, E., and Evagorou, M. (2025). A systematic review of empirical studies: Outcomes from programs informed by STEM reforms and policies. Eurasia Journal of Mathematics, Science and Technology Education, 21(1), em2558. https://doi.org/10.29333/ejmste/15795

MLA

Konstantinidou, Evi et al. "A systematic review of empirical studies: Outcomes from programs informed by STEM reforms and policies". Eurasia Journal of Mathematics, Science and Technology Education, vol. 21, no. 1, 2025, em2558. https://doi.org/10.29333/ejmste/15795