High School

Empowering Teachers to See and Support Student Use of Crosscutting Concepts in the Life Sciences

The project focuses on the development of formative assessment tools that highlight assets of students’ use of crosscutting concepts (CCCs) while engaged in science and engineering practices in grades 9-12 Life Sciences.

Lead Organization(s): 
Award Number: 
2100822
Funding Period: 
Sun, 08/01/2021 to Wed, 07/31/2024
Full Description: 

The project focuses on the development of formative assessment tools that highlight assets of students’ use of crosscutting concepts (CCCs) while engaged in science and engineering practices in grades 9-12 Life Sciences. In response to the calls set forth by the Framework for K-12 Science Education and Next Generation Science Standards (NGSS), the field has most successfully researched and developed assessment tools for disciplinary core ideas and the science and engineering practices. The CCCs, which serve as the connective links across science domains, however, remain more abstractly addressed. Presently, science educators have little guidance for what student use of CCCs looks like or how to assess and nurture such use. This project, with its explicit attention to the CCCs, advances true three-dimensional scientific understanding in both research and the classroom. Leveraging formative assessment as a vehicle for student and teacher development taps into proven successful instructional strategies (e.g., sharing visions of successful learning, descriptive feedback, self-assessment), while also advancing formative assessment, itself, by strengthening and illustrating how these strategies may focus on the CCCs. Further, a strengths-based approach will center culturally related differences in students’ use of CCCs to achieve more equitable opportunities to engage in classroom sensemaking practices. This work impacts the field of science education by 1) enabling a more thorough realization of NGSS ideals, 2) strengthening teachers’ abilities to identify diverse demonstrations of CCCs, and 3) showcasing the impact of novel classroom tools to sharpen teachers’ abilities to solicit, notice, and act upon evidence of emergent student scientific thinking within their instructional practices.

This design-based implementation research project will engage teachers in the iterative development and refinement of rubrics that support three-dimensional science understanding through formative assessment. The high school biology classrooms that compose the study site are engaged in ambitious science teaching-inspired instruction. An inductive, bottom-up approach (Brookhart, 2013) will allow researchers, teachers, and students to co-construct rubrics. Analysis of classroom observations, artifact collection, interviews with teachers and students, and expert-panel ratings will produce a rubric for each CCC that integrates relevant science and engineering practices and is applicable across a range of disciplinary core ideas. These rubrics will illustrate progressions of increasingly advanced use of each of the CCCs, to guide the construction, pursuit, and assessment of learning goals. There will be two design cycles that allow for the collection of validity evidence and produce rubrics with the potential for broad application by educators. Complementary lines of qualitative and quantitative (i.e., psychometric) analysis will contribute to development and validation of the rubrics and their formative uses. Project inquiry will focus on 1) how the rubrics can represent CCCs for key disciplinary practices, 2) the extent to which teachers’ and students’ understandings of the rubrics align, and 3) how implementation of the rubrics impacts teachers’ and students’ understandings of the CCCs.

Practice-Driven Professional Development for Algebra Teachers

This project seeks to develop a personalized, scalable PD approach that centers on and builds from algebra teachers’ practices and individual strengths. The project will focus its PD efforts on instructional actions that are tailored to teachers' existing practice, can be readily adopted, and are easily accessible.

Lead Organization(s): 
Award Number: 
2101508
Funding Period: 
Thu, 07/01/2021 to Mon, 06/30/2025
Full Description: 

Professional development (PD) is a direct attempt to improve the quality of instruction for teachers already in the classroom. Traditional PD is typically costly in terms of time and money, and efforts tend to be delivered as a one-size-fits-all approach. Furthermore, for teachers who adopt novel techniques such as flipped instruction, there may be few resources to support their efforts. This project seeks to develop a personalized, scalable PD approach that centers on and builds from algebra teachers’ practices and individual strengths. The project will focus its PD efforts on instructional actions that are tailored to teachers' existing practice, can be readily adopted, and are easily accessible. The project team have termed such instructional actions high-uptake practices. The project will develop and field test PD materials to support algebra teachers at scale via these high-uptake practices.

In addition to developing the PD materials, the project team will research the efficacy of this PD model in terms of student learning outcomes and teacher instructional practices in approximately 60 algebra classrooms. The main data sources will include teacher observation data, teacher interviews and surveys, student pre/posttests, student surveys, and PD analytics. The research will characterize the immediate and longer term impacts of the PD on teachers’ instructional practices; and characterize the impact of teachers’ participation in the PD on students’ learning outcomes and engagement. The research questions include: 1) In what ways does teachers’ participation in the PD impact their instructional practices? 2) Do students of teachers who participate in the PD demonstrate differential growth in learning outcomes? 3) Do students of teachers who participate in the PD have increased rates of homework completion?; and 4) Do students of teachers who participate in the PD have increased engagement during individual work time? In meeting both our PD development and research aims, this project will contribute knowledge about the effectiveness of an incremental, practice-driven approach to PD and instructional change.

Developing and Researching K-12 Teacher Leaders Enacting Anti-bias Mathematics Education (Collaborative Research: Heaton)

The goal of this project is to study the design and development of community-centered, job-embedded professional development for classroom teachers that supports bias reduction. The project team will partner with three school districts serving racially, ethnically, linguistically, and socio-economically diverse communities, for a two-year professional development program.

Lead Organization(s): 
Award Number: 
2101668
Funding Period: 
Sun, 08/01/2021 to Thu, 07/31/2025
Full Description: 

There is increased recognition that engaging all students in learning mathematics requires an explicit focus on anti-bias mathematics teaching. Teachers, even with positive intentions, have biases, causing them to treat students differently and impacting how they distribute students’ opportunities to learn in K-12 mathematics classrooms. Research is needed to examine models of mathematics teacher professional development that explicitly addresses bias reduction. The goal of this project is to study the design and development of community-centered, job-embedded professional development for classroom teachers that supports bias reduction. The project team will partner with three school districts serving racially, ethnically, linguistically, and socio-economically diverse communities, for a two-year professional development program. The aim is to reduce bias through: analyzing and designing mathematics teaching with colleagues, students, and families to create classrooms and schools based on community-centered mathematics; engaging in anti-bias teaching routines; and building relationships with parents, caretakers, and community members. The project team will study teacher leader professional development, including the professional development model, framework, and tools, along with what teacher leaders across district contexts and grade-levels take up and use in their instructional practice.  This will potentially have wider implications for supporting more equitable mathematics teaching and leadership. Project activities, resources, and tools will be shared with the broader community of mathematics educators and researchers for use in other contexts.

The goal of this two-phase, design based research project is to iteratively design and research teacher leaders’ (TLs) participation in community-centered, job-embedded professional development and investigate their subsequent impact on classrooms, schools, and districts. The project builds on the existing Math Studio professional development model to create a Community Centered Math Studio, integrating the Anti-bias Mathematics Education Framework into the work. The project seeks to understand how the professional development model supports the development of teacher leaders' knowledge, dispositions, and practices for teaching and leading anti-bias mathematics education, and how teachers' subsequent classroom practice can cultivate students' mathematical engagement, discourse, and interests. The project will measure aspects of teacher knowledge and classroom practice by integrating existing classroom observation rubrics and STEM interest surveys to assess the impact on teacher classroom practice and student outcomes. The project will engage 12 TLs and approximately 60 additional teachers working with those TLs in two years of professional development using the Community Centered Math Studio Model to support anti-bias mathematics teaching. Data will be collected for all teachers related to their participation in the professional learning, with six teachers being followed for additional data collection and in-depth case studies. The project's outcomes will contribute to theories of how TLs build adaptive expertise for teaching and leading to reduce bias in classrooms, departments, schools, and districts. In addition, the project will contribute new and adapted research instruments on anti-bias teaching and leading. The research outcomes will add to the growing research base that describes the nature of equitable mathematics teaching in K-12 classrooms and increases access to meaningful mathematics for students, teachers, and communities.

Developing and Researching K-12 Teacher Leaders Enacting Anti-bias Mathematics Education (Collaborative Research: Elliott)

The goal of this project is to study the design and development of community-centered, job-embedded professional development for classroom teachers that supports bias reduction. The project team will partner with three school districts serving racially, ethnically, linguistically, and socio-economically diverse communities, for a two-year professional development program.

Lead Organization(s): 
Award Number: 
2101667
Funding Period: 
Sun, 08/01/2021 to Thu, 07/31/2025
Full Description: 

There is increased recognition that engaging all students in learning mathematics requires an explicit focus on anti-bias mathematics teaching. Teachers, even with positive intentions, have biases, causing them to treat students differently and impacting how they distribute students’ opportunities to learn in K-12 mathematics classrooms. Research is needed to examine models of mathematics teacher professional development that explicitly addresses bias reduction. The goal of this project is to study the design and development of community-centered, job-embedded professional development for classroom teachers that supports bias reduction. The project team will partner with three school districts serving racially, ethnically, linguistically, and socio-economically diverse communities, for a two-year professional development program. The aim is to reduce bias through: analyzing and designing mathematics teaching with colleagues, students, and families to create classrooms and schools based on community-centered mathematics; engaging in anti-bias teaching routines; and building relationships with parents, caretakers, and community members. The project team will study teacher leader professional development, including the professional development model, framework, and tools, along with what teacher leaders across district contexts and grade-levels take up and use in their instructional practice.  This will potentially have wider implications for supporting more equitable mathematics teaching and leadership. Project activities, resources, and tools will be shared with the broader community of mathematics educators and researchers for use in other contexts.

The goal of this two-phase, design based research project is to iteratively design and research teacher leaders’ (TLs) participation in community-centered, job-embedded professional development and investigate their subsequent impact on classrooms, schools, and districts. The project builds on the existing Math Studio professional development model to create a Community Centered Math Studio, integrating the Anti-bias Mathematics Education Framework into the work. The project seeks to understand how the professional development model supports the development of teacher leaders' knowledge, dispositions, and practices for teaching and leading anti-bias mathematics education, and how teachers' subsequent classroom practice can cultivate students' mathematical engagement, discourse, and interests. The project will measure aspects of teacher knowledge and classroom practice by integrating existing classroom observation rubrics and STEM interest surveys to assess the impact on teacher classroom practice and student outcomes. The project will engage 12 TLs and approximately 60 additional teachers working with those TLs in two years of professional development using the Community Centered Math Studio Model to support anti-bias mathematics teaching. Data will be collected for all teachers related to their participation in the professional learning, with six teachers being followed for additional data collection and in-depth case studies. The project's outcomes will contribute to theories of how TLs build adaptive expertise for teaching and leading to reduce bias in classrooms, departments, schools, and districts. In addition, the project will contribute new and adapted research instruments on anti-bias teaching and leading. The research outcomes will add to the growing research base that describes the nature of equitable mathematics teaching in K-12 classrooms and increases access to meaningful mathematics for students, teachers, and communities.

Developing and Researching K-12 Teacher Leaders Enacting Anti-bias Mathematics Education (Collaborative Research: Thanheiser)

The goal of this project is to study the design and development of community-centered, job-embedded professional development for classroom teachers that supports bias reduction. The project team will partner with three school districts serving racially, ethnically, linguistically, and socio-economically diverse communities, for a two-year professional development program.

Lead Organization(s): 
Award Number: 
2101665
Funding Period: 
Sun, 08/01/2021 to Thu, 07/31/2025
Full Description: 

There is increased recognition that engaging all students in learning mathematics requires an explicit focus on anti-bias mathematics teaching. Teachers, even with positive intentions, have biases, causing them to treat students differently and impacting how they distribute students’ opportunities to learn in K-12 mathematics classrooms. Research is needed to examine models of mathematics teacher professional development that explicitly addresses bias reduction. The goal of this project is to study the design and development of community-centered, job-embedded professional development for classroom teachers that supports bias reduction. The project team will partner with three school districts serving racially, ethnically, linguistically, and socio-economically diverse communities, for a two-year professional development program. The aim is to reduce bias through: analyzing and designing mathematics teaching with colleagues, students, and families to create classrooms and schools based on community-centered mathematics; engaging in anti-bias teaching routines; and building relationships with parents, caretakers, and community members. The project team will study teacher leader professional development, including the professional development model, framework, and tools, along with what teacher leaders across district contexts and grade-levels take up and use in their instructional practice.  This will potentially have wider implications for supporting more equitable mathematics teaching and leadership. Project activities, resources, and tools will be shared with the broader community of mathematics educators and researchers for use in other contexts.

The goal of this two-phase, design based research project is to iteratively design and research teacher leaders’ (TLs) participation in community-centered, job-embedded professional development and investigate their subsequent impact on classrooms, schools, and districts. The project builds on the existing Math Studio professional development model to create a Community Centered Math Studio, integrating the Anti-bias Mathematics Education Framework into the work. The project seeks to understand how the professional development model supports the development of teacher leaders' knowledge, dispositions, and practices for teaching and leading anti-bias mathematics education, and how teachers' subsequent classroom practice can cultivate students' mathematical engagement, discourse, and interests. The project will measure aspects of teacher knowledge and classroom practice by integrating existing classroom observation rubrics and STEM interest surveys to assess the impact on teacher classroom practice and student outcomes. The project will engage 12 TLs and approximately 60 additional teachers working with those TLs in two years of professional development using the Community Centered Math Studio Model to support anti-bias mathematics teaching. Data will be collected for all teachers related to their participation in the professional learning, with six teachers being followed for additional data collection and in-depth case studies. The project's outcomes will contribute to theories of how TLs build adaptive expertise for teaching and leading to reduce bias in classrooms, departments, schools, and districts. In addition, the project will contribute new and adapted research instruments on anti-bias teaching and leading. The research outcomes will add to the growing research base that describes the nature of equitable mathematics teaching in K-12 classrooms and increases access to meaningful mathematics for students, teachers, and communities.

Developing and Researching K-12 Teacher Leaders Enacting Anti-bias Mathematics Education (Collaborative Research: Yeh)

The goal of this project is to study the design and development of community-centered, job-embedded professional development for classroom teachers that supports bias reduction. The project team will partner with three school districts serving racially, ethnically, linguistically, and socio-economically diverse communities, for a two-year professional development program.

Lead Organization(s): 
Award Number: 
2101666
Funding Period: 
Sun, 08/01/2021 to Thu, 07/31/2025
Full Description: 

There is increased recognition that engaging all students in learning mathematics requires an explicit focus on anti-bias mathematics teaching. Teachers, even with positive intentions, have biases, causing them to treat students differently and impacting how they distribute students’ opportunities to learn in K-12 mathematics classrooms. Research is needed to examine models of mathematics teacher professional development that explicitly addresses bias reduction. The goal of this project is to study the design and development of community-centered, job-embedded professional development for classroom teachers that supports bias reduction. The project team will partner with three school districts serving racially, ethnically, linguistically, and socio-economically diverse communities, for a two-year professional development program. The aim is to reduce bias through: analyzing and designing mathematics teaching with colleagues, students, and families to create classrooms and schools based on community-centered mathematics; engaging in anti-bias teaching routines; and building relationships with parents, caretakers, and community members. The project team will study teacher leader professional development, including the professional development model, framework, and tools, along with what teacher leaders across district contexts and grade-levels take up and use in their instructional practice.  This will potentially have wider implications for supporting more equitable mathematics teaching and leadership. Project activities, resources, and tools will be shared with the broader community of mathematics educators and researchers for use in other contexts.

The goal of this two-phase, design based research project is to iteratively design and research teacher leaders’ (TLs) participation in community-centered, job-embedded professional development and investigate their subsequent impact on classrooms, schools, and districts. The project builds on the existing Math Studio professional development model to create a Community Centered Math Studio, integrating the Anti-bias Mathematics Education Framework into the work. The project seeks to understand how the professional development model supports the development of teacher leaders' knowledge, dispositions, and practices for teaching and leading anti-bias mathematics education, and how teachers' subsequent classroom practice can cultivate students' mathematical engagement, discourse, and interests. The project will measure aspects of teacher knowledge and classroom practice by integrating existing classroom observation rubrics and STEM interest surveys to assess the impact on teacher classroom practice and student outcomes. The project will engage 12 TLs and approximately 60 additional teachers working with those TLs in two years of professional development using the Community Centered Math Studio Model to support anti-bias mathematics teaching. Data will be collected for all teachers related to their participation in the professional learning, with six teachers being followed for additional data collection and in-depth case studies. The project's outcomes will contribute to theories of how TLs build adaptive expertise for teaching and leading to reduce bias in classrooms, departments, schools, and districts. In addition, the project will contribute new and adapted research instruments on anti-bias teaching and leading. The research outcomes will add to the growing research base that describes the nature of equitable mathematics teaching in K-12 classrooms and increases access to meaningful mathematics for students, teachers, and communities.

The Impact of COVID on American Education in 2021: Continued Evidence from the Understanding America Study

This study will build upon the team's prior research from early in the pandemic. Researchers will continue to collect data from families and aims to understand parents’ perspectives on the educational impacts of COVID-19 by leveraging a nationally representative, longitudinal study, the Understanding America Study (UAS). The study will track educational experiences during the Spring and Summer of 2021 and into the 2021-22 school year.

Award Number: 
2120194
Funding Period: 
Mon, 03/01/2021 to Mon, 02/28/2022
Full Description: 

The COVID-19 epidemic has been a tremendous disruption to the education of U.S. students and their families, and evidence suggests that this disruption has been unequally felt across households by income and race/ethnicity. While other ongoing data collection efforts focus on understanding this disruption from the perspective of students or educators, less is known about the impact of COVID-19 on children’s prek-12 educational experiences as reported by their parents, especially in STEM subjects. This study will build upon the team's prior research from early in the pandemic. Researchers will continue to collect data from families and aims to understand parents’ perspectives on the educational impacts of COVID-19 by leveraging a nationally representative, longitudinal study, the Understanding America Study (UAS). The study will track educational experiences during the spring and summer of 2021 and into the 2021-22 school year. The team will analyze outcomes overall and for key demographic groups of interest as students and teachers return to in-person instruction during 2021. This RAPID project allows critically important data to continue to be collected and contribute to continued understanding of the impacts of and responses to the pandemic by American families.

Since March of 2020, the UAS has been tracking the educational impacts of COVID-19 for a nationally representative sample of approximately 1,400 households with preK-12 children. Early results focused on quantifying the digital divide and documenting the receipt of important educational services--like free meals and special education servicesafter COVID-19 began. This project will support the continued targeted administration of UAS questions to parents about students’ learning experiences and engagement, overall and in STEM subjects, data analysis, and dissemination of results to key stakeholder groups. Findings will be reported overall and across key demographic groups including ethnicity, disability, urbanicity, and socioeconomic status. This project will also produce targeted research briefs addressing pressing policy questions aimed at supporting intervention strategies in states, districts, and schools moving forward. Widespread dissemination will take place through existing networks and in collaboration with other research projects focused on understanding the COVID-19 crisis. All cross-sectional and longitudinal UAS data files will be publicly available shortly after conclusion of administration so that other researchers can explore the correlates of, and outcomes associated with, COVID-19.

Enhancing Science Education through Virtual Reality: A Conference to Design Simulations that Enhance the Clinical Preparation of Secondary Science Teachers

This conference focuses on the use of virtual/mixed reality simulation in the preparation of secondary science teachers. The conference convenes experts in simulation in teacher preparation, practicing high school teachers, and teacher candidates to engage in a design process related to mixed reality simulations. Conference attendees will identify important gaps in science teacher preparation and design prototype simulation environments for addressing those gaps.

Award Number: 
2040747
Funding Period: 
Fri, 01/01/2021 to Fri, 12/31/2021
Full Description: 

This conference focuses on the use of virtual/mixed reality simulation in the preparation of secondary science teachers. Educator preparation programs (EPPs) face significant challenges in providing science teacher candidates with quality clinical placements in high school science classrooms. Placements typically do not include the variety of science subject areas that teacher candidates are likely to teach (e.g., biology, chemistry, geoscience, physics) and the classes may not include important student populations such as English language learners or students who receive special education services. The use of virtual and/or mixed reality teaching simulations can address these needs by providing teacher candidates with opportunities to teach a wide range of science content and a diverse set of science learners. This conference brings together stakeholders in science teacher education to develop prototype simulation environments to address these gaps.

The conference convenes experts in simulation in teacher preparation, practicing high school teachers, and teacher candidates to engage in a design process related to mixed reality simulations. Conference attendees will identify important gaps in science teacher preparation and design prototype simulation environments for addressing those gaps. Mursion, a leader in mixed-reality teaching simulations, will provide the platform and resources to rapidly design and test prototypes that build on their current simulation deployment and provide these prototypes to conference attendees and members of the American Association of Colleges of Teacher Education (AACTE) to use and test in their EPP settings. Another key outcome of the convening is the development of a networked improvement community that would develop guidance for the effective use of simulations in science teacher preparation. This work will have a broad impact as the networked improvement community will continue to iterate and advance the use of the simulations in high school science teacher preparation programs.

Building Networks and Enhancing Diversity in the K-12 STEM Teaching Workforce

The goal of this planning grant is to explicitly focus on broadening participation in the K-12 STEM teaching workforce, with the theory of action that diversifying the K-12 STEM teaching workforce would in the long term help more students see STEM as accessible to them and then be more likely to choose a STEM degree or career.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
2040784
Funding Period: 
Tue, 12/01/2020 to Tue, 11/30/2021
Full Description: 

The goal of this planning grant is to explicitly focus on broadening participation in the K-12 STEM teaching workforce, with the theory of action that diversifying the K-12 STEM teaching workforce would in the long term help more students see STEM as accessible to them and then be more likely to choose a STEM degree or career. Currently there is a large demographic discrepancy between students and teachers in K-12 schools. Studies have highlighted that the diverse teaching workforce benefits not only students of color but all students. Since 2017, the Smithsonian Science Education Center has conducted an annual STEM Diversity Summit, with the goal of building a coalition (built on collective impact) for attracting and retaining a diverse K-12 STEM teaching workforce, in which teams of teachers and administrators representing 83 school districts, schools, and states across the country shared their problems and developed a logic model to attract and retain a diverse K-12 STEM teaching workforce in their region with annual support from a matched mentor. This planning grant supports revisiting those former teams to better understand the dynamics of systems change through close examination of the successes and challenges outlined in their logic models with the perspective of the Cultural-Historical Activity Theory (CHAT). Under the collaborative infrastructure elements of shared vision and partnerships, this planning grant will inform and lay the foundation for a future alliance focused on diversifying the K-12 STEM teaching workforce.

In this planning grant, the Smithsonian in collaboration with Howard University, as well as in partnership with other experts in STEM teacher education, professional development, and diversityincluding from Harvard University, Rutgers University, 100kin10, National Board for Professional Teaching Standards, MA Department of Higher Education, STEM Equity Alliance, National Science Teaching Association, and private industrywill work on four primary activities. First, a survey will be developed and conducted with faculty members of Institutions of Higher Education (IHEs), including approximately 100 Minority Serving Institutions, which serve diverse populations in K-12 teacher preparation programs and STEM education across the country. The goal of the survey is to understand what roles IHEs play in organizational change management and strategic planning to diversify the K-12 STEM teaching workforce. Second, a virtual workshop will be convened to bring former STEM Diversity Summit attendees and their extended networks to reflect on their progress and activities in past years and discuss strategic long-term plans. Third, a survey with the virtual workshop participants will be conducted to better understand their practices, attitudes, and perceptions about their roles to create culturally diverse ecosystems in K-12 STEM education. Finally, all the collected information from the above activities will be used to investigate strategies and evidence-based practices of enhancing diversity in the K-12 STEM teaching workforce, and an iterative source book will be developed based on those findings as an initial resource to ground future work. Over a 12 month period, this planning grant will build a network between the former teams and with the extended partners, including the NSF INCLUDES National Network, and help them to grow as regional hubs within a Future NSF INCLUDES Alliance focused on diversifying the K-12 STEM teacher workforce, with the Smithsonian as the backbone organization.

Improving Evaluations of STEM Programs: An Empirical Investigation of Key Design Parameters

This study seeks to further understanding of the STEM learning environment by 1) examining the extent to which mathematics and science achievement varies across students, teachers, schools, and districts, and 2) examining the extent to which student, teacher, school, and district characteristics that are found in state administrative databases can be used to explain this variation at each level.

Lead Organization(s): 
Award Number: 
2000388
Funding Period: 
Mon, 06/15/2020 to Wed, 05/31/2023
Full Description: 

To improve science, technology, engineering, and mathematics (STEM) outcomes in K-12 classrooms, it is critical to understand the landscape of the STEM learning environment. However, the STEM learning environment is complex. Students are nested within teachers, and teachers are nested within schools (which in turn are nested within districts), which implies a multilevel structure. To date, most empirical research that uses multilevel modeling to examine the role of higher levels on variation in student outcomes does not examine the teacher level. The reason is that for many states, data linkages between students and teachers have been difficult to achieve. However, in the last five years, this situation has improved in many states, which makes this work now possible. This study seeks to further understanding of the STEM learning environment by 1) examining the extent to which mathematics and science achievement varies across students, teachers, schools, and districts and 2) examining the extent to which student, teacher, school, and district characteristics that are found in state administrative databases can be used to explain this variation at each level. This work will support advances in research and evaluation methodologies that will enable researchers to design more rigorous and comprehensive evaluations of STEM interventions and improve the accuracy of statistical power calculations. Broad dissemination of the resulting tools and techniques will provide access through freely available websites, and workshops and training opportunities to build capacity in the field for STEM researchers to design cluster randomized trials (CRTs) to answer questions beyond what works to for whom and under what conditions.

This project will contribute to 1) describing and explaining the landscape of the STEM learning environment, an environment which includes students, teachers, and schools, and 2) applying this empirical information in the design of STEM intervention studies to enable researchers to extend beyond the usual questions about if the intervention works and for which types of students or schools. By adding teacher level variables, this analysis would account for key teacher characteristics that may moderate the treatment effect. The research will also increase the efficiency in the design of CRTs of STEM interventions. Specifically, the findings from this study will improve the internal validity and cost-efficiency of evaluations of STEM interventions by increasing the accuracy of estimates for the full range of parameters needed to conduct power analyses, particularly when the teacher level is included. The high cost associated with CRTs makes it critical to plan accurate trials that do not overestimate the required sample size, and hence cost more than necessary, or underestimate the sample size and thereby reduce the potential to generate high-quality evidence of program effectiveness. Including the teacher level in intervention studies, a critical level in the delivery of any intervention, will allow for more testing of teacher characteristics that may moderate intervention effects.

Pages

Subscribe to High School