This project aims to engage students in meaningful scientific data collection, analysis, visualization, modeling, and interpretation. It targets grades 9-12 science instruction. The proposed research poses the question "How do learners conceive of and interact with empirical data, particularly when it has a hierarchical structure in which parameters and results are at one level and raw data at another?"
This project aims to engage students in meaningful scientific data collection, analysis, visualization, modeling, and interpretation. It targets grades 9-12 science instruction. The proposed research poses the question "How do learners conceive of and interact with empirical data, particularly when it has a hierarchical structure in which parameters and results are at one level and raw data at another?" As working with data becomes an integral part of students' learning across STEM curricula, understanding how students conceive of data grows ever more important. This is particularly timely as science becomes more and more data driven.
The team will develop and test a Common Online Data Analysis Platform (CODAP). STEM curriculum development has moved online, but development of tools for students to engage in data analysis has yet to follow suit. As a result, online curriculum development projects are often forced to develop their own data analysis tools, settle for desktop tools, or do without. In a collaboration with NSF-funded projects at the Concord Consortium, Educational Development Center, and University of Minnesota, the project team is developing an online, open source data analysis platform that can be used not only by these three projects, but subsequently by others.
The proposed research breaks new ground both in questions to be investigated and in methodology. The investigations build on prior research on students' understanding of data representation, measures of center and spread, and data modeling to look more closely at students' understanding of data structures especially as they appear in real scientific situations. Collaborative design based on three disparate STEM projects will yield a flexible data analysis environment that can be adopted by additional projects in subsequent years. Such a design process increases the likelihood that CODAP will be more than a stand-alone tool, and can be meaningfully integrated into online curricula. CODAP's overarching goal is to improve the preparation of students to fully participate in an increasingly data-driven society. It proposes to do so by improving a critical piece of infrastructure: namely, access to classroom-friendly data analysis tools by curriculum developers who wish to integrate student engagement with data into content learning.
This is a quasi-experimental study of the effects of attending an inclusive STEM high school in three key geographic regions and comparing outcomes for students in these schools with those of their counterparts attending other types of schools in the same states. The study's focus is on the extent to which inclusive STEM high schools contribute to improved academic outcomes, interests in STEM careers, and expectations for post secondary study.
Researchers from SRI and George Washington University are studying the effectiveness of inclusive STEM high schools in three key geographic regions including Texas, North Carolina and Ohio. STEM schools continue to be an important policy area and test bed for one indication of what STEM education can accomplish under the most optimal conditions in which STEM is the focus of students' learning experiences. The President has called for the creation of an additional 1,000 STEM schools with relatively little evidence about the impact of such schools or the evidence of which configurations and elements of such schools are important. The study's focus is on the extent to which inclusive STEM high schools contribute to improved academic outcomes, interests in STEM careers, and expectations for post secondary study. The research study engages in implementation research to examine the elements of the STEM schools' design and implementation and other contextual factors, including state policies, which are associated with superior outcomes.
This is a quasi-experimental study of the effects of attending an inclusive STEM high school comparing outcomes for students in these schools with those of their counterparts attending other types of schools in the same states. The study includes all students in the 9th or 12th grade in the inclusive STEM high schools and students in samples of same-state comparison schools identified through propensity score matching. Data are collected longitudinally using student records and surveying students at regular intervals. The study follows the 12th grade students after graduation into postsecondary study and the workforce. The states identified in this study have the requisite administrative data systems to support the proposed study. By using a combination of data available in state-level data bases and new information obtained through project surveys, the researchers are identifying students who are matched not only on demographic variables and academic achievement before high school entry, but also on indicators of pre-existing interest and expectation such as self-efficacy and prior participation in informal STEM-related activities. Impacts on student achievement are analyzed separately for each state. Data on the elements of STEM schools are collected through teacher and administrator surveys and interviews. State STEM school history and policy data are collected through document analysis and interviews. The study utilizes hierarchical regression models, with separate models of each outcome measure and adjustments for tests of multiple comparisons. Student attrition is monitored and findings are examined to determine influence of attrition.
This project focuses on inclusive rather than selective STEM schools so that the population of students more typically represents the population of the students locally. The study provides a source of evidence about not only the effectiveness of STEM schools, but also contextual evidence of what works and for whom and under what conditions.
This project is designing and conducting a crowd-sourced open innovation challenge to young people of ages 13-18 to mitigate levels of greenhouse gases. The goal of the project is to explore the extent to which the challenge will successfully attract, engage and motivate teen participants to conduct sustained and meaningful scientific inquiry across science, technology and engineering disciplines.
This project is designing and conducting a crowd-sourced open innovation challenge to young people of ages 13-18 to mitigate levels of greenhouse gases. The goal of the project is to explore the extent to which the challenge will successfully attract, engage and motivate teen participants to conduct sustained and meaningful scientific inquiry across science, technology and engineering disciplines. Areas in which active cutting edge research on greenhouse gas mitigation is currently taking place include, among others, biology (photosynthesis, or biomimicry of photosynthesis to sequester carbon) and chemistry (silicon chemistry for photovoltaics, carbon chemistry for decarbonization of fossil fuels). Collaborating in teams of 2-5, participants engage with the basic science in these areas, and become skilled at applying scientific ideas, principles, and evidence to solve a design problem, while taking into account possible unanticipated effects. They refine their solutions based on scientific knowledge, student-generated sources of evidence, prioritized criteria, and tradeoff considerations.
An interactive project website describes specifications for the challenge and provides rubrics to support rigor. It includes a library of relevant scientific resources, and, for inspiration, links to popular articles describing current cutting-edge scientific breakthroughs in mitigation. Graduate students recruited for their current work on mitigation projects provide online mentoring. Social networking tools are used to support teams and mentors in collaborative scientific problem-solving. If teams need help while working on their challenges, they are able to ask questions of a panel of expert scientists and engineers who are available online. At the end of the challenge, teams present and critique multimedia reports in a virtual conference, and the project provides awards for excellence.
The use of open innovation challenges for education provides a vision of a transformative setting for deep learning and creative innovation that at the same time addresses a problem of critical importance to society. Researchers study how this learning environment improves learning and engagement among participants. This approach transcends the informal/formal boundaries that currently exist, both in scientific and educational institutions, and findings are relevant to many areas of research and design in both formal and informal settings. Emerging evidence suggests that open innovation challenges are often successfully solved by participants who do not exhibit the kinds of knowledge, skill or disciplinary background one might expect. In addition, the greater the diversity of solvers is, the greater the innovativeness of challenge solutions tends to be. Therefore, it is expected that the free choice learning environment, the nature of the challenge, the incentives, and the support for collaboration will inspire the success of promising young participants from underserved student populations, as well as resulting in innovative solutions to the challenge given the diversity of teams.
An Innovative Approach to Earth Science Teacher Preparation: Uniting Science, Informal Science Education, and Schools to Raise Student Achievement
The American Museum of Natural History in New York City, in partnership with New York University, and in collaboration with five high-needs schools, is developing, implementing, and researching a five-year pilot Master of Arts in Teaching (MAT) program in Earth Science. The program is delivered by the Museum's scientific and education teams and its evaluation covers aspects of the program from recruitment to first year of teaching.
The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.
The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.
The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”
This effectiveness study focuses on the scale-up of a model of curricular and teacher professional development intervention aimed at improving science achievement of all students, especially English language learners (ELLs). The model consists of three basic components: (a) inquiry-oriented science curriculum, (b) teacher professional development for science instruction with these students, and (c) school resources for science instruction.
This four-year effectiveness study focuses on the scale-up of a model of curricular and teacher professional development intervention aimed at improving science achievement of all students, especially English language learners (ELLs). The model consists of three basic components: (a) inquiry-oriented science curriculum, (b) teacher professional development for science instruction with these students, and (c) school resources for science instruction. The project's main goals are: (1) to evaluate the effect of the intervention on student achievement, (2) to determine the effect of the intervention on teacher knowledge, practices, and school resources, and (3) to assess how teacher knowledge, practices, and resources mediate student achievement. The project is conducted in the context of the Florida current science education policies and accountability system (e.g., adoption of the Next Generation Sunshine State Standards in Science, assessment of science at the fifth grade, a Race to the Top award state). The study draws on findings from research on a previous NSF-funded efficacy study (035331) in which the model to be scaled-up was tested in a single school district. The effectiveness study includes three (of 67) school districts as key partners, representative of racially, ethnically, linguistically, and socioeconomically diverse student populations; 64 elementary schools, 320 science teachers, and 24,000 fifth-grade students over a three-year period. Science learning is the primary subject matter, inclusive of life, physical, and earth/space sciences. Six research questions corresponding to three research areas guide the proposed scope of work. For the research area of Student Science Achievement, questions are: (1) What is the effect of the intervention on fifth-grade students' science achievement, compared to "business as usual"?, and (2) To what extent are the effects of the intervention moderated by students' English as a Second Language (ESOL) level, SES status, and racial/ethnic backgrounds? For Teacher Knowledge and Practices as a research area, questions are: (3) What is the effect of the intervention on teachers' science knowledge and teaching practices?, and (4) To what extent is students' science achievement predicted by school resources for science instruction? For School Resources for Science, questions are: (5) What is the effect of the intervention on school resources for science instruction?, and (6) To what extent is student achievement predicted by school resources for science instruction? To assess the effect of the intervention on students' and teachers' outcomes, a cluster-randomized-control trial is used, resulting in a total of 64 randomly selected schools (after stratifying them by school-level percent of ESOL and Free Reduced Lunch students). All science teachers and students from the 64 schools participate in the project: 32 in the treatment group (project curriculum for fifth grade, teacher professional development, and instructional resources), and 32 in the control group (district-adopted fifth-grade curriculum, no teacher professional development, and no instructional resources). To address the research area of Student Science Achievement, formative assessment items are used at the end of each curriculum unit, along with two equated forms of a project-developed science test (to be used as pre-and posttests) with both treatment and control groups, in addition to the Florida's Comprehensive Assessment Tests-Science. Data interpretation for this research area employs a set of three-level HLMs (students, nested in classrooms, nested in schools). To address the research area of Teacher Knowledge and Practices and School Resources for Science, the project uses three measures: (a) two equated forms of a 35-items test of teacher science knowledge, (b) a classroom observation instrument measuring third-party ratings of teacher knowledge and teaching practices, and (c) a questionnaire measuring teachers' self-reports of science knowledge and teaching practices. All measures are administered to both treatment and control groups. Data interpretation strategies include a series of HLMs with emphasis on the relevant teacher outcomes as a function of time, and of school-level mediating variables. External project evaluation is conducted by Concentric Research and Evaluation using quantitative and qualitative methods and addressing both formative and summative components. Project research findings contribute to the refinement of a model reflective of the new science standards in the State and the emerging national science standards. The value added of this effort consists of its potential to inform effective implementation of science curricula and teacher professional development in other learning settings, including ELLs and traditionally marginalized student populations at the elementary school level. It constitutes practically the only research study focused on the issue of scale-up and sustainability of effective science education practices with this student subpopulation, which has become prominent due to the dramatic growth of a racially, ethnically, and linguistically diverse school-aged population, low levels of U.S. student science achievement, and the role of science and mathematics in current accountability systems nationwide.
Investigating and Supporting the Development of Ambitious and Equitable Mathematics Instruction at Scale
This project is supporting and investigating the implementation of reformed mathematics instruction at the middle school level in two large school districts. The primary goal of the project is to develop an empirically grounded theory of action for implementing reform at school and district levels. The researchers are investigating reform within a coherent system that focuses on leadership and school-based professional development.
The Development of Ambitious and Equitable Mathematics Instruction project is supporting and investigating the implementation of reformed mathematics instruction at the middle school level in two large school districts. Project researchers are asking: What does it take to support mathematics teachers' development of ambitious and equitable instructional practices on a large scale? The project has built on what was learned in a previous, successful project studying the implementation of a middle school mathematics curriculum. The primary goal of the new project is to develop an empirically grounded theory of action for implementing reform at school and district levels. The researchers are investigating reform within a coherent system that focuses on leadership and school-based professional development. In addition, they are facilitating a longitudinal study of the curriculum implementation by continuing the data collection from the original study.
In order to build a theory of action, the project team is synthesizing data from a variety of domains including instructional systems (e.g., curriculum, materials, professional development, support for struggling students, and learning communities), mathematics coaching, networks of teachers, school leadership, and district leadership. Investigators are using a variety of analytic techniques to successfully integrate both quantitative and qualitative data as they seek to understand how school district strategies are playing out in schools and classrooms and how those strategies can be revised in order to improve student learning of mathematics.
An empirically grounded theory of action for implementing reform will help the mathematics education community to implement and to understand the process of reforming mathematics instruction at the middle school level. Many advances in mathematics instruction have been documented within a limited context, but researchers and practitioners need to understand the full range of action necessary to achieve similar successes at a district-wide level. The model developed from this project, in conjunction with longitudinal data, has the potential to guide future reform efforts that seek to provide ambitious and equitable mathematics instruction.
This project examines the first-year implementation of a program that will provide low-cost netbook computers and specialized software to fifth and sixth grade students in four schools in Southern California. The PIs collect baseline and early implementation data to determine effects of the intervention on students' academic achievement in science, academic writing in science, and interest in further STEM study.
This is a RAPID award to investigators at the University of California, Irvine, to examine the first-year implementation of a program that will provide low-cost netbook computers and specialized software to fifth and sixth grade students in four schools in Southern California. The PIs collect baseline and early implementation data to determine effects if the intervention on students' academic achievement in science, academic writing in science, and interest in further STEM study. They also examine the extent to which participation in the program improves student access to, use of, and self-perceived proficiency with technology and how these attributes are mediated by socioeconomic status, ethnicity, and English learner status. Additionally, they examine the effect of the program on teachers' knowledge of and use of technology for instruction.
Four schools from the same school district with similar demographics serve as comparison schools in the study. Additionally, all fifth and sixth grade teachers participate in the study with four program teachers (two at fifth grade and two at sixth grade) participating more extensively as focus teachers. Both qualitative and quantitative methods are used to examine the effects of the program.
The products include analysis of extensive data on implementation, learning and attitudes. A total of 531 students are involved in the study as well as their teachers. The findings are likely to guide subsequent implementation and research on full implementation within the targeted schools.