Concerns about both economic competitiveness and educational equity emphasize the need for the United States to broaden and diversify the pipeline of students prepared and motivated to pursue STEM college majors. An emerging strategy for addressing this need is large-scale implementation of inclusive STEM high schools. In this exploratory project, investigators from SRI International and George Washington University are laying the foundation for a rigorous quasi-experiment to test the effects of attending such a school using longitudinal student records, surveys, and interviews. The project's operational definition for an inclusive STEM high school (ISHS) is a school, school within a school, or school program that accepts students primarily on the basis of interest rather than aptitude or prior achievement and gives them the mathematics and science preparation they need to succeed in a STEM college major. ISHSs enroll students from groups underrepresented in STEM professions through an application process that does not require high test scores before high school entry. In contrast to selective STEM schools that admit gifted and talented students on the basis of entrance examination scores and thus select for perceived STEM aptitude, ISHSs have the more ambitious goal of developing STEM expertise.

To establish the feasibility of a large, multi-state investigation of the effectiveness of inclusive STEM schools at scale, researchers are:

- Developing a tentative taxonomy of ISHSs and exploring implications of ISHS heterogeneity for the research design;

- Recruiting three school partners representing different ISHS approaches;

- Using state data to identify a comparison school (without a particular focus on STEM) for each ISHS school partner and recruiting comparison school partners;

- Developing School Leader and three student surveys (fall 9th-grade, spring 12th-grade, and spring post-graduation);

- Collaborating with partner schools in design of data collection procedures, recruiting materials, and incentives;

- Piloting the School Leader Survey and two student surveys (9th-grade fall survey and 12th-grade spring survey) in six partner schools;

- Identifying and recruiting a larger sample of ISHSs and matched comparison schools for Year 2 data collection;

- Administering surveys in 40 or more high schools;

- Locating spring 2012 graduates of the three ISHS partner schools and pilot testing the post-graduation student survey with these students; and

- Engaging an Advisory Board who will provide methodological expertise and advice.

Ultimately, by documenting survey response rates, student location rates, and rates for successful matching of student administrative and survey data, this feasibility work is demonstrating that it is possible to collect the kind of data that would enable a large-scale study to be launched with the necessary instruments and experience in hand. As evidenced by the recent call from the President's Council of Advisors in Science and Technology for 1,000 new STEM schools and the National Research Council's report entitled "Successful K-12 STEM Education: Identifying Effective Approaches in Science, Technology, Engineering, and Mathematics" that highlights various STEM schools, the proposed research is highly relevant to current policy initiatives and debates. Moreover, the research has the potential to promote diversity in the STEM pipeline by influencing policymakers in states and districts that have yet to implement ISHSs at scale.

This project scales and further tests the Target Inquiry (TI) professional development model. The TI model involves teachers in three core experiences: 1) a research experience for teachers, 2) materials adaptation, and 3) an action research project. The original program was implemented with high school chemistry teachers at Grand Valley State University (GVSU), and was shown to result in significant increases, with large effect sizes, in teachers' understanding of science inquiry and quality of instruction, and in science achievement of those teachers' students. The scale-up and further testing would involve adding physics, biology and geology at Grand Valley State University, and implementing the program at Miami University (MU) with chemistry teachers. Three research questions will be studied:

1) How do the three TI core experiences influence in-service high school science teachers' (i) understanding of the nature of science; (ii) attitudes and beliefs about inquiry instruction; and (iii) classroom instructional methods in the derivatives of the TI model?

2) How does teacher participation in TI affect students' process skills (scientific reasoning and metacognition) and conceptual understanding of science in the derivatives of the TI model?

3) What are the challenges and solutions related to implementing TI in science disciplines beyond chemistry and in other regions?

The research design is quasi-experimental and longitudinal, incorporating implementation with research, and using quantitative and qualitative methods blended in a design research framework. A total of 54 middle and high school science teachers are being recruited for the study. The TI group is completing the TI program (N = 27; 15 at GVSU; 12 at MU) while the comparison group (same sizes and locations) is not. The comparison group is matched according to individual characteristics and school demographics. All teachers are being studied, along with their students, for 4 years (pre-program, post-RET, post-MA, post-AR/post-program). TI teachers are taking 15 credits of graduate level science courses over three years, including summers. Courses include a graduate seminar focused on preparing for the research experience, the research experience in a faculty member's science lab during the summer, application of research to teaching, action research project development, adaptation and evaluation of inquiry-focused curricula, and interpretation and analysis of classroom data from action research. Consistent feedback from professional development, teachers, and evaluation, including the previous implementation, contributes to a design-based approach. Teacher factors being studied include nature of science, inquiry teaching knowledge and beliefs, and quality of inquiry instruction. Student factors being studied include scientific reasoning; metacognition, self-efficacy, and learning processes in science; and content knowledge and conceptual understanding. Only established quantitative and qualitative instruments are being used. Quantitative analysis includes between-group comparisons by year on post-tests, with pre-tests as covariates, and multi-level models with students nested with teachers, and teachers within sites, with the teacher level as the primary unit of change. Trends over time between the treatment and comparison groups are being examined. The evaluation is using a combination of pre/post causal comparative quantitative measures and relevant qualitative data from project leaders and participants, as well as from the comparison group, to provide formative and summative evaluation input.

Outcomes of the project include documentation and understanding of the impacts on science teachers' instruction and student outcomes of research experiences for teachers when they are supported by materials adaptation and action research, and an understanding of what it takes to scale the model to different science disciplines and a different site. The project is also producing a website of instructional materials for middle and secondary science.

This CAREER awardee at Michigan Technological University is investigating the outcomes of a teacher education model designed to foster prospective mathematics teachers' abilities to notice and capitalize on important mathematical moments in instruction. The researcher engages prospective teachers in research-like analysis of unedited teacher-perspective classroom video early in their teacher education coursework in order to help them learn to identify, assess the mathematical potential of, and respond to important student ideas and insights that arise during instruction.

The research is based on a quasi-experimental design and involves three cohorts of prospective teachers. Practicing teachers from local schools collaborate with the research team. The data collected consists of classroom video. The video is coded and analyzed using Studiocode, which allows for real-time coding and for multiple users to code and annotate video segments.

The research findings are integrated into the institution's teacher education program and are also disseminated more broadly through publication and presentations at professional meetings.

This project scales and further tests the Target Inquiry (TI) professional development model. The TI model involves teachers in three core experiences: 1) a research experience for teachers (RET), 2) materials adaptation (MA), and 3) an action research (AR) project. The original program was implemented with high school chemistry teachers at Grand Valley State University (GVSU), and was shown to result in significant increases, with large effect sizes, in teachers' understanding of science inquiry and quality of instruction, and in science achievement of those teachers' students. The scale-up and further testing would involve adding physics, biology and geology at GVSU, and implementing the program at Miami University (MU) with chemistry teachers. Three research questions will be studied:

1) How do the three TI core experiences influence in-service high school science teachers' (i) understanding of the nature of science; (ii) attitudes and beliefs about inquiry instruction; and (iii) classroom instructional methods in two new applications of the TI model?

2) How does teacher participation in TI affect students' process skills (scientific reasoning and metacognition) and conceptual understanding of science in two new applications of the TI model?

3) What are the challenges and solutions related to implementing TI in science disciplines beyond chemistry and in other regions?

The research design is quasi-experimental and longitudinal, incorporating implementation with research, and using quantitative and qualitative methods blended in a design research framework. A total of 54 middle and high school science teachers are being recruited for the study. The TI group is completing the TI program (N = 27; 15 at GVSU; 12 at MU) while the comparison group (same sizes and locations) is not. The comparison group is matched according to individual characteristics and school demographics. All teachers are being studied, along with their students, for 4 years (pre-program, post-RET, post-MA, post-AR/post-program). TI teachers are taking 15 credits of graduate level science courses over three years, including summers. Courses include a graduate seminar focused on preparing for the research experience, the research experience in a faculty member's science lab during the summer, application of research to teaching, action research project development, adaptation and evaluation of inquiry-focused curricula, and interpretation and analysis of classroom data from action research. Consistent feedback from professional development providers, other teachers, and evaluation, including comparison with the previous implementation, contributes to a design-based approach. Teacher factors being studied include beliefs about the nature of science, inquiry teaching knowledge and beliefs, and quality of inquiry instruction. Student factors being studied include scientific reasoning; metacognition, self-efficacy, and learning processes in science; and content knowledge and conceptual understanding. Only established quantitative and qualitative instruments are being used. Quantitative analysis includes between-group comparisons by year on post-tests, with pre-tests as covariates, and multi-level models with students nested within teachers, and teachers within sites, with the teacher level as the primary unit of change. Trends over time between the treatment and comparison groups are being examined. The evaluation is using a combination of pre/post causal comparative quantitative measures and relevant qualitative data from project leaders and participants, as well as from the comparison group, to provide formative and summative evaluation input.

Outcomes of the project include documentation and understanding of the impacts on science teachers' instruction and student outcomes of research experiences for teachers when they are supported by materials adaptation and action research, and an understanding of what it takes to scale the model to different science disciplines and a different site. The project is also producing a website of instructional materials for middle and secondary science.

This project--led by science educators at Michigan State University, the National Geographic Society, the Natural Resource Ecology Laboratory (NREL) at Colorado State University, the Berkeley Evaluation and Assessment Research (BEAR) Center, and AAAS Project 2061, and including schools in California, Colorado, Maryland, Michigan, and Washington--builds on prior efforts with learning progressions, and is focused on key carbon-transforming processes in socio-ecological systems at multiple scales, including cellular and organismal metabolism, ecosystem energetics and carbon cycling, carbon sequestration, and combustion of fossil fuels.

The project uses an iterative design research process to develop and refine a suite of tools for reasoning and test efficacy of those tools in geographically and culturally diverse schools. The project team is:

1. Refining and validating a detailed learning progression framework covering the middle and high school years; ultimately, the framework will describe the development of students' capacity to use fundamental principles such as conservation of matter and energy to reason about carbon-transforming processes at multiple scales.

2. Refining 'Tools for Reasoning' that make hidden scientific principles - matter, energy, and scale - visible to students; the power of these tools lies in their flexible use for different processes, systems, scales, and curricular contexts.

3. Developing and refining flexible teaching strategies that engage students in cognitive apprenticeship in the practices of environmental science literacy: a) inquiry and argumentation, b) explanations and predictions, and c) decision-making about environmental issues.

4. Using and refining existing summative assessments, and developing and testing formative assessment tools; these assessment tools will provide teachers and researchers with immediate information about their students' intellectual resources and will be linked to the learning progression framework.

5. Developing, field testing, and assessing the effectiveness of six middle school and six high school units that use project tools and enact project principles; the units introduce students to fundamental principles, engage them in reasoning about carbon-transforming processes at organismal scale, and at landscape and global scales. Each unit includes a) an online formative assessment and b) activity sequences that use tools for reasoning and teaching strategies.

6. Developing, field testing, and assessing professional development materials in both face-to-face and facilitated online forms; the materials introduce teachers to learning progressions in environmental science literacy, assessment tools, tools for reasoning, teaching strategies, and teaching materials and activities, and also address difficulties that teachers encounter in using learning progressions and enacting teaching strategies.

The primary project outcomes will be coordinated instructional tools that are useful to professionals at all levels in the science education system--classroom teachers, professional developers, and developers of curricula, standards and assessments.

This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?

The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.

The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.

There is an increasing gap between the assumptions governing the use of cyber-enabled resources in schools and the realities of their use by students in out of school settings. The potential of information and communications technologies (ICT) as cognitive tools for engaging students in scientific inquiry and enhancing teacher learning is explored. A comprehensive professional development program of over 240 hours, along with follow-up is used to determine how teachers can be supported to use ICT tools effectively in classroom instruction to create meaningful learning experiences for students, reducing the gap between formal and informal learning and improve student learning outcomes. In the first year, six teachers from school districts - two in Utah and one in New York - are educated to become teacher leaders and advisors. Then three cohorts of 30 teachers matched by characteristics are provided professional development and field test units over two years in a delayed-treatment design. Biologists from Utah State University and New York College of Technology develop four modules that meet the science standards for both states - the first being changes in the environment. Teachers are guided to develop additional modules. The key technological resource to be used in the project is the Opensimulator 3D application Server (OpenSim), an open source, modular, expandable platform used to create simulated 3D spaces with customizable terrain, weather and physics. 

The research methodology includes the use of the classroom observations using RTOP and Technology Use in Science Instruction (TUSI), selected interviews of teachers and students and validated assessments of student learning. Evaluation, by an external evaluator, assesses the quality of the professional development and the quality of the cyber-enabled learning resources, as well as reviews the research design and implementation. An Advisory Board will monitor the project. 

The project is to determine the professional development needed to make teachers comfortable teaching with multi-user simulations and communications that students use everyday. The enactment with OpenSim also provides an opportunity to demonstrate the level of planning and preparation that go into fashioning modules with all selected cyber-enabled cognitive tools framed by constructivism, such as GoogleEarth and Biologica.

This is a 3.5-year efficacy study of the Developing Mathematical Ideas (DMI) elementary math teacher professional development (PD) program. DMI was developed by staff from Education Development Center (EDC), SummerMath for Teachers, and TERC, the STEM research and development institution responsible for this research. DMI is a well-known, commercially available PD program with substantial prior evidence showing its impact on elementary teachers' mathematical and pedagogical knowledge. However, no studies have yet linked DMI directly with changes in teachers' classroom practice, or with improved student outcomes in math. This study aims to remedy this gap.

The research questions for the study are:

1) Does participation in the Developing Mathematical Ideas (DMI) professional development program lead to increases in reform-oriented teaching?

2) Does participation in DMI lead to increases in students' mathematics learning and achievement, especially in their ability to explain their thinking and justify their answers?

3) What is the process by which a reform-oriented professional development program can influence teaching practice and, thus, student learning? Through what mechanisms does DMI have impact, and with what kinds of support do we see the desired changes on our outcome measures when the larger professional development context is examined?

The dependent variables for this study include a) teachers' pedagogical and mathematics knowledge for teaching; b) the nature of their classroom practice; and c) student learning/ achievement in mathematics.

The study uses experimental and quasi-experimental methods, working with about 195 elementary grades teachers and their students in Boston, Springfield, Leominster, Fitchburg, and other Massachusetts public schools. Volunteer teachers are randomly assigned either to PD with DMI in the first year of the efficacy study, or to a control group that will wait until the second year of the study to receive DMI PD. Both groups of teachers will be followed through two academic years. Analyses use OLS regression, hierarchical modeling, and structural equation modeling, as appropriate, to compare the two groups and to track changes over time. In this way, the project explores several aspects of a conceptual framework hypothesizing relationships among PD, teacher mathematical and pedagogical knowledge, classroom teaching practice, and student outcomes. There are multiple measures of each construct, including video-analysis of teacher practice, and a new video-based measure of teacher knowledge.

The study tests the impact of DMI in a range of districts (large urban, small urban, suburban) serving an ethnically and economically diverse mix of students. It provides much needed, rigorous evidence testing the efficacy of this reform-oriented professional development program. It also directly explores the commonplace theory that teachers' understanding of content and student thinking and their encouragement of rich mathematical discourse for student sense-making lead to improvement on measures of mathematics achievement. Findings from the study are disseminated to both research and practitioner communities. The project provides professional development in mathematics to about 195 teachers to improve their ability to teach important concepts. If the evidence for efficacy is positive, then even larger-scale use of this PD program is likely.

This synthesis project is a systematic review of experimental research evaluating programs and practices in elementary science. The systematic review addresses all areas of science in the elementary grades. Different versions of the synthesis are written for audiences of researchers, policy makers, principals, and teachers. The review uses an adaptation of best-evidence synthesis previously applied to elementary and secondary mathematics and reading, and includes experimental and quasi-experimental research on the outcomes of alternative approaches to elementary science. The review is a part of a series of reviews that are part of the Best Evidence Encyclopedia (BEE), an on-line resource that disseminates systematic reviews of research on achievement outcomes of programs at all subject areas and grade levels (see www.bestevidence.org), and is led by Robert Slavin of Johns Hopkins University.

The review is carried out by a US-UK partnership of science educators and experts on systematic reviews of research. An advisory group of scientists, science educators, and experts on research review oversees the design of the review, monitors review procedures, and comments on drafts. This review takes a broad approach to searching the literature in order to locate every study that meets inclusion requirements for valid research. It includes electronic searches of educational databases (JSTOR, ERIC, EBSCO, Psych INFO, Dissertation Abstracts) using different combinations of key words (for example, "elementary students" and "science achievement"), covering the years 1970-2010. Results are narrowed by subject area (for example, "educational software", "science achievement", "instructional strategies"). Web-based repositories and education publishers' websites are included. The review also discusses each study that meets the inclusion requirements for a valid research design.

A strength of this work is that it takes on the synthesis of what is known about best practice for elementary science education, relying only on studies that meet the criteria for inclusion as having credible research designs. This is a review that is sorely needed in the field of science education. The lengthy and detailed review will be available on the BEE network, along with educator-friendly summaries. The work is also vetted via publication in a top, peer-reviewed journal. The study will include a set of tables showing ratings of programs according to consistent criteria in terms of the strength of the evidence base for each, with brief descriptions of the methods and findings. This educators' summary, patterned on Consumer Reports, is intended primarily for superintendents, principals, and teachers who are making choices among programs for implementation with their children.

This proposal outlines a research and development project that investigates how complex systems concepts supported by innovative curricular resources, technology applications and a comprehensive research and development structure can assist student learning in the domain of biology by providing a unifying theme across scales of time and space. The project seeks to address four areas of critical need in STEM education: biological sciences, complex systems, computational modeling, and equal access for all. This proposal explores how these needs are addressed through a curricular and technological intervention that structures biology learning through the framework of complex systems and computational modeling. The primary partners are the Massachusetts Institute of Technology and the University of Pennsylvania, working with eight teachers in four schools in the Boston area.

The project integrates graphical programming and simulation software, StarLogo TNG, into the standard high school biology curriculum to improve learning of biology concepts through the introduction and understanding of core complex systems processes. Instead of learning biology in discrete chunks, the chosen biological topics are connected through the framework of complex systems, and successively build in complexity from the basic building blocks of life to the interdependence and sustainability of life forms. This approach is designed to help students understand how processes at one level are connected to those at another level. The research is designed to answer the following questions: 1. Does a learning progression based on the complex systems ideas of scale and emergence enable students to make connections across biological topics, remediate known misconceptions, and apply core complex systems principles better than traditional instructional sequences? 2. What are the on-going affordances and constraints of implementation taking into consideration structural, functional and behavioral variables and what changes to project activities yield increased implementation and learning capacities? 3. Does programming of simulations increase understanding of complex systems and biology concepts compared to use of previously constructed simulations? The evaluation is designed to collect data and provide feedback on the adherence to the plan, the implementation challenged, and how research informs development.

The project anticipates a number of deliverables towards the end of the project and beyond. These include the creation of a unified high school biology curricular sequence that builds in increasing spatial and temporal scales to deepen student understanding of four core biology topics; the production, implementation and testing of curricular activities that acknowledge and ameliorate known implementation challenges; and the development of curricular strategies and tools to help teachers and students improve knowledge and skills in computational modeling, computer programming and participation in the cyberinfrastructure. In order to increase ease of integration into schools, and enhance scalability, the simulation activities are facilitated by a new web-based version of StarLogo TNG that integrates the curricular materials all of which will be distributed freely. Additional dissemination strategies include a website, conferences, a newsletter, community activities, active dissemination, and academic presentations.