This award is doing a research study of three models of professional development (PD) to test the efficacy of a practicum for grade 3-5 in-service teachers organized in three cohorts of 25. Model 1 is a one-week institute based on classroom discourse practices and a 2-week practicum (cohort 1). Model 2 is the one-week institute (cohort 2). Model 3 is a "business as usual" model (cohort 3) based on normal professional development provided by the school district. Cohorts 1 and 2 experience the interventions in year 1 with four follow-up sessions in each of years 2 and 3. In year 4 they receive no PD, but are being observed to see if they sustain the practices learned. Cohort 3 receives no treatment in years 1 and 2, but participates in a revised version of the institute plus practicum in year 3 with four follow up sessions in year 4. The Lawrence Hall of Science provides the professional development, and Stanford University personnel are conducting the research. The teachers come from the Oakland Unified School District. Science content is the GEMS Ocean Sciences Sequence.

There are 3 research questions;

1. In what ways do practicum-based professional development models influence science instructional practice?

2. What differences in student outcomes are associated with teachers' participation in the different PD programs?

3. Is the impact of the revised PD model different from the impact of the original model?

This is a designed-based research model. Teacher data is based on interviews on beliefs about teaching and the analysis of video tapes of their practicum and classroom performance using the Discourse in Inquiry Science Classrooms instrument. Student data is based on the GEMS unit pre- and post-tests and the California Science Test for 5th graders. Multiple analyses are being conducted using different combinations of the data from 8 scales across 4 years.

There will be 75 teachers and their students directly impacted by the project. Additional impacts of the project are research results and professional development materials, including a PD implementation guide and instructional videos. These will be presented in publications and conference presentations and be posted on linked websites at the Lawrence Hall of Science and the Center to Support Excellence in Teaching at Stanford University.

This award is doing a research study of three models of professional development (PD) to test the efficacy of a practicum for grade 3-5 in-service teachers organized in three cohorts of 25. Model 1 is a one-week institute based on classroom discourse practices and a 2-week practicum (cohort 1). Model 2 is the one-week institute (cohort 2). Model 3 is a "business as usual" model (cohort 3) based on normal professional development provided by the school district. Cohorts 1 and 2 experience the interventions in year 1 with four follow-up sessions in each of years 2 and 3. In year 4 they receive no PD, but are being observed to see if they sustain the practices learned. Cohort 3 receives no treatment in years 1 and 2, but participates in a revised version of the institute plus practicum in year 3 with four follow up sessions in year 4. The Lawrence Hall of Science provides the professional development, and Stanford University personnel are conducting the research. The teachers come from the Oakland Unified School District. Science content is the GEMS Ocean Sciences Sequence.

There are 3 research questions;

1. In what ways do practicum-based professional development models influence science instructional practice?

2. What differences in student outcomes are associated with teachers' participation in the different PD programs?

3. Is the impact of the revised PD model different from the impact of the original model?

This is a designed-based research model. Teacher data is based on interviews on beliefs about teaching and the analysis of video tapes of their practicum and classroom performance using the Discourse in Inquiry Science Classrooms instrument. Student data is based on the GEMS unit pre- and post-tests and the California Science Test for 5th graders. Multiple analyses are being conducted using different combinations of the data from 8 scales across 4 years.

There will be 75 teachers and their students directly impacted by the project. Additional impacts of the project are research results and professional development materials, including a PD implementation guide and instructional videos. These will be presented in publications and conference presentations and be posted on linked websites at the Lawrence Hall of Science and the Center to Support Excellence in Teaching at Stanford University.

This research study is examining the persistence of improved teacher skills achieved during the K-2 Science & Technology Assistance for Rural Teachers and Small Districts project (K-2 STARTS) funded by the State of California.

K-2 STARTS provided four years of professional development to teachers in 16 rural school districts in California with high populations of traditionally underserved students. 39 teachers each received 110 hours of professional development. Project data indicate that the project met its goals by increasing teacher content knowledge, pedagogical content knowledge, abilities to integrate science and literacy and to use research-based instructional strategies. K-2 STARTS also improved the capacity of teachers to use science resources and to network with teachers from their own and other rural districts.

This project is doing a longitudinal research study by extending data collection for 35 teachers for two years after the end of K-2 STARTS. It is using the measures from the original evaluation, which include teacher surveys and interviews, classroom observations, surveys for school administrators, teacher-developed unit artifacts, and student science notebooks, and adding two more measures, administrative interviews and school/district documents. In the final year, the project is doing data analysis and dissemination. The project is exploring the persistence of the knowledge and skills of the teachers over time, as well as their continued use of science instructional practices. It will also study the persistence of school/district support for science education.

External evaluation is being conducted by Dr. Loretta Kelley of Kelley, Peterson, and Associates, Inc. It focuses on project progress through formative and summative components.

Longitudinal studies of the effects of teacher professional development are rare. The increased knowledge concerning the persistence of the new knowledge and skills obtained through K-2 STARTS professional development, and why and to what extent they decay over time, is a significant goal.

Teaching Evolution through Human Examples (TEtHE), a three-year exploratory research and development project, is assessing how the use of resource activities and teaching strategies focused on human evolution will affect the understanding, teaching and learning of evolution by high school AP biology teachers and students. The guiding questions of the proposed project are 1) In what ways does using examples of human evolution to teach basic evolutionary concepts affect understanding of evolution among high school students? 2) In what ways do teaching strategies that focus on positive dialogue about human evolution help teachers overcome cultural challenges to teaching evolution concepts? 3) In what ways does using examples of human evolution to teach basic evolutionary concepts in conjunction with teaching strategies that focus on positive dialogue about human evolution affect understanding of evolution among high school students? TEtHE project will contribute to the field of evolution education, which is lacking on whether using teaching materials with a human emphasis along with strategies that increase teacher comfort and confidence in teaching evolution lead to greater understanding of evolution.

Project evaluation will focus on refining teaching materials and strategies and testing their efficacy in pilot studies in cooperation with the College Board and its professional development programs for the newly restructured AP course in biology. Studies include: independent assessment of teacher satisfaction with the resource activities as well as confidence and ease in use of the materials, independent review of the materials by the Advisory boards, and survey of all participating teachers to identify ways the materials were used. When addressing each question, the team will investigate validity, feasibility, usefulness, appropriateness, and student results. Methods for collection include: observation, open-response surveys, open-ended interviews, content assessments, and attitudinal surveys. The primary investigator is the Smithsonian Institute; the National Academies Teacher Advisory Board, the Understanding Evolution Teacher Advisor Board, and AP biology teachers from Washington DC serve as co-developers. The project has an external evaluator as well as an advisory board.

The TEtHE project will develop resource activities and teaching strategies with and for high school biology teachers. Professional development will also provide teachers with guidance on how to incorporate the activities and strategies into the classroom. The TEtHE project, over the course of three years, will involve over 100 AP biology teachers which will translate to reaching over 2000 AP biology students. The resources will be widely disseminated online at the end of the project, at national conferences, in national publications, and long range plans include incorporation into the national AP biology curriculum. This project could serve as a model for expanding effective methods for teaching evolution to Biology 1 classes, and contribute to an understanding of how to approach the teaching of scientific topics that intersect religious, ethical, and other areas of societal concern.

Technology educators from Black Hills State University and Purdue University partner with science educators from the University of Massachusetts at Boston and Stevens Institute of Technology to determine the viability of an engineering concept-based approach to teacher professional development for secondary school science teachers in life science and in physical science. The project refines the conceptual base for engineering at the secondary level learning (previously developed by the PIs) to increase the understanding of engineering concepts by the science teachers. In a pilot test of two weeks of professional development with ten teachers from each discipline, teachers become familiar with engineering concepts and study the process of infusing engineering concepts into science curricula so that they can develop modules in their discipline to be taught during the following in the school year. The following summer the teachers debrief the process and develop additional modules for their discipline. The process is revised and repeated with 22 teachers from each discipline. Teachers are explicitly provided strategies to help them meet the needs of diverse learners. The outputs of this project include: 1) a preliminary framework for secondary level engineering education to be published in both research and practitioner journals; 2) a pilot tested and validated Engineering Concept Assessment; 3) engineering-infused curriculum modules in life and physical science; and 4) a professional development model to prepare science teachers to infuse engineering in their teaching.

The project compares student learning when particular concepts in physics and biology are taught through engineering design with learning the same concepts taught an earlier group of students with present reform techniques used in the discipline. The hypothesis is that when teachers and students engage with engineering design activities their understanding of science concepts and inquiry are also enhanced. The research component of the project employs an iterative design with the design of activities followed by development and implementation. An engineering concept assessment is developed and tested to examine teacher learning and to determine how engineering concepts can be infused into the science curricula for life and physical science. Other quantitative and qualitative instruments are developed to assess the teachers? understandings of the engineering concepts and their pedagogical implications.

There is increasing emphasis on integrative STEM education. New national and international assessments are developing engineering strands and emphasizing non-routine problem solving. The framework for the Next Generation Science Standards includes engineering as one of four strands. Stand alone engineering course are not likely to be widely used. This project develops engineering infused science units and determines the professional development needed to use them effectively.

Transforming Teaching Through Implementing Inquiry (T2I2) is a full research and development project that explores the use of cyberinfrastructure to significantly enhance the delivery and quality of professional development (PD) for grades 8-12 engineering, technology, and design educators. The goal of the project is to study whether the use of highly interactive cyberinfrastructure increases this target audience's: 1) understanding of engineering design concepts and ability to effectively teach them 2) understanding of how to address student learning needs 3) ability to manage, monitor, and adjust the learning environment 4) use of self assessment to enhance teaching ability and 5) engagement in a community of practice. These issues are of particular interest because of the limited resources in place to prepare pre-service engineering and CTE teachers, as well as a lack of in-service PD.

The content for the PD is grounded in the materials and processes of two projects reviewed by the National Research Council's (NRC) report review committee: Technology Education: Learning by Design for Middle Schools" and "Engineering by Design for High Schools." By incorporating an object-oriented generic system design (learning objects), the cyberinfrastructure is set to be reusable, adaptable, and scalable. These learning objects allow for customization of the learning experience, whereby learning facilitators or learners themselves can configure the system based on their specific needs. Delivering learning objects in an online framework enables teachers to develop and grow in a network community.

A mixed methods approach is used to determine effects of professional development. Student achievement is measured by comparing each site's state assessments in the following areas: the curriculum's technology, engineering, and design assessment, end-of-grade mathematics assessment, and end-of-grade science assessment. Both formative and summative evaluation strategies inform the development and implementation of the project. As such, the project will advance theory, design, and practice in middle and high school enginee

The Science and Mathematics Simulated Interaction Model (SIM) will design and clinically test simulations for mathematics and science teachers. The main hypothesis is that mathematics and science simulations will identify strengths and misconceptions in teachers' understanding of content and pedagogy, increase teachers¡ instructional capacity, and advance student achievement. The SIM will be designed for both preservice (in training) and induction-stage (early career) mathematics and science teachers. The eight different SIM simulations will focus on common problems of practice, challenges, dilemmas, issues that mathematics and science teachers encounter at the secondary level (grades 9-12). The Syracuse University School of Education and SUNY Upstate Medical University's Clinical Skills Center have partnered together in past simulation design and research endeavors. Through their SIM partnership, these organizations now focus on the first exploration of content-specific simulations. When designed and clinically tested, the researchers expect the SIM to serve as an innovative teacher development tool that helps novice mathematics and science teachers effectively transition from preservice preparation to classroom practice.

The heart of the SIM is a series of live, one-to-one interactions between novice mathematics and science teachers and standardized individuals (SIs). Similar to medical education's use of standardized patients, the SIM's standardized individuals are local actors who are carefully trained and scripted to present to novice teachers distinct mathematics or science problems, questions, or dilemmas. For example, how do novice mathematics teachers navigate a conversation with a standardized student who questions the relevance of advanced mathematics? Similarly, how do novice science teachers navigate a difficult conversation with a standardized parent who questions the teaching of evolutionary biology? Each teacher's simulation is immediately followed by an individual debriefing and a written improvement plan in a highly structured simulation to reflection to improvement plan cycle of assistance. Each simulation cycle is coupled with a content-specific seminar designed to support teachers' strengths and to address their content or pedagogical misconceptions. The SIM is structured as an iterative design project, where the initial design of the eight simulations will be clinically tested twice. 40 novice teachers (20 preservice and 20 induction stages) will take part in the clinical testing process. SIM data strands include pre-simulation questions, audio/video data of the simulated interactions between teachers and SIs, post-simulation teacher video reflections, and written professional improvement plans. The research team will focus on refining the simulations and identifying the teachers' strengths and misconceptions based on 160 different simulated interactions.

When complete, the SIM will consist of eight simulations that effectively identify the content and pedagogical strengths and misconceptions of secondary mathematics and science teachers. Initially, the SIM will be implemented within the Syracuse University School of Education. SIM products, processes, and all findings will be made available to all education researchers and teacher educators through password-protected digital access. The SIM's problem-based methodology challenges novice teachers to enact content and pedagogy, while also helping researchers to accurately and meaningfully assess teacher strengths and misconceptions in mathematics and science. As data are gathered and analyzed for each SIM problem of practice, we anticipate the formation of grounded theories and models of mathematics and science teacher development. These data - gathered through a methodology that places novice teachers in immediate, demanding, authentic situations - hold the potential to yield broader understandings of how novice science and mathematics teachers are transferring the content and pedagogy learned within teacher preparation into actual teacher practice.

This four-year effectiveness study focuses on the scale-up of a model of curricular and teacher professional development intervention aimed at improving science achievement of all students, especially English language learners (ELLs). The model consists of three basic components: (a) inquiry-oriented science curriculum, (b) teacher professional development for science instruction with these students, and (c) school resources for science instruction. The project's main goals are: (1) to evaluate the effect of the intervention on student achievement, (2) to determine the effect of the intervention on teacher knowledge, practices, and school resources, and (3) to assess how teacher knowledge, practices, and resources mediate student achievement. The project is conducted in the context of the Florida current science education policies and accountability system (e.g., adoption of the Next Generation Sunshine State Standards in Science, assessment of science at the fifth grade, a Race to the Top award state). The study draws on findings from research on a previous NSF-funded efficacy study (035331) in which the model to be scaled-up was tested in a single school district. The effectiveness study includes three (of 67) school districts as key partners, representative of racially, ethnically, linguistically, and socioeconomically diverse student populations; 64 elementary schools, 320 science teachers, and 24,000 fifth-grade students over a three-year period. Science learning is the primary subject matter, inclusive of life, physical, and earth/space sciences. Six research questions corresponding to three research areas guide the proposed scope of work. For the research area of Student Science Achievement, questions are: (1) What is the effect of the intervention on fifth-grade students' science achievement, compared to "business as usual"?, and (2) To what extent are the effects of the intervention moderated by students' English as a Second Language (ESOL) level, SES status, and racial/ethnic backgrounds? For Teacher Knowledge and Practices as a research area, questions are: (3) What is the effect of the intervention on teachers' science knowledge and teaching practices?, and (4) To what extent is students' science achievement predicted by school resources for science instruction? For School Resources for Science, questions are: (5) What is the effect of the intervention on school resources for science instruction?, and (6) To what extent is student achievement predicted by school resources for science instruction? To assess the effect of the intervention on students' and teachers' outcomes, a cluster-randomized-control trial is used, resulting in a total of 64 randomly selected schools (after stratifying them by school-level percent of ESOL and Free Reduced Lunch students). All science teachers and students from the 64 schools participate in the project: 32 in the treatment group (project curriculum for fifth grade, teacher professional development, and instructional resources), and 32 in the control group (district-adopted fifth-grade curriculum, no teacher professional development, and no instructional resources). To address the research area of Student Science Achievement, formative assessment items are used at the end of each curriculum unit, along with two equated forms of a project-developed science test (to be used as pre-and posttests) with both treatment and control groups, in addition to the Florida's Comprehensive Assessment Tests-Science. Data interpretation for this research area employs a set of three-level HLMs (students, nested in classrooms, nested in schools). To address the research area of Teacher Knowledge and Practices and School Resources for Science, the project uses three measures: (a) two equated forms of a 35-items test of teacher science knowledge, (b) a classroom observation instrument measuring third-party ratings of teacher knowledge and teaching practices, and (c) a questionnaire measuring teachers' self-reports of science knowledge and teaching practices. All measures are administered to both treatment and control groups. Data interpretation strategies include a series of HLMs with emphasis on the relevant teacher outcomes as a function of time, and of school-level mediating variables. External project evaluation is conducted by Concentric Research and Evaluation using quantitative and qualitative methods and addressing both formative and summative components. Project research findings contribute to the refinement of a model reflective of the new science standards in the State and the emerging national science standards. The value added of this effort consists of its potential to inform effective implementation of science curricula and teacher professional development in other learning settings, including ELLs and traditionally marginalized student populations at the elementary school level. It constitutes practically the only research study focused on the issue of scale-up and sustainability of effective science education practices with this student subpopulation, which has become prominent due to the dramatic growth of a racially, ethnically, and linguistically diverse school-aged population, low levels of U.S. student science achievement, and the role of science and mathematics in current accountability systems nationwide.

This project scales and further tests the Target Inquiry (TI) professional development model. The TI model involves teachers in three core experiences: 1) a research experience for teachers, 2) materials adaptation, and 3) an action research project. The original program was implemented with high school chemistry teachers at Grand Valley State University (GVSU), and was shown to result in significant increases, with large effect sizes, in teachers' understanding of science inquiry and quality of instruction, and in science achievement of those teachers' students. The scale-up and further testing would involve adding physics, biology and geology at Grand Valley State University, and implementing the program at Miami University (MU) with chemistry teachers. Three research questions will be studied:

1) How do the three TI core experiences influence in-service high school science teachers' (i) understanding of the nature of science; (ii) attitudes and beliefs about inquiry instruction; and (iii) classroom instructional methods in the derivatives of the TI model?

2) How does teacher participation in TI affect students' process skills (scientific reasoning and metacognition) and conceptual understanding of science in the derivatives of the TI model?

3) What are the challenges and solutions related to implementing TI in science disciplines beyond chemistry and in other regions?

The research design is quasi-experimental and longitudinal, incorporating implementation with research, and using quantitative and qualitative methods blended in a design research framework. A total of 54 middle and high school science teachers are being recruited for the study. The TI group is completing the TI program (N = 27; 15 at GVSU; 12 at MU) while the comparison group (same sizes and locations) is not. The comparison group is matched according to individual characteristics and school demographics. All teachers are being studied, along with their students, for 4 years (pre-program, post-RET, post-MA, post-AR/post-program). TI teachers are taking 15 credits of graduate level science courses over three years, including summers. Courses include a graduate seminar focused on preparing for the research experience, the research experience in a faculty member's science lab during the summer, application of research to teaching, action research project development, adaptation and evaluation of inquiry-focused curricula, and interpretation and analysis of classroom data from action research. Consistent feedback from professional development, teachers, and evaluation, including the previous implementation, contributes to a design-based approach. Teacher factors being studied include nature of science, inquiry teaching knowledge and beliefs, and quality of inquiry instruction. Student factors being studied include scientific reasoning; metacognition, self-efficacy, and learning processes in science; and content knowledge and conceptual understanding. Only established quantitative and qualitative instruments are being used. Quantitative analysis includes between-group comparisons by year on post-tests, with pre-tests as covariates, and multi-level models with students nested with teachers, and teachers within sites, with the teacher level as the primary unit of change. Trends over time between the treatment and comparison groups are being examined. The evaluation is using a combination of pre/post causal comparative quantitative measures and relevant qualitative data from project leaders and participants, as well as from the comparison group, to provide formative and summative evaluation input.

Outcomes of the project include documentation and understanding of the impacts on science teachers' instruction and student outcomes of research experiences for teachers when they are supported by materials adaptation and action research, and an understanding of what it takes to scale the model to different science disciplines and a different site. The project is also producing a website of instructional materials for middle and secondary science.

The goal of this project is to develop two tests (instruments) to assess conceptual understanding of statistics.

The instruments are based on the levels A/B and on level C of statistical understanding development as described in the American Statistical Association Guidelines for Assessment and Instruction of Statistics Education (GAISE) framework. These instruments will be used to assess knowledge of statistics by grades 6-12 students. The instruments will have multiple-choice and constructed response (CR) items. The CR items will have scoring rubrics. The assessments will be pilot tested in school districts in six states. The instruments will be used by teachers to analyze students' growth in understanding of statistics and will be useable for both formative and summative purposes. An assessment blueprint will be developed based on the GAISE framework for selecting and constructing both fixed-choice and open-ended items. An evidenced-based designed process will be used to develop the assessments. The blueprint will be used by the test development committee to develop items. These items will be reviewed by the advisory board considering the main statistics topics to be included on the assessments. Through a layering process, the assessments will be piloted, revised, and field tested with students in grades 6-12 in six states. A three-parameter IRT model will be used in analyzing the items. The work will be done by researchers at the University of Florida with the support of those at the University of Minnesota, the Educational Testing Service, and Kenyon College. Researchers from TERC will conduct a process evaluation with several feedback and redesign cycles.

The assessments will be aligned with the Common Core State Standards for mathematics (CCSSM) and made available as open-source to teachers through a website. The research team will interact with the state consortia developing assessments to measure students? attainment of the CCSSM. As such, the assessments have the potential of being used by a large proportion of students in the country. The more conceptually-based items will provide teachers with concrete examples of what statistics students in grades 6-12 should know.