This research study is examining the persistence of improved teacher skills achieved during the K-2 Science & Technology Assistance for Rural Teachers and Small Districts project (K-2 STARTS) funded by the State of California.

K-2 STARTS provided four years of professional development to teachers in 16 rural school districts in California with high populations of traditionally underserved students. 39 teachers each received 110 hours of professional development. Project data indicate that the project met its goals by increasing teacher content knowledge, pedagogical content knowledge, abilities to integrate science and literacy and to use research-based instructional strategies. K-2 STARTS also improved the capacity of teachers to use science resources and to network with teachers from their own and other rural districts.

This project is doing a longitudinal research study by extending data collection for 35 teachers for two years after the end of K-2 STARTS. It is using the measures from the original evaluation, which include teacher surveys and interviews, classroom observations, surveys for school administrators, teacher-developed unit artifacts, and student science notebooks, and adding two more measures, administrative interviews and school/district documents. In the final year, the project is doing data analysis and dissemination. The project is exploring the persistence of the knowledge and skills of the teachers over time, as well as their continued use of science instructional practices. It will also study the persistence of school/district support for science education.

External evaluation is being conducted by Dr. Loretta Kelley of Kelley, Peterson, and Associates, Inc. It focuses on project progress through formative and summative components.

Longitudinal studies of the effects of teacher professional development are rare. The increased knowledge concerning the persistence of the new knowledge and skills obtained through K-2 STARTS professional development, and why and to what extent they decay over time, is a significant goal.

Teacher residency academies (TRAs) are gaining attention as a powerful tool for teacher preparation and professional development; however, there is a lack of empirical study demonstrating their merit. The goal of the Teacher Residency Academy Alliance (TRA2) - a partnership among Jackson State University, the National Board for Professional Teaching Standards, Xavier University of Louisiana, and seven diverse urban and rural school districts in Mississippi and Louisiana - is to investigate the implementation of a TRA model to recruit, license, induct, employ, and retain 28 middle school and secondary science teachers for high-need schools that serve more than 119,000 diverse students. The Alliance will accomplish its goal by completing the following specific objectives: create a high quality, rigorous, and clinically-based teacher preparation program for aspiring middle and secondary science teachers; recruit, prepare, employ, and support an increased number of diverse (e.g., African American), effective middle and secondary science educators in high-need urban and rural schools; and contribute to the knowledge base regarding the implementation of a clinically-based science teacher preparation for middle and secondary classrooms in diverse schools. The project will enable one cohort of 28 teachers to successfully complete the TRA2 program and obtaining state licensure/certification in science teaching, a master's degree, and initiation to National Board certification.

The project's focus on middle school and secondary science helps make TRA2 unique in its approach to increase the number of high quality, culturally responsive, and licensed middle and secondary science teachers prepared to teach in the nation's high-need urban and rural schools. Project outcomes of this two year project are expected to inform the design of additional TRAs that will serve as a novel alternative to the traditional teacher preparation and post-baccalaureate certification programs common throughout the nation.

The study design will be formative. The data obtained through surveys of teachers, district leaders, and principals, telephone interviews of mentors, and from extant data, will provide important information regarding the implementation of TRA2.

This four-year effectiveness study focuses on the scale-up of a model of curricular and teacher professional development intervention aimed at improving science achievement of all students, especially English language learners (ELLs). The model consists of three basic components: (a) inquiry-oriented science curriculum, (b) teacher professional development for science instruction with these students, and (c) school resources for science instruction. The project's main goals are: (1) to evaluate the effect of the intervention on student achievement, (2) to determine the effect of the intervention on teacher knowledge, practices, and school resources, and (3) to assess how teacher knowledge, practices, and resources mediate student achievement. The project is conducted in the context of the Florida current science education policies and accountability system (e.g., adoption of the Next Generation Sunshine State Standards in Science, assessment of science at the fifth grade, a Race to the Top award state). The study draws on findings from research on a previous NSF-funded efficacy study (035331) in which the model to be scaled-up was tested in a single school district. The effectiveness study includes three (of 67) school districts as key partners, representative of racially, ethnically, linguistically, and socioeconomically diverse student populations; 64 elementary schools, 320 science teachers, and 24,000 fifth-grade students over a three-year period. Science learning is the primary subject matter, inclusive of life, physical, and earth/space sciences.

Six research questions corresponding to three research areas guide the proposed scope of work. For the research area of Student Science Achievement, questions are: (1) What is the effect of the intervention on fifth-grade students' science achievement, compared to "business as usual"?, and (2) To what extent are the effects of the intervention moderated by students' English as a Second Language (ESOL) level, SES status, and racial/ethnic backgrounds? For Teacher Knowledge and Practices as a research area, questions are: (3) What is the effect of the intervention on teachers' science knowledge and teaching practices?, and (4) To what extent is students' science achievement predicted by school resources for science instruction? For School Resources for Science, questions are: (5) What is the effect of the intervention on school resources for science instruction?, and (6) To what extent is student achievement predicted by school resources for science instruction? To assess the effect of the intervention on students' and teachers' outcomes, a cluster-randomized-control trial is used, resulting in a total of 64 randomly selected schools (after stratifying them by school-level percent of ESOL and Free Reduced Lunch students). All science teachers and students from the 64 schools participate in the project: 32 in the treatment group (project curriculum for fifth grade, teacher professional development, and instructional resources), and 32 in the control group (district-adopted fifth-grade curriculum, no teacher professional development, and no instructional resources). To address the research area of Student Science Achievement, formative assessment items are used at the end of each curriculum unit, along with two equated forms of a project-developed science test (to be used as pre-and posttests) with both treatment and control groups, in addition to the Florida's Comprehensive Assessment Tests-Science. Data interpretation for this research area employs a set of three-level HLMs (students, nested in classrooms, nested in schools). To address the research area of Teacher Knowledge and Practices and School Resources for Science, the project uses three measures: (a) two equated forms of a 35-items test of teacher science knowledge, (b) a classroom observation instrument measuring third-party ratings of teacher knowledge and teaching practices, and (c) a questionnaire measuring teachers' self-reports of science knowledge and teaching practices. All measures are administered to both treatment and control groups. Data interpretation strategies include a series of HLMs with emphasis on the relevant teacher outcomes as a function of time, and of school-level mediating variables. External project evaluation is conducted by Concentric Research and Evaluation using quantitative and qualitative methods and addressing both formative and summative components.

Project research findings contribute to the refinement of a model reflective of the new science standards in the State and the emerging national science standards. The value added of this effort consists of its potential to inform effective implementation of science curricula and teacher professional development in other learning settings, including ELLs and traditionally marginalized student populations at the elementary school level. It constitutes practically the only research study focused on the issue of scale-up and sustainability of effective science education practices with this student subpopulation, which has become prominent due to the dramatic growth of a racially, ethnically, and linguistically diverse school-aged population, low levels of U.S. student science achievement, and the role of science and mathematics in current accountability systems nationwide.

This project designs, develops, and tests coherent interdisciplinary instructional materials to support high school students' integrated understanding of the forces and energetics involved in interactions that occur between atoms and molecules, and explores how students' learning progresses across time. Instructional materials focus on physical science core ideas identified in "A Framework for K-12 Science Education" (NRC, 2011), and "College Board Standards for College Success" (College Board, 2009). The two research questions are: (1) How does learning progress over time when students experience a set of interdisciplinary instructional materials designed to help them advance toward important learning goals related to interactions at very small scales?; and (2) How do the various learning activities support the development of integrated understanding? The project is implemented in three Michigan school districts with students who traditionally do not succeed in science. Two of the school districts serve urban communities with ethnically diverse student populations; the third serves a rural, primarily Caucasian community.

To develop and test instructional materials and associated assessments, the project joins efforts with the Concord Consortium and employs the Construct-Centered Design process (a principled process based on evidence-centered assessment and learning goal-driven designs); uses physical and computer-based models and simulations; and draws on previous and ongoing work on a learning progression of the hypothetical students' path in their understanding of the structure, properties, interactions, and transformations of matter. Four instructional units are produced: (1) Introduction to Electrical Forces, (2) Water, (3) Larger Molecules, and (4) Bio-Molecules, with a duration of two to six weeks each. After testing for usability, the units go through two additional phases. Phase I comprises pilot testing with at least one teacher at two sites, two classrooms each, yielding information from 100-120 students per unit. Phase II consists of field testing the units with a larger sample. Using a power analysis to determine sample size, the project tests two different sequences of the units: (a) four teachers, eight classrooms, and 200 students use the units as a single semester course before taking biology or chemistry; and (b) four teachers, eight classrooms, and 200 students use the units in appropriate points within a chemistry or biology course. Eight teachers from the same school districts, 16 classrooms, and 400 students who do not use the units, serve as the comparison group. A mixed-methods approach is used to collect and analyze data. Data collection strategies include: (a) pre- and post- tests, (b) unit-embedded assessments, (c) students' interest and attitudes, (d) assessments to place students in the learning progression, (e) classroom observations, (f) analysis of student classroom work, and (g) interviews with students and teachers. Data interpretation strategies include: (a) coding of students' and teachers' responses from interviews, (b) identification of patterns, and (c) using item-response theory (IRT) procedures to place students' responses in the learning progression. A range of methods are used to assess validity and reliability of instruments used, including: (a) construct validity, (b) content validity, and (c) IRT procedures. Project external evaluation addresses both formative and summative aspects.

Key project outcomes include: (a) a research-informed and field-tested semester-long course comprising four integrated units with specific objectives, learning tasks, phenomena to illustrate and support understanding at key points, reading materials, and embedded assessments; (b) computer simulations aligned with the units; (c) educative materials for teachers; (d) valid and reliable instruments to measure students' understanding and attitudes; and (e) a set of research manuscripts focused on how the new materials work and promote student learning of key challenging ideas.

This project--led by science educators at Michigan State University, the National Geographic Society, the Natural Resource Ecology Laboratory (NREL) at Colorado State University, the Berkeley Evaluation and Assessment Research (BEAR) Center, and AAAS Project 2061, and including schools in California, Colorado, Maryland, Michigan, and Washington--builds on prior efforts with learning progressions, and is focused on key carbon-transforming processes in socio-ecological systems at multiple scales, including cellular and organismal metabolism, ecosystem energetics and carbon cycling, carbon sequestration, and combustion of fossil fuels.

The project uses an iterative design research process to develop and refine a suite of tools for reasoning and test efficacy of those tools in geographically and culturally diverse schools. The project team is:

1. Refining and validating a detailed learning progression framework covering the middle and high school years; ultimately, the framework will describe the development of students' capacity to use fundamental principles such as conservation of matter and energy to reason about carbon-transforming processes at multiple scales.

2. Refining 'Tools for Reasoning' that make hidden scientific principles - matter, energy, and scale - visible to students; the power of these tools lies in their flexible use for different processes, systems, scales, and curricular contexts.

3. Developing and refining flexible teaching strategies that engage students in cognitive apprenticeship in the practices of environmental science literacy: a) inquiry and argumentation, b) explanations and predictions, and c) decision-making about environmental issues.

4. Using and refining existing summative assessments, and developing and testing formative assessment tools; these assessment tools will provide teachers and researchers with immediate information about their students' intellectual resources and will be linked to the learning progression framework.

5. Developing, field testing, and assessing the effectiveness of six middle school and six high school units that use project tools and enact project principles; the units introduce students to fundamental principles, engage them in reasoning about carbon-transforming processes at organismal scale, and at landscape and global scales. Each unit includes a) an online formative assessment and b) activity sequences that use tools for reasoning and teaching strategies.

6. Developing, field testing, and assessing professional development materials in both face-to-face and facilitated online forms; the materials introduce teachers to learning progressions in environmental science literacy, assessment tools, tools for reasoning, teaching strategies, and teaching materials and activities, and also address difficulties that teachers encounter in using learning progressions and enacting teaching strategies.

The primary project outcomes will be coordinated instructional tools that are useful to professionals at all levels in the science education system--classroom teachers, professional developers, and developers of curricula, standards and assessments.