This project between Lawrence Hall of Science and Boston College is developing Earth and Space Science multimedia educative curriculum materials (MECM) and a system to facilitate teachers' learning and beliefs of scientific argumentation. The MECMs include videos, voice-over narratives, diagrammatic representations, images of student writings, and text. The PIs are investigating the impact of the MECMS on teachers' beliefs about scientific argumentation and their related pedagogical content knowledge. The overarching research question, with four sub questions, focuses on how can multimedia educative curriculum materials provide support to middle school science teachers in implementing standards for constructing and critiquing arguments. The four sub questions are: What factors impact teachers' implementation of argumentation instruction in the classroom? How can MECMs be designed to positively impact teachers' beliefs and their pedagogical content knowledge (PCK) about argumentation? What is the relationship between teachers' beliefs about the value of argumentation and their implementation of argumentation in the classroom? What impact do MECMs have on teachers' beliefs and PCK?

A mixed method approach is being used to assess teachers' beliefs and pedagogical content knowledge. The PIs are developing and pilot testing teachers' beliefs about scientific argumentation. They will use an iterative design process for the MECMs that will involve 50 teachers. Twenty-five phone interviews will be conducted to investigate factors that impact teachers' implementations of scientific argumentation. Three iterative cycles of design and testing include focus groups, a pilot of the MECMs in six classrooms, and a national field test of 30 classrooms. One hundred teachers will field test the assessment followed by collection of six case studies and data analyses. The project's formative and summative evaluations include monitoring and providing feedback for all activities, and assessments of program implementation and impact.

Teachers need support using field tested multimedia educative materials (MECMs) in learning and delivering science content using a scientific argumentation process. By delivering and engaging the teaching and learning process through iterative design of Earth and Space Science multimedia educative curriculum materials, this project would provide, if successful, teachers and students with the necessary literacy and knowledge about scientific argumentation. The MECMs and approach has the potential for broad implementation in middle schools and beyond for delivering Earth and Space science material to support and teach scientific argumentation.

The research goal of this project is to evaluate whether an early childhood science education program, Head Start on Science, implemented in low-income preschool settings (Head Start) produces measurable impacts for children, teachers, and parents. The study is being conducted in eight Head Start programs in Michigan, involving 72 classrooms, 144 teachers, and 576 students and their parents. Partners include Michigan State University, Grand Valley State University, and the 8 Head Start programs. Southwest Counseling Solutions is the external evaluator.

The study is determining the efficacy of the Head Start on Science curriculum in two models, one in which 72 teachers participate in professional development activities (the intervention), and another in which 72 teachers receive the curriculum and teachers' guide but no professional development (the control). The teacher study is a multi-site cluster randomized trial (MSCRT) with the classroom being the unit of randomization. Four time points over two years permit analysis through multilevel latent growth curve models. For teachers, measurement instruments include Attitudes Toward Science (ATS survey), the Head Start on Science Observation Protocol, the Preschool Classroom Science Materials/Equipment Checklist, the Preschool Science Classroom Activities Checklist, and the Classroom Assessment Scoring System (CLASS). For students, measures include the "mouse house problem," Knowledge of Biological Properties, the physics of falling objects, the Peabody Picture Vocabulary Test-Fourth Edition, the Expressive Vocabulary Test-2, the Test of Early Mathematics Ability-3, Social Skills Improvement System-Rating Scales, and the Emotion Regulation Checklist. Measures for parents include the Attitudes Toward Science survey, and the Community and Home Activities Related to Science and Technology for Preschool Children (CHARTS/PS). There are Spanish versions of many of these instruments which can be used as needed. The external evaluation is monitoring the project progress toward its objectives and the processes of the research study.

This project meets a critical need for early childhood science education. Research has shown that very young children can achieve significant learning in science. The curriculum Head Start on Science has been carefully designed for 3-5 year old children and is one of only a few science programs for this audience with a national reach. This study intends to provide a sound basis for early childhood science education by demonstrating the efficacy of this important curriculum in the context of a professional development model for teachers.

In this full research and development project, a team of learning scientists and media researchers at Education Development Center and SRI International will collaborate with educational media producers at WGBH to develop, test, and refine a curriculum supplement (a hands-on technology) that (1) promotes childrens' understanding of number (counting, comparing, and ordering) and fair sharing (equipartitioning); (2) uses interactive media on an emerging handheld platform (touch screen tablets), integrating new multi-touch activities with existing hands-on activities; (3) enhances opportunities for learning with interactive media through shared use with adult guides and peers; and (4) provides professional and technical support materials for preschool educators. The project investigates if and how engagement with activities in a media-rich curriculum supplement improves low-income young childrens' early learning of number and equipartitioning.

The project builds on sound research about learning trajectories to develop materials for fostering young childrens' learning. In addition, this project will generate new research findings about how engagement with activities in a media-rich curriculum supplement can improve low-income childrens' learning. The project uses use mixed methods (ethnographic observations and interviews and HLM analyses) to answer the research questions.

This project addresses a critical need to develop quality early childhood mathematics curriculum, particularly that aimed at low-income students. This project involves two important content areas. Both the content and the mode of delivery make major contributions to curriculum development and research. This project can provide much needed insights about how to effectively use technology for improving student learning.

Michigan State University is developing a model for integrating best practices in technology-supported instructional design and formative assessment for genetics instruction in upper elementary, middle and high school. The project partners with an urban school district in Texas and a suburban school district in Michigan. The objectives are: (1) to articulate a detailed standards- and research-base conceptual framework for describing students' conceptions of genetics and how students develop a full understanding of genetics across grade spans (upper elementary, middle and high school); (2) to develop innovative instructional materials and embedded assessments that provide richer information about students' conceptual understanding of genetics and help practitioners make decisions about what to do next in instruction; and (3) to examine the implementation of these instructional materials and assessments to investigate students' understanding of genetics concepts.

Using the Web-based Inquiry Science Environment (WISE) 4.0 platform (a technology-rich learning environment), the project is developing a 5-week elementary, middle, and secondary school curriculum models that scaffold and model scientific practices, enable students to interface with real-world problems, provide opportunities for students to make connections between visible phenomena and underlying genetic processes, and promote student monitoring and reflection on their learning. Each module will include animation- and stimulation-based contexts in WISE to provide rich occasions to press for building and developing reasoning and explanations. To promote teachers' use of student responses in formative ways, the materials will offer clear guidance about how to make evidence-based instructional decisions as well as provide options for contingent instruction activities that can be used to address persistent or common non-normative ways of reasoning.

The research offers generalizable approaches on the principled design of embedded assessments in WISE 4.0 and on using these assessments formatively. A quasi-experimental study employing a cross-sectional and longitudinal comparison design will investigate the development of students' understanding of genetics-related ideas from upper elementary to the high school years.

The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.

The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.

The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally  underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”

This four-year effectiveness study focuses on the scale-up of a model of curricular and teacher professional development intervention aimed at improving science achievement of all students, especially English language learners (ELLs). The model consists of three basic components: (a) inquiry-oriented science curriculum, (b) teacher professional development for science instruction with these students, and (c) school resources for science instruction. The project's main goals are: (1) to evaluate the effect of the intervention on student achievement, (2) to determine the effect of the intervention on teacher knowledge, practices, and school resources, and (3) to assess how teacher knowledge, practices, and resources mediate student achievement. The project is conducted in the context of the Florida current science education policies and accountability system (e.g., adoption of the Next Generation Sunshine State Standards in Science, assessment of science at the fifth grade, a Race to the Top award state). The study draws on findings from research on a previous NSF-funded efficacy study (035331) in which the model to be scaled-up was tested in a single school district. The effectiveness study includes three (of 67) school districts as key partners, representative of racially, ethnically, linguistically, and socioeconomically diverse student populations; 64 elementary schools, 320 science teachers, and 24,000 fifth-grade students over a three-year period. Science learning is the primary subject matter, inclusive of life, physical, and earth/space sciences.

Six research questions corresponding to three research areas guide the proposed scope of work. For the research area of Student Science Achievement, questions are: (1) What is the effect of the intervention on fifth-grade students' science achievement, compared to "business as usual"?, and (2) To what extent are the effects of the intervention moderated by students' English as a Second Language (ESOL) level, SES status, and racial/ethnic backgrounds? For Teacher Knowledge and Practices as a research area, questions are: (3) What is the effect of the intervention on teachers' science knowledge and teaching practices?, and (4) To what extent is students' science achievement predicted by school resources for science instruction? For School Resources for Science, questions are: (5) What is the effect of the intervention on school resources for science instruction?, and (6) To what extent is student achievement predicted by school resources for science instruction? To assess the effect of the intervention on students' and teachers' outcomes, a cluster-randomized-control trial is used, resulting in a total of 64 randomly selected schools (after stratifying them by school-level percent of ESOL and Free Reduced Lunch students). All science teachers and students from the 64 schools participate in the project: 32 in the treatment group (project curriculum for fifth grade, teacher professional development, and instructional resources), and 32 in the control group (district-adopted fifth-grade curriculum, no teacher professional development, and no instructional resources). To address the research area of Student Science Achievement, formative assessment items are used at the end of each curriculum unit, along with two equated forms of a project-developed science test (to be used as pre-and posttests) with both treatment and control groups, in addition to the Florida's Comprehensive Assessment Tests-Science. Data interpretation for this research area employs a set of three-level HLMs (students, nested in classrooms, nested in schools). To address the research area of Teacher Knowledge and Practices and School Resources for Science, the project uses three measures: (a) two equated forms of a 35-items test of teacher science knowledge, (b) a classroom observation instrument measuring third-party ratings of teacher knowledge and teaching practices, and (c) a questionnaire measuring teachers' self-reports of science knowledge and teaching practices. All measures are administered to both treatment and control groups. Data interpretation strategies include a series of HLMs with emphasis on the relevant teacher outcomes as a function of time, and of school-level mediating variables. External project evaluation is conducted by Concentric Research and Evaluation using quantitative and qualitative methods and addressing both formative and summative components.

Project research findings contribute to the refinement of a model reflective of the new science standards in the State and the emerging national science standards. The value added of this effort consists of its potential to inform effective implementation of science curricula and teacher professional development in other learning settings, including ELLs and traditionally marginalized student populations at the elementary school level. It constitutes practically the only research study focused on the issue of scale-up and sustainability of effective science education practices with this student subpopulation, which has become prominent due to the dramatic growth of a racially, ethnically, and linguistically diverse school-aged population, low levels of U.S. student science achievement, and the role of science and mathematics in current accountability systems nationwide.

Researchers at Harvard University are studying whether middle school instruction about ecosystem science can be made more engaging and effective by combining immersion experiences in virtual ecosystems with immersion experiences in real ecosystems infused with virtual resources. Project personnel are developing a set of learning resources for deployment by mobile broadband devices that provide students with virtual access to information and simulations while working in the field. The EcoMobile project is testing the hypothesis that student engagement, self-efficacy, and understanding of life science standards will be enhanced if students using a four-week inquiry-based curriculum that provides immersion experiences in simulated ecosystems employ smartphones, tablets, and other mobile devices to collect and share data, access on-site information, and visit geo-referenced locations while investigating real ecosystems. Target audiences are middle school students and teachers, curriculum developers, and education researchers.

The project is using quasi-experimental methods to collect data on the usability of the blended environment approach, student gains, and relationships between the two modes of learning. Pilot-test middle school teachers are implementing the EcoMobile curriculum and a comparison curriculum that does not employ mobile devices in the field. Using a variety of assessment instruments and methods, researchers are measuring changes in students' knowledge, attitudes, and self-efficacy.

Blending virtual and mobile device-enhanced real world learning experiences can potentially enhance student-directed inquiry, enhance learning, and students' ability to understand and solve complex environmental problems. EcoMobile encompasses the types of learning strengths and preferences many students today bring to school, based on their use of social media, mobile devices, and games. Employing virtual and augmented reality learning environments in science classes may broaden the pool of science in science careers by enhancing their engagement in science learning, self-efficacy, and knowledge of science and technology.

This project scales and further tests the Target Inquiry (TI) professional development model. The TI model involves teachers in three core experiences: 1) a research experience for teachers, 2) materials adaptation, and 3) an action research project. The original program was implemented with high school chemistry teachers at Grand Valley State University (GVSU), and was shown to result in significant increases, with large effect sizes, in teachers' understanding of science inquiry and quality of instruction, and in science achievement of those teachers' students. The scale-up and further testing would involve adding physics, biology and geology at Grand Valley State University, and implementing the program at Miami University (MU) with chemistry teachers. Three research questions will be studied:

1) How do the three TI core experiences influence in-service high school science teachers' (i) understanding of the nature of science; (ii) attitudes and beliefs about inquiry instruction; and (iii) classroom instructional methods in the derivatives of the TI model?

2) How does teacher participation in TI affect students' process skills (scientific reasoning and metacognition) and conceptual understanding of science in the derivatives of the TI model?

3) What are the challenges and solutions related to implementing TI in science disciplines beyond chemistry and in other regions?

The research design is quasi-experimental and longitudinal, incorporating implementation with research, and using quantitative and qualitative methods blended in a design research framework. A total of 54 middle and high school science teachers are being recruited for the study. The TI group is completing the TI program (N = 27; 15 at GVSU; 12 at MU) while the comparison group (same sizes and locations) is not. The comparison group is matched according to individual characteristics and school demographics. All teachers are being studied, along with their students, for 4 years (pre-program, post-RET, post-MA, post-AR/post-program). TI teachers are taking 15 credits of graduate level science courses over three years, including summers. Courses include a graduate seminar focused on preparing for the research experience, the research experience in a faculty member's science lab during the summer, application of research to teaching, action research project development, adaptation and evaluation of inquiry-focused curricula, and interpretation and analysis of classroom data from action research. Consistent feedback from professional development, teachers, and evaluation, including the previous implementation, contributes to a design-based approach. Teacher factors being studied include nature of science, inquiry teaching knowledge and beliefs, and quality of inquiry instruction. Student factors being studied include scientific reasoning; metacognition, self-efficacy, and learning processes in science; and content knowledge and conceptual understanding. Only established quantitative and qualitative instruments are being used. Quantitative analysis includes between-group comparisons by year on post-tests, with pre-tests as covariates, and multi-level models with students nested with teachers, and teachers within sites, with the teacher level as the primary unit of change. Trends over time between the treatment and comparison groups are being examined. The evaluation is using a combination of pre/post causal comparative quantitative measures and relevant qualitative data from project leaders and participants, as well as from the comparison group, to provide formative and summative evaluation input.

Outcomes of the project include documentation and understanding of the impacts on science teachers' instruction and student outcomes of research experiences for teachers when they are supported by materials adaptation and action research, and an understanding of what it takes to scale the model to different science disciplines and a different site. The project is also producing a website of instructional materials for middle and secondary science.

This five-year project investigates how to provide continuous assessment and feedback to guide students' understanding during science inquiry-learning experiences, as well as detailed guidance to teachers and administrators through a technology-enhanced system. The assessment system integrates validated automated scorings for students' written responses to open-ended assessment items (i.e., short essays, science narratives, concept mapping, graphing problems, and virtual experiments) into the "Web-based Inquiry Science Environment" (WISE) program. WISE is an online science-inquiry curricula that supports deep understanding through visualization of processes not directly observable, virtual experiments, graphing results, collaboration, and response to prompts for explanations. In partnership with Educational Testing Services (ETS), project goals are: (1) to develop five automated inquiry assessment activities that capture students' abilities to integrate their ideas and form coherent scientific arguments; (2) to customize WISE by incorporating automated scores; (3) to investigate how students' systematic feedback based on these scores improve their learning outcomes; and (4) to design professional development resources to help teachers use scores to improve classroom instruction, and administrators to make better informed decisions about teacher professional development and inquiry instruction. The project targets general science (life, physical, and earth) in three northern California school districts, five middle schools serving over 4,000 6th-8th grade students with diverse cultural and linguistic backgrounds, and 29 science teachers. It contributes to increase opportunities for students to improve their science achievement, and for teachers and administrators to make efficient, evidence-based decisions about high-quality teaching and learning.

A key research question guides this effort: How automated scoring of inquiry assessments can increase success for diverse students, improve teachers' instructional practices, and inform administrators' decisions about professional development, inquiry instruction, and assessment? To develop science inquiry assessment activities, scoring written responses include semantic, syntax, and structure of meaning analyses, as well as calibration of human-scored items with a computer-scoring system through the c-rater--an ETS-developed cyber learning technology. Validity studies are conducted to compare automated scores with human-scored items, teacher, district, and state scores, including sensitivity to the diverse student population. To customize the WISE curriculum, the project modifies 12 existing units and develops nine new modules. To design adaptive feedback to students, comparative studies explore options for adaptive guidance and test alternatives based on automated scores employing linear models to compare student performance across randomly assigned guidance conditions; controlling for covariates, such as prior science scores, gender, and language; and grouping comparison studies. To design teacher professional development, synthesis reports on auto-scored data are created to enable them to use evidence to guide curricular decisions, and comments' analysis to improve feedback quality. Workshops, classroom observations, and interviews are conducted to measure longitudinal teachers' change over time. To empower administrators' decision making, special data reports, using-evidence activities, individual interviews, and observation of administrators' meetings are conducted. An advisory board charged with project evaluation addresses both formative and summative aspects.

A research-informed model to improve science teaching and learning at the middle school level through cyber-enabled assessment is the main outcome of this effort. A total of 21 new, one- to three-week duration standards-based science units, each with four or more automatically scored items, serve as prototypes to improve students' performance, teachers' instructional approaches, and administrators' school policies and practices.