Experimental

Cluster Randomized Trial of the Efficacy of Early Childhood Science Education for Low-income Children

The research goal of this project is to evaluate whether an early childhood science education program, implemented in low-income preschool settings produces measurable impacts for children, teachers, and parents. The study is determining the efficacy of the program on Science curriculum in two models, one in which teachers participate in professional development activities (the intervention), and another in which teachers receive the curriculum and teachers' guide but no professional development (the control).

Project Email: 
vanegere@msu.edu
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1119327
Funding Period: 
Mon, 08/15/2011 - Wed, 07/31/2013
Project Evaluator: 
Brian Dates, Southwest Counseling Services
Full Description: 

The research goal of this project is to evaluate whether an early childhood science education program, Head Start on Science, implemented in low-income preschool settings (Head Start) produces measurable impacts for children, teachers, and parents. The study is being conducted in eight Head Start programs in Michigan, involving 72 classrooms, 144 teachers, and 576 students and their parents. Partners include Michigan State University, Grand Valley State University, and the 8 Head Start programs. Southwest Counseling Solutions is the external evaluator.

The study is determining the efficacy of the Head Start on Science curriculum in two models, one in which 72 teachers participate in professional development activities (the intervention), and another in which 72 teachers receive the curriculum and teachers' guide but no professional development (the control). The teacher study is a multi-site cluster randomized trial (MSCRT) with the classroom being the unit of randomization. Four time points over two years permit analysis through multilevel latent growth curve models. For teachers, measurement instruments include Attitudes Toward Science (ATS survey), the Head Start on Science Observation Protocol, the Preschool Classroom Science Materials/Equipment Checklist, the Preschool Science Classroom Activities Checklist, and the Classroom Assessment Scoring System (CLASS). For students, measures include the "mouse house problem," Knowledge of Biological Properties, the physics of falling objects, the Peabody Picture Vocabulary Test-Fourth Edition, the Expressive Vocabulary Test-2, the Test of Early Mathematics Ability-3, Social Skills Improvement System-Rating Scales, and the Emotion Regulation Checklist. Measures for parents include the Attitudes Toward Science survey, and the Community and Home Activities Related to Science and Technology for Preschool Children (CHARTS/PS). There are Spanish versions of many of these instruments which can be used as needed. The external evaluation is monitoring the project progress toward its objectives and the processes of the research study.

This project meets a critical need for early childhood science education. Research has shown that very young children can achieve significant learning in science. The curriculum Head Start on Science has been carefully designed for 3-5 year old children and is one of only a few science programs for this audience with a national reach. This study intends to provide a sound basis for early childhood science education by demonstrating the efficacy of this important curriculum in the context of a professional development model for teachers.

Cluster Randomized Trial of the Efficacy of Early Childhood Science Education for Low-income Children

Children's Understanding of Functions in Grades K-2

This project is studying how young children in grades K-2 understand mathematical concepts that are foundational for developing algebraic thinking. Researchers are contributing to an ongoing effort to develop a learning trajectory that describes how algebraic concepts are developed. The project uses teaching experiments, with researchers talking directly to students as they explore algebraic ideas. They explore how students think about and develop concepts related to covariation, representations of functions, relationships among variable, and generalization.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1154355
Funding Period: 
Mon, 08/01/2011 - Mon, 10/31/2011
Full Description: 

The researchers in the Children's Understanding of Functions project are studying how young children in grades K-2 understand mathematical concepts that are foundational for developing algebraic thinking. Researchers at University of Massachusetts at Dartmouth and Tufts University are contributing to an ongoing effort to develop a learning trajectory that describes how algebraic concepts are developed. Most research has focused on student development at the upper elementary and middle school levels, but this project will add information about early elementary learners.

The project's research methodology uses teaching experiments which allow researchers to talk directly to students as they explore algebraic ideas. They explore how students think about and develop concepts related to covariation, representations of functions, relationships among variable, and generalization. Researchers have designed tasks that help students explain their thinking and solve problems where some quantities vary and others are constant. They are analyzing videos and students' written work as they build case studies about the development of algebraic thinking. External evaluation of this exploratory project is one of the responsibilities of its advisory board.

This project is connecting the algebraic thinking of younger children to what has been documented for older children. This process enables them to build an evidence-based learning trajectory about students' development of algebraic thinking. The products of this research can be used to build curricula and lessons that are aligned with what students know and can learn at various points in their development. Project findings, tasks and videos are being disseminated not only to researchers, but also to practitioners through professional publications and the DRK-12 Resource Network.

Children's Understanding of Functions in Grades K-2

SimScientists Human Body Systems: Using Simulations to Foster Integrated Understanding of Complex, Dynamic, Interactive Systems

This project leverages curricular module development to design, develop, and test new cyberlearning modules that integrate multiple (circulation, respiration, and digestion) systems of the human body. The project aims to deepen science content knowledge, science inquiry skills, and model-based reasoning skills for high school biology students. The project will use simulations showing how individual systems function, how they work together, and how the integration of all three creates a dynamic and reactive biological system.

Lead Organization(s): 
Award Number: 
1020264
Funding Period: 
Wed, 09/15/2010 - Sun, 08/31/2014
Project Evaluator: 
Gargani + Company
Full Description: 

This research and development project leverages curricular module development to design, develop, and test new cyberlearning modules that integrate multiple (circulation, respiration, and digestion) systems of the human body. The project aims to deepen science content knowledge, science inquiry skills, and model-based reasoning skills for high school biology students. The project will use simulations showing how individual systems function, how they work together, and how the integration of all three creates a dynamic and reactive biological system. It is expected that the presentation of this dynamic system will result in a deeper understanding of the materials and enhanced performance on student achievement measures. The goals of the project are to: 1. Develop an integrated simulation of the human digestive, circulatory and respiratory systems that allows students to develop productive inquiry strategies. 2. Embed the simulation in online instructional modules that provide immediate, individualized coaching as students are challenged with a series of investigative tasks. 3. Provide reports of students' performances during the activities to students and teachers. 4. Develop follow-up online collaborative investigations that provide differentiated instruction to strengthen students' understanding and support transfer and opportunities to engage in scientific discourse. 5. Develop one benchmark assessment that measures outcomes across all three body systems and reports to students and teachers. 6. Develop and deploy professional development to support teachers as they use these materials. 7. Provide evidence of the technical quality, feasibility, and usability of the new materials. 8. Study the influence of these materials on complex science and inquiry learning of the integration of the three human body systems modeled. A small scale randomized, controlled trial will be performed at the end of the project. The project is grounded in model-based learning, cognitive learning research, and an evidence-centered design. Universal Design for Learning is factored into all simulation designs. Questions asked during the evaluation include: Is the project progressing as planned? Are the modules useable? Are the users satisfied? Are the modules used as intended in a typical high school setting? Does this improve teaching and learning of key content? The primary investigator is WestEd; the American Association for the Advancement of Science is a partner and three teachers from nearby schools serve as co-developers. The project has an external evaluator as well as a strong advisory board. The project will create multi-leveled instructional cyber-modules. These modules will contain embedded assessments that provide students and teachers immediate and individualized coaching. Professional development will also provide teachers tools and guidance to increase their learning of human body systems. Dissemination strategies include featuring the modules on WestEd's award-winning website as well as submission of academic papers to journals and national conferences targeted at science educators and education researchers. Because these modules supplement classroom curricula and use online technology, they could potentially be used to teach millions of high school biology students.

SimScientists Human Body Systems: Using Simulations to Foster Integrated Understanding of Complex, Dynamic, Interactive Systems

Project AIM: All Included in Mathematics

This project will adapt and study successful discourse strategies used during language arts instruction to help teachers promote mathematically-rich classroom discourse. Of special interest is the use of models to promote mathematics communication that includes English language learners (ELL) in mathematics discourse.  The project will result in a full 40-hour professional development module to support mathematics discourse for Grade 2 teachers, with an emphasis on place value, multidigit addition and subtraction, and linear measurement.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1020177
Funding Period: 
Sun, 08/01/2010 - Wed, 07/31/2013
Project Evaluator: 
Judy Storeygard, TERC
Full Description: 

Developers and researchers at North Carolina State University and Horizon Research, Inc. are adapting and studying successful discourse strategies used during language arts instruction to help teachers promote mathematically-rich classroom discourse. Of special interest to the project is the use of models to promote mathematics communication that includes English language learners (ELL) in mathematics discourse.

The project is conceived as a design experiment that includes successive instructional engineering cycles in which the R&D team designs professional learning tasks, implements the tasks with teachers, and revises the tasks and their sequencing to better support the desired learning outcomes. The members of the project team then examine the effects of the PD on teachers' instruction and the possibilities for scaling up the materials across PD facilitators, grade levels, and curriculum materials. The overarching research questions guiding the research and development effort proposed in this project are: How do generalist elementary teachers learn to promote high quality mathematics discourse that includes all students in their classrooms and engages those students in meaningful mathematics learning opportunities? How do we scale up an intervention designed to support elementary teacher learning of ways to promote high quality mathematics discourse in their classrooms?

The project will result in a full 40-hour professional development module to support mathematics discourse for Grade 2 teachers, with an emphasis on place value, multidigit addition and subtraction, and linear measurement. The main professional learning tasks of the program will have been piloted and studied in a series of sessions with mathematics coaches and teachers.

Project AIM: All Included in Mathematics

Pre-K Early Algebra through Quantitative Reasoning (PreKEA)

This project is initiating an innovative approach to pre-K students' development of quantitative reasoning through measurement. This quantitative approach builds on measurement concepts and algebraic design of the pre-numeric stage of instruction found in the Elkonin-Davydov (E-D) elementary mathematics curriculum from Russia. The project team is adapting and refocusing the conceptual framework and learning tasks of the E-D pre-numeric stage for use with four-year-olds.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1212766
Funding Period: 
Wed, 09/01/2010 - Fri, 08/31/2012
Full Description: 

NSF DR K-12: PreK Early Algebra through Quantitative Reasoning (PreKEA)

 

This is an exploratory project that endeavors to initiate an innovative approach to preK students’ development of quantitative reasoning through measurement. This quantitative approach builds on measurement concepts and algebraic design of the pre-numeric stage of instruction found in the successful Elkonin-Davydov (E-D) elementary mathematics curriculum from Russia. The PreKEA project will adapt and refocus the conceptual framework of the E-D pre-numeric stage with respect to early algebra in the context of teaching experiments with preK and kindergarten students. A primary goal of the project is to obtain a proof-of-concept and lay down a conceptual and empirical foundation for a subsequent full research and development DR K-12 proposal.

The importance of early algebra (EA) in mathematics education has been acknowledged by the publication of a separate chapter solely devoted to early algebra and algebraic reasoning in the second Handbook of Research on Mathematics Teaching and Learning (Lester, 2007). Given that “much prior research highlights the difficulties that middle and high school students have with algebra,” the proponents of EA argue that “the weaving of algebra throughout the K-12 curriculum could lend coherence, depth, and power to school mathematics, and replace late, abrupt, isolated, and superficial high school algebra courses” (Carraher & Schliemann, 2007, pp. 670-671). At the same time, “quantitative thinking is unavoidable in EA” as it “does not seem realistic to first introduce youngsters to the algebra of number and then proceed to problems steeped in quantities as ‘applications’ of algebra” (ibid., p. 671). While the E-D curriculum with its proven track record focuses on the development of quantitative and measurement reasoning among elementary-aged children in grades 1–6, it is feasible that much younger children, even four-year-olds, can access the pre-numeric ideas. This is supported by research by Baillargeon (2001) and Wynn (1997) who showed that infants as young as two-months old demonstrate the development of number and measurement concepts. The PreKEA project will identify key concepts of the E-D pre-numeric stage relevant to four-year-olds and develop and explore lesson units which can be integrated into US preK settings. The project team combines the international expertise of PI Berkaliev who served as project coordinator and international liaison for an NSF-funded international project US-Russian Working Forum on Elementary Mathematics: Is the Elkonin-Davydov Curriculum a Model for the US? and who also brings the perspective of a mathematician, with the theoretical, methodological, and empirical expertise of co-PI Dougherty who has been one of the leading figures in working with, adapting, and studying the implementations of the E-D curriculum in the US, as well as a group of five leading Russian experts who developed, implemented, and studied the original E-D curriculum. The project resources include the E-D curriculum materials and articles only available in Russian.

The PreKEA project has the potential to make contributions beyond the preK early algebra curriculum that it will develop and implement. The PreKEA project can benefit disadvantaged students by using an innovative approach to EA instruction that has the potential to broaden access and at an early stage change the situation when disproportionately many disadvantaged students are not prepared adequately for learning quantitative reasoning and algebra. With research in preK narrowly focused on particular topics, the results of this project have the potential to inform a broader field including mathematics education and early childhood education with evidence that young children can access and interact with more complex mathematics, extending beyond counting.

Developers and researchers at the Illinois Institute of Technology and Iowa State University are initiating an innovative approach to pre-K students' development of quantitative reasoning through measurement. This quantitative approach builds on measurement concepts and algebraic design of the pre-numeric stage of instruction found in the Elkonin-Davydov (E-D) elementary mathematics curriculum from Russia. The project team is adapting and refocusing the conceptual framework and learning tasks of the E-D pre-numeric stage for use with four-year-olds. The adaptation is being done in collaboration with experts in Russia who were involved in the original E-D development. A primary goal of the project is to obtain a proof-of-concept and lay down a conceptual and empirical foundation for a subsequent research and development.

The research progresses using teaching experiments involving six students. Each student is engaged in 15 minute one-on-one sessions twice each week. Sessions are videotaped and transcribed for further analysis. The analysis of the data is conducted by the project team in collaboration with Russian consultants.

The research findings and methodology will provide grounds for supporting more complex and sophisticated mathematical ideas that will inform curriculum development for pre-K students and teachers. Results will be published and reported widely.

Pre-K Early Algebra through Quantitative Reasoning (PreKEA)

Expanding PhET Interactive Science Simulations to Grades 4-8: A Research-based Approach

Colorado’s PhET project and Stanford’s AAALab will develop and study learning from interactive simulations designed for middle school science classrooms. Products will include 35 interactive sims with related support materials freely available from the PhET website; new technologies to collect real-time data on student use of sims; and guidelines for the development and use of sims for this age population. The team will also publish research on how students learn from sims.

Project Email: 
phethelp@colorado.edu
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1020362
Funding Period: 
Wed, 09/01/2010 - Sat, 08/31/2013
Project Evaluator: 
Stephanie Chasteen
Full Description: 

In this DRK12 project, the PhET Interactive Simulations group at the University of Colorado and the AAALab at Stanford University are working together to produce and study learning from interactive simulations designed for middle school science classrooms. We are developing a suite of 35 high-quality, interactive simulations covering physical science topics. These simulations include innovative technologies that provide teachers with real-time, formative feedback on how their students are using the simulations.  The research investigates how various characteristics of the simulation design influence student engagement and learning, and how this response varies across grade-level and diverse populations. The research also includes an investigation of different ways of using simulations in class, and how these approaches affect student preparation for future learning when they are no longer using a given simulation.

      The original PhET simulations were designed for college use, but overtime, they have migrated to lower grades.  The current suite of free research-based, interactive PhET science simulations are used over 10 million times per year.  To optimize their utility for middle school science, we are conducting interviews with diverse 4-8th graders using 25 existing PhET simulations to help identify successful design alternatives where needed, and to formulate generalized design guidelines. In parallel, pull-out and classroom-based studies are investigating a variety of lesson plans to identify the most promising approach. These studies include controlled comparisons that collect both qualitative and quantitative data.

      On the basis of our emerging design principles, we are developing 10 new simulations in consultation with teachers, who are helping to identify high need areas for simulations. These new simulations also include a back-end data collection capability that can collect, aggregate, and display student patterns of simulation use for teachers and researchers. The design of the data collection and presentation formats depends on an iterative process done in collaboration with teachers to identify the most useful information and display formats. A final evaluation compares student learning with and without this back-end formative assessment technology.   

This project is working to transform the way science is taught and learned in Grades 4-8 so that it is more effective at promoting scientific thinking and content learning, while also being engaging to diverse populations. The project is expected to impact many, many thousands of teachers and students through its production of a suite of 35 free, interactive science simulations optimized for Grades 4-8 along with “activity templates”, guidance, and real time feedback to teachers to support pedagogically effective integration into classrooms. Finally, the intellectual merit of the project is its significant contributions to understanding when, how, and why interactive simulations can be effective learning and research tools.

Expanding PhET Interactive Science Simulations to Grades 4-8: A Research-based Approach

Evaluating the Developing Mathematical Ideas Professional Development Program: Researching its Impact on Teaching and Student Learning

This is a 3.5-year efficacy study of the Developing Mathematical Ideas (DMI) elementary math teacher professional development (PD) program. DMI is a well-known, commercially available PD program with substantial prior evidence showing its impact on elementary teachers' mathematical and pedagogical knowledge. However, no studies have yet linked DMI directly with changes in teachers' classroom practice, or with improved student outcomes in math. This study aims to remedy this gap.

Project Email: 
evaluatingdmi@terc.edu
Lead Organization(s): 
Award Number: 
1019769
Funding Period: 
Wed, 09/01/2010 - Fri, 08/31/2012
Project Evaluator: 
Bill Nave
Full Description: 

This is a 3.5-year efficacy study of the Developing Mathematical Ideas (DMI) elementary math teacher professional development (PD) program. DMI was developed by staff from Education Development Center (EDC), SummerMath for Teachers, and TERC, the STEM research and development institution responsible for this research. DMI is a well-known, commercially available PD program with substantial prior evidence showing its impact on elementary teachers' mathematical and pedagogical knowledge. However, no studies have yet linked DMI directly with changes in teachers' classroom practice, or with improved student outcomes in math. This study aims to remedy this gap.

The research questions for the study are:

1) Does participation in the Developing Mathematical Ideas (DMI) professional development program lead to increases in reform-oriented teaching?

2) Does participation in DMI lead to increases in students' mathematics learning and achievement, especially in their ability to explain their thinking and justify their answers?

3) What is the process by which a reform-oriented professional development program can influence teaching practice and, thus, student learning? Through what mechanisms does DMI have impact, and with what kinds of support do we see the desired changes on our outcome measures when the larger professional development context is examined?

The dependent variables for this study include a) teachers' pedagogical and mathematics knowledge for teaching; b) the nature of their classroom practice; and c) student learning/ achievement in mathematics.

The study uses experimental and quasi-experimental methods, working with about 195 elementary grades teachers and their students in Boston, Springfield, Leominster, Fitchburg, and other Massachusetts public schools. Volunteer teachers are randomly assigned either to PD with DMI in the first year of the efficacy study, or to a control group that will wait until the second year of the study to receive DMI PD. Both groups of teachers will be followed through two academic years. Analyses use OLS regression, hierarchical modeling, and structural equation modeling, as appropriate, to compare the two groups and to track changes over time. In this way, the project explores several aspects of a conceptual framework hypothesizing relationships among PD, teacher mathematical and pedagogical knowledge, classroom teaching practice, and student outcomes. There are multiple measures of each construct, including video-analysis of teacher practice, and a new video-based measure of teacher knowledge.

The study tests the impact of DMI in a range of districts (large urban, small urban, suburban) serving an ethnically and economically diverse mix of students. It provides much needed, rigorous evidence testing the efficacy of this reform-oriented professional development program. It also directly explores the commonplace theory that teachers' understanding of content and student thinking and their encouragement of rich mathematical discourse for student sense-making lead to improvement on measures of mathematics achievement. Findings from the study are disseminated to both research and practitioner communities. The project provides professional development in mathematics to about 195 teachers to improve their ability to teach important concepts. If the evidence for efficacy is positive, then even larger-scale use of this PD program is likely.

Evaluating the Developing Mathematical Ideas Professional Development Program: Researching its Impact on Teaching and Student Learning

Enabling Modeling and Simulation-based Science in the Classroom: Integrating Agent-based Models, Real World Sensing and Collaborative Networks

This project develops and assesses the effectiveness of integrating three computation-based technologies into curricular modules: agent-based modeling (ABM), real-world sensing, and collaborative classroom networks. The STEM disciplines addressed are life sciences and physical sciences at middle and high school levels, specifically Evolution, Population Biology/Ecology, Kinetic Molecular Theory, and Electromagnetism.

Project Email: 
uri@northwestern.edu
Lead Organization(s): 
Award Number: 
1020101
Funding Period: 
Sun, 08/01/2010 - Tue, 07/31/2012
Full Description: 

This four-year Full Research and Development project develops and assesses the effectiveness of integrating three computation-based technologies into curricular modules: agent-based modeling (ABM), real-world sensing, and collaborative classroom networks. The team brings together researchers from Northwestern, Vanderbilt and Stanford universities in collaboration with a commercial partner, Inquire Learning. The STEM disciplines addressed are life sciences and physical sciences at middle and high school levels, specifically Evolution, Population Biology/Ecology, Kinetic Molecular Theory, and Electromagnetism.

The project proceeds in two phases: The first phase is a design experiment for the iterative creation of ABM-only and enhanced-ABM modules field tested with fourteen teachers drawn from seven schools. In the second phase, an experiment is conducted that aims at providing quantitative data to help characterize the different effects of various components of the intervention and to prepare the way for future efficacy and scaling research. Between 40 and 80 teachers participate in the experiment and are assigned to immediate or lagged treatments. The four topic areas were selected because they are scientifically important; they are difficult for students, provoking significant misconceptions; they are amenable to a complex-systems and modeling approach; and prior work has prepared the PIs to develop high-quality curricular materials on these topics. The evaluation is led by a member of the advisory board which is constituted to provide guidance on the project evaluation.

The products are research findings on the achievement, engagement and attitudes of students as a result of the deep use of computational modeling technologies in science. In addition, four fully developed classroom-ready modules with teacher support materials are deployed and disseminated through a broad network of educational communities.

Enabling Modeling and Simulation-based Science in the Classroom: Integrating Agent-based Models, Real World Sensing and Collaborative Networks

Embodied STEM Learning Across Technology-based Learning Environments

This project conducts interdisciplinary research to advance understanding of embodied learning as it applies to STEM topics across a range of current technology-based learning environments (e.g., desktop simulations, interactive whiteboards, and 3D interactive environments). The project has two central research questions: How are student knowledge gains impacted by the degree of embodied learning and to what extent do the affordances of different technology-based learning environments constrain or support embodied learning for STEM topics?

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1020367
Funding Period: 
Sun, 08/15/2010 - Sun, 07/31/2011
Project Evaluator: 
Susan Haag
Full Description: 

This project conducts interdisciplinary research to advance understanding of embodied learning as it applies to STEM topics across a range of current technology-based learning environments (e.g., desktop simulations, interactive whiteboards, and 3D interactive environments). The project builds on extensive research, including prior work of the PIs, regarding both embodied learning and statistical learning. The PIs describe embodied learning as engaging the neuromuscular systems of learners as they interact with the world around them visually, aurally, and kinesthetically in order to construct new knowledge structures. Statistical learning is described as the ability to learn, often without intent, which sequences of stimuli are consistent with a set of rules. An example of statistical learning is pattern recognition, which is central to mastery of complex topics in many STEM disciplines including physics and mathematics.

The project has two central research questions: How are student knowledge gains impacted by the degree of embodied learning and to what extent do the affordances of different technology-based learning environments constrain or support embodied learning for STEM topics? To investigate these questions, the PIs are conducting three series of experiments in five phases using two physics topics. The first four phases are developmental and the final phase implements and assesses the two modules in schools (20 plus teachers, 700 plus K-12 students) in Arizona and New York (15 total sites, 10 plus public schools, minimum one Title I school).

The aim of this project is to meld these two research trajectories to yield two key outcomes: 1) basic research regarding embodiment and statistical learning that can be applied to create powerful STEM learning experiences, and 2) the realization of exemplary models and principles to aid curriculum and technology designers in creating learning scenarios that take into account the level of embodiment that a given learning environment affords. 

 

Embodied STEM Learning Across Technology-based Learning Environments

Effective Programs for Elementary Science: A Best-evidence Synthesis

This synthesis project is a systematic review of experimental research evaluating programs and practices in elementary science. The systematic review addresses all areas of science in the elementary grades. The review uses an adaptation of best-evidence synthesis previously applied to elementary and secondary mathematics and reading, and includes experimental and quasi-experimental research on the outcomes of alternative approaches to elementary science.

Lead Organization(s): 
Award Number: 
1019306
Funding Period: 
Wed, 09/01/2010 - Fri, 08/31/2012
Full Description: 

This synthesis project is a systematic review of experimental research evaluating programs and practices in elementary science. The systematic review addresses all areas of science in the elementary grades. Different versions of the synthesis are written for audiences of researchers, policy makers, principals, and teachers. The review uses an adaptation of best-evidence synthesis previously applied to elementary and secondary mathematics and reading, and includes experimental and quasi-experimental research on the outcomes of alternative approaches to elementary science. The review is a part of a series of reviews that are part of the Best Evidence Encyclopedia (BEE), an on-line resource that disseminates systematic reviews of research on achievement outcomes of programs at all subject areas and grade levels (see www.bestevidence.org), and is led by Robert Slavin of Johns Hopkins University.

The review is carried out by a US-UK partnership of science educators and experts on systematic reviews of research. An advisory group of scientists, science educators, and experts on research review oversees the design of the review, monitors review procedures, and comments on drafts. This review takes a broad approach to searching the literature in order to locate every study that meets inclusion requirements for valid research. It includes electronic searches of educational databases (JSTOR, ERIC, EBSCO, Psych INFO, Dissertation Abstracts) using different combinations of key words (for example, "elementary students" and "science achievement"), covering the years 1970-2010. Results are narrowed by subject area (for example, "educational software", "science achievement", "instructional strategies"). Web-based repositories and education publishers' websites are included. The review also discusses each study that meets the inclusion requirements for a valid research design.

A strength of this work is that it takes on the synthesis of what is known about best practice for elementary science education, relying only on studies that meet the criteria for inclusion as having credible research designs. This is a review that is sorely needed in the field of science education. The lengthy and detailed review will be available on the BEE network, along with educator-friendly summaries. The work is also vetted via publication in a top, peer-reviewed journal. The study will include a set of tables showing ratings of programs according to consistent criteria in terms of the strength of the evidence base for each, with brief descriptions of the methods and findings. This educators' summary, patterned on Consumer Reports, is intended primarily for superintendents, principals, and teachers who are making choices among programs for implementation with their children.

Effective Programs for Elementary Science: A Best-evidence Synthesis
Syndicate content