Qualitative

Cluster Randomized Trial of the Efficacy of Early Childhood Science Education for Low-income Children

The research goal of this project is to evaluate whether an early childhood science education program, implemented in low-income preschool settings produces measurable impacts for children, teachers, and parents. The study is determining the efficacy of the program on Science curriculum in two models, one in which teachers participate in professional development activities (the intervention), and another in which teachers receive the curriculum and teachers' guide but no professional development (the control).

Project Email: 
vanegere@msu.edu
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1119327
Funding Period: 
Mon, 08/15/2011 - Wed, 07/31/2013
Project Evaluator: 
Brian Dates, Southwest Counseling Services
Full Description: 

The research goal of this project is to evaluate whether an early childhood science education program, Head Start on Science, implemented in low-income preschool settings (Head Start) produces measurable impacts for children, teachers, and parents. The study is being conducted in eight Head Start programs in Michigan, involving 72 classrooms, 144 teachers, and 576 students and their parents. Partners include Michigan State University, Grand Valley State University, and the 8 Head Start programs. Southwest Counseling Solutions is the external evaluator.

The study is determining the efficacy of the Head Start on Science curriculum in two models, one in which 72 teachers participate in professional development activities (the intervention), and another in which 72 teachers receive the curriculum and teachers' guide but no professional development (the control). The teacher study is a multi-site cluster randomized trial (MSCRT) with the classroom being the unit of randomization. Four time points over two years permit analysis through multilevel latent growth curve models. For teachers, measurement instruments include Attitudes Toward Science (ATS survey), the Head Start on Science Observation Protocol, the Preschool Classroom Science Materials/Equipment Checklist, the Preschool Science Classroom Activities Checklist, and the Classroom Assessment Scoring System (CLASS). For students, measures include the "mouse house problem," Knowledge of Biological Properties, the physics of falling objects, the Peabody Picture Vocabulary Test-Fourth Edition, the Expressive Vocabulary Test-2, the Test of Early Mathematics Ability-3, Social Skills Improvement System-Rating Scales, and the Emotion Regulation Checklist. Measures for parents include the Attitudes Toward Science survey, and the Community and Home Activities Related to Science and Technology for Preschool Children (CHARTS/PS). There are Spanish versions of many of these instruments which can be used as needed. The external evaluation is monitoring the project progress toward its objectives and the processes of the research study.

This project meets a critical need for early childhood science education. Research has shown that very young children can achieve significant learning in science. The curriculum Head Start on Science has been carefully designed for 3-5 year old children and is one of only a few science programs for this audience with a national reach. This study intends to provide a sound basis for early childhood science education by demonstrating the efficacy of this important curriculum in the context of a professional development model for teachers.

Cluster Randomized Trial of the Efficacy of Early Childhood Science Education for Low-income Children

CAREER: Engaging Elementary Students in Data Analysis through Study of Physical Activities

This project is investigating the learning that can take place when elementary school students are directly involved in the collection, sense-making, and analysis of real, personally-meaningful data sets. The hypotheses of this work are that by organizing elementary statistics instruction around the study of physical activities, students will have greater personal engagement in data analysis processes and that students will also develop more robust understandings of statistical ideas.

Lead Organization(s): 
Award Number: 
1054280
Funding Period: 
Fri, 07/01/2011 - Thu, 06/30/2016
Full Description: 

This CAREER awardee at Utah State University is investigating the learning that can take place when elementary school students are directly involved in the collection, sense-making, and analysis of real, personally-meaningful data sets. The project responds to increasing attention to data collection and analysis in elementary grades and aims to make important contributions to the knowledge base on effective approaches to these topics. The hypotheses of this work are that by organizing elementary statistics instruction around the study of physical activities, students will have greater personal engagement in data analysis processes and that students will also develop more robust understandings of statistical ideas. Students and teachers from fifth grade classrooms from several elementary schools from northern Utah, are participating in the project. This work is co-funded by the EPSCoR program.

Statistics topics include measures of center and variation. Students use pedometers, heart rate monitors, other probeware, and the TinkerPlots software. The research team investigates the influence of personal ownership and relationships to data on students' understanding of learning of elementary statistics concepts and their ability to analyze data. The research involves multi-year clinical interviews and video-recorded classroom design experiments.

Research results are expected to be published in appropriate journals and are expected to be presented at professional meetings. Lesson plans and student instructional materials related to physical activity, measures of center, and data distributions are made available for use in partner elementary schools.

CAREER: Engaging Elementary Students in Data Analysis through Study of Physical Activities

CAREER: Noticing and Capitalizing on Important Mathematical Moments in Instruction

This project investigates the outcomes of a teacher education model designed to foster prospective mathematics teachers' abilities to notice and capitalize on important mathematical moments in instruction. The project engages prospective teachers in research-like analysis of unedited teacher-perspective classroom video early in their teacher education coursework in order to help them learn to identify, assess the mathematical potential of, and respond to important student ideas and insights that arise during instruction.

Lead Organization(s): 
Award Number: 
1052958
Funding Period: 
Fri, 04/15/2011 - Sat, 03/31/2012
Full Description: 

This CAREER awardee at Michigan Technological University is investigating the outcomes of a teacher education model designed to foster prospective mathematics teachers' abilities to notice and capitalize on important mathematical moments in instruction. The researcher engages prospective teachers in research-like analysis of unedited teacher-perspective classroom video early in their teacher education coursework in order to help them learn to identify, assess the mathematical potential of, and respond to important student ideas and insights that arise during instruction.

The research is based on a quasi-experimental design and involves three cohorts of prospective teachers. Practicing teachers from local schools collaborate with the research team. The data collected consists of classroom video. The video is coded and analyzed using Studiocode, which allows for real-time coding and for multiple users to code and annotate video segments.

The research findings are integrated into the institution's teacher education program and are also disseminated more broadly through publication and presentations at professional meetings.

CAREER: Noticing and Capitalizing on Important Mathematical Moments in Instruction

Efficacy Study of Metropolitan Denver's Urban Advantage Program: A Project to Improve Scientific Literacy Among Urban Middle School Students

This is an efficacy study to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The study aims to answer the following questions: How does participation in the program affect students' science knowledge, skills, and attitudes toward science; teachers' science knowledge, skills, and abilities; and families engagement in and support for their children's science learning and aspirations?

Lead Organization(s): 
Award Number: 
1020386
Funding Period: 
Wed, 09/15/2010 - Wed, 08/31/2011
Project Evaluator: 
Maggie Miller
Full Description: 

This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?

The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.

The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.

Efficacy Study of Metropolitan Denver's Urban Advantage Program: A Project to Improve Scientific Literacy Among Urban Middle School Students

Modeling Engineered Levers for the 21st Century Teaching of STEM (Collaborative Research: Schunn)

This project will develop three replacement units for biology and refine them through classroom testing. The units will be models of STEM integration by using the important concepts of proportional reasoning and algebraic thinking and engineering re-design to address big ideas in science while also promoting the learning of 21st century skills. The materials will be educative for teachers, and the teacher materials and professional development methods will work at scale and distance.

Project Email: 
birdy@pitt.edu
Lead Organization(s): 
Award Number: 
1027629
Funding Period: 
Wed, 09/01/2010 - Sun, 08/31/2014
Project Evaluator: 
Bill Bickel
Full Description: 

Research in biology has become increasingly mathematical, but high school courses in biology use little mathematics. To address this concern, this project will develop three replacement units for biology and refine them through classroom testing. The units will be models of STEM integration by using the important concepts of proportional reasoning and algebraic thinking and engineering re-design to address big ideas in science while also promoting the learning of 21st century skills. The materials build on existing work on the use of model eliciting activities and focus science and technology instruction on high-stakes weaknesses in mathematics and science. They address the scaling issue as part of the core design work by developing small units of curriculum that can be applied by early adopters in each context. The materials will undergo many rounds of testing and revision in the early design process with at least ten teachers each time. The materials will be educative for teachers, and the teacher materials and professional development methods will work at scale and distance.

Learning of science content will be measured through the use of existing instruments in wide use. Existing scales of task values, achievement goals and interest are used to measure student motivation. The work performed is guided by a content team; a scaling materials team; a scaling research team; the PI team of a cognitive scientist, a robotics educator, and a mathematics educator specializing in educational reform at scale; and the summative evaluation team lead by an external evaluator.

There is great interest in understanding whether integrated STEM education can interest more students in STEM disciplines. The focus on mathematics integrated with engineering in the context of a science topic is interesting and novel and could contribute to our understanding of integrating mathematics, engineering and science. The development team includes a cognitive scientist, a mathematics educator, teachers and scientists. The issues and challenges of interdisciplinary instruction will be investigated.

Modeling Engineered Levers for the 21st Century Teaching of STEM (Collaborative Research: Schunn)

Beyond Bridging: Co-education of Preservice and Inservice Elementary Teachers In Science and Mathematics

This project will implement and study a professional community designed to alleviate the mismatch between the expectations of student teachers in mathematics and science and their mentor in-service teachers. The project is creating a neutral forum for the exchange of perspectives on issues of pedagogy with the expectation that student teachers would implement inquiry-based science and problem-solving mathematics pedagogies with the knowledgeable support of their mentor teachers.

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1019860
Funding Period: 
Wed, 09/01/2010 - Sun, 08/31/2014
Project Evaluator: 
Horizon Reseach, Inc.
Full Description: 

The University of Arizona is partnering with the Tucson Unified School District to implement and study a professional community designed to alleviate the mismatch between the expectations of student teachers in mathematics and science and their mentor in-service teachers. This vexing problem often arises when student teachers expect to implement reform-based pedagogies while their mentor teachers insist on traditional approaches. The project is creating a "third space," a professional community that includes 40 pre-service and 50 in-service teachers, university scientists and mathematicians, science and mathematics education faculty, and school district administrators. The third space is providing a neutral forum for the exchange of perspectives on issues of pedagogy with the expectation that student teachers would implement inquiry-based science and problem-solving mathematics pedagogies with the knowledgeable support of their mentor teachers. The project is being implemented in two low-income, culturally and linguistically diverse elementary schools with a comparison school used as a control.

The evaluation/research component is a qualitative study led by Horizon Research, Inc. The fundamental research question is whether the third space model establishes interpretive systems that foster enactment of inquiry-based and problem-solving teaching practices. Data collection will include all participants in the third space forum, but focuses on the pre-service and in-service teachers through written products and discussions of lesson design activities, videotapes of teaching by pre-service and in-service teachers, and analysis of comments made in a web-based forum. Instruments to be used are the Reform Teaching Observation Protocol (RTOP), the Experiences Patterns Explanations (EPE) framework, and the Inquiry-Application Instructional Model (I-AIM).

The main product of this project is the third space model and the research that supports its success. The model will be disseminated broadly and if replicated widely, it would represent a major improvement in the professional development of teachers in the areas of inquiry-based science and problem-solving mathematics.

Beyond Bridging: Co-education of Preservice and Inservice Elementary Teachers In Science and Mathematics

ScratchEd: Working with Teachers to Develop Design-based Approaches to the Cultivation of Computational Thinking

This project is designing, developing, and studying an innovative model for professional development (PD) of teachers who use the Scratch computer programming environment to help their students learn computational thinking. The fundamental hypothesis of the project is that engagement in workshops and on-line activities of the ScratchEd professional development community will enhance teacher knowledge about computational thinking, their practice of design-based instruction, and their students' learning of key computational thinking concepts and habits of mind.

Project Email: 
scratched@media.mit.edu
Partner Organization(s): 
Award Number: 
1019396
Funding Period: 
Sun, 08/15/2010 - Wed, 07/31/2013
Project Evaluator: 
Education Development Center
Full Description: 

The ScratchEd project, led by faculty at the Massachusetts Institute of Technology and professionals at the Education Development Center, is designing, developing, and studying an innovative model for professional development (PD) of teachers who use the Scratch computer programming environment to help their students learn computational thinking. The fundamental hypothesis of the project is that engagement in workshops and on-line activities of the ScratchEd professional development community will enhance teacher knowledge about computational thinking, their practice of design-based instruction, and their students' learning of key computational thinking concepts and habits of mind.

The effectiveness of the ScratchEd project is being evaluated by research addressing four specific questions: (1) What are the levels of teacher participation in the various ScratchEd PD offerings and what do teachers think of these experiences? (2) Do teachers who participate in ScratchEd PD activities change their use of Scratch in classroom instruction to create design-based learning opportunities? (3) Do the students of teachers who participate in the ScratchEd PD activities show evidence of developing an understanding of computational thinking concepts and processes? (4) When the research instruments developed for the evaluation are made available for teachers in the Scratch community to use for self-evaluation, how do teachers make use of them? Because both computational thinking and design-based instruction are complex activities, the project research is using a combination of survey, interview, and artifact analysis methods to answer the questions.

The ScratchEd professional development and research work will provide important insight into the challenge of helping teachers create productive learning environments for development of computational thinking. Those efforts will also yield a set of evaluation tools that can be integrated into the ScratchEd resources and used by others to study development of computational thinking and design-based instruction.

Events

  • 2012 Conference - http://events.scratch.mit.edu/conference/
  • Regular Workshops, Webinars, and Meetups - http://scratched.eventbrite.com/
  • Social Media

  • Twitter - http://twitter.com/ScratchEdTeam
  • Facebook - http://www.facebook.com/ScratchEdTeam
  • Vimeo - http://vimeo.com/scratchedteam/
  • Flickr - http://www.flickr.com/photos/38090850@N08/
  • ScratchEd: Working with Teachers to Develop Design-based Approaches to the Cultivation of Computational Thinking

    Expanding PhET Interactive Science Simulations to Grades 4-8: A Research-based Approach

    Colorado’s PhET project and Stanford’s AAALab will develop and study learning from interactive simulations designed for middle school science classrooms. Products will include 35 interactive sims with related support materials freely available from the PhET website; new technologies to collect real-time data on student use of sims; and guidelines for the development and use of sims for this age population. The team will also publish research on how students learn from sims.

    Project Email: 
    phethelp@colorado.edu
    Lead Organization(s): 
    Partner Organization(s): 
    Award Number: 
    1020362
    Funding Period: 
    Wed, 09/01/2010 - Sat, 08/31/2013
    Project Evaluator: 
    Stephanie Chasteen
    Full Description: 

    In this DRK12 project, the PhET Interactive Simulations group at the University of Colorado and the AAALab at Stanford University are working together to produce and study learning from interactive simulations designed for middle school science classrooms. We are developing a suite of 35 high-quality, interactive simulations covering physical science topics. These simulations include innovative technologies that provide teachers with real-time, formative feedback on how their students are using the simulations.  The research investigates how various characteristics of the simulation design influence student engagement and learning, and how this response varies across grade-level and diverse populations. The research also includes an investigation of different ways of using simulations in class, and how these approaches affect student preparation for future learning when they are no longer using a given simulation.

          The original PhET simulations were designed for college use, but overtime, they have migrated to lower grades.  The current suite of free research-based, interactive PhET science simulations are used over 10 million times per year.  To optimize their utility for middle school science, we are conducting interviews with diverse 4-8th graders using 25 existing PhET simulations to help identify successful design alternatives where needed, and to formulate generalized design guidelines. In parallel, pull-out and classroom-based studies are investigating a variety of lesson plans to identify the most promising approach. These studies include controlled comparisons that collect both qualitative and quantitative data.

          On the basis of our emerging design principles, we are developing 10 new simulations in consultation with teachers, who are helping to identify high need areas for simulations. These new simulations also include a back-end data collection capability that can collect, aggregate, and display student patterns of simulation use for teachers and researchers. The design of the data collection and presentation formats depends on an iterative process done in collaboration with teachers to identify the most useful information and display formats. A final evaluation compares student learning with and without this back-end formative assessment technology.   

    This project is working to transform the way science is taught and learned in Grades 4-8 so that it is more effective at promoting scientific thinking and content learning, while also being engaging to diverse populations. The project is expected to impact many, many thousands of teachers and students through its production of a suite of 35 free, interactive science simulations optimized for Grades 4-8 along with “activity templates”, guidance, and real time feedback to teachers to support pedagogically effective integration into classrooms. Finally, the intellectual merit of the project is its significant contributions to understanding when, how, and why interactive simulations can be effective learning and research tools.

    Expanding PhET Interactive Science Simulations to Grades 4-8: A Research-based Approach

    CAREER: Teaching Practices That Support Fraction-based Algorithmic Thinking

    The research and educational activities of this project focus on advancing the field in the area of fraction operation algorithm development. The goal of this research is to identify core mathematical teaching practices that engage and support students in algorithmic thinking associated with fraction operations. The educational product of this work will be written educational materials that can be used to support the general population of teachers in this domain.

    Lead Organization(s): 
    Award Number: 
    0952661
    Funding Period: 
    Sun, 08/15/2010 - Fri, 07/31/2015
    Full Description: 

    The research and educational activities of this project focus on advancing the field in the area of fraction operation algorithm development. The goal of the research is to identify core mathematical teaching practices that engage and support students in algorithmic thinking associated with fraction operations. The project has four objectives: (1) understand and document local instructional theories and routines of practice exemplary teachers use as they engage students in algorithmic thinking for fraction operations; (2) develop a prototypical model of core routines of practice generated from exemplary teachers that support students as they engage in algorithmic thinking for fraction operations; (3) design, pilot and study the usability of the prototypical model as a professional development tool with typical teachers as they engage students in algorithmic thinking for fraction operations; and (4) identify specific core routines of practice that are shown to be productive for use with typical teachers and explore ways of disseminating them at a larger scale.

    Phase One involves collaborative work with and intensive observational study of the practice of four exemplary teachers while they teach a common unit on fraction operations. Individual teacher case and cross-case examination will focus on mathematical development, use of representational modes, aspects of purposefulness in the teachers' practice, and discursive considerations and positioning of the learner. The identified local instructional theories and routines of practice that emerge will lead to the development of a prototypical model of teaching practice that engages students in algorithmic thinking for fraction operations. The prototypical model will frame the development of activities and tools to be piloted and studied with 15 typical middle grade teachers from urban and suburban districts in Phase Two. A study group focused professional development setting will be used to implement, study, and refine frameworks, activities and tools.

    The product of this work will be written educational materials that can be used by other teacher educators to support the general population of teachers in this domain. These materials will identify core routines of practice associated with algorithmic thinking for fraction operations and offer activities and tools to support their development in practice. The domain of rational number has been identified as the most challenging and the most essential topic in elementary and middle school mathematics needed to succeed in higher mathematics and science. Moving forward in this area is critical in the successful preparation of students for STEM careers.

    CAREER: Teaching Practices That Support Fraction-based Algorithmic Thinking

    CAREER: Supporting Students' Proof Practices Through Quantitative Reasoning in Algebra

    The aim of this project is to explore the hypothesis that a curricular focus on quantitative reasoning in middle grades mathematics can enhance development of student skill and understanding about mathematical proof. The project is addressing that hypothesis through a series of studies that include small group teaching experiments with students, professional development work with teachers, and classroom field tests of curricular units that connect quantitative reasoning and proof in algebra.

    Lead Organization(s): 
    Award Number: 
    0952415
    Funding Period: 
    Mon, 03/15/2010 - Mon, 02/28/2011
    Full Description: 

    The aim of this CAREER project led by Amy Ellis at the University of Wisconsin is to explore the hypothesis that a curricular focus on quantitative reasoning in middle grades mathematics can enhance development of student skill and understanding about mathematical proof. The project is addressing that hypothesis through a series of studies that include small group teaching experiments with students, professional development work with teachers, and classroom field tests of curricular units that connect quantitative reasoning and proof in algebra.

    Work of the project will produce: (a) insights into ways of unifying two previously disconnected lines of research on quantitative reasoning and proof; (b) models describing realistic ways to support development of students' proof competencies through quantitative reasoning; (c) improvement in students' understanding of algebra through engagement in proof practices based on quantitative reasoning; (d) insights into middle-school students' thinking as they negotiate the transition from elementary to more advanced mathematics; and (e) increased understanding of teachers' knowledge about proof and their classroom practices aimed at helping students progress towards understanding and skill in proof.

    CAREER: Supporting Students' Proof Practices Through Quantitative Reasoning in Algebra
    Syndicate content