Classroom Practice

Educating the Imagination: A Studio Design for Transformative Science Learning

<!--[if gte mso 9]> 0 0 1 81 468 TERC 3 1 548 14.0 <![endif]--> <!--[if gte mso 9]> Normal 0 false false false EN-US JA X-NONE <![endif]--><!--[if gte mso 9]> <![endif]--> <!--[if gte mso 10]> <! /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:Cambria; mso-ascii-font-family:Cambria; mso-ascii-theme-font:minor-latin; mso-hansi-font-family:Cambria; mso-hansi-theme-font:minor-latin;} --> <!--[endif] --> <!--StartFragment-->

Educating the Imagination will develop a studio approach to science for underrepresented high school students. The approach integrates scientific and artistic habits of mind and forms of engagement for meaningful learning in water-related sciences. Youth will a) investigate significant water-related phenomena, b) develop creative responses to the phenomena that foster new understandings and possibilities for action, and c) exhibit their responses community-wide to involve others in re-imagining water locally and globally.

<!--EndFragment-->

 

<!--EndFragment--> <!--[if gte mso 9]> 0 0 1 25 144 TERC 1 1 168 14.0 <![endif]--> <!--[if gte mso 9]> Normal 0 false false false EN-US JA X-NONE <![endif]--><!--[if gte mso 9]> <![endif]--> <!--[if gte mso 10]> <! /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:Cambria; mso-ascii-font-family:Cambria; mso-ascii-theme-font:minor-latin; mso-hansi-font-family:Cambria; mso-hansi-theme-font:minor-latin;} --> <!--[endif] --> <!--StartFragment--><!--EndFragment-->

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1135120
Funding Period: 
Sat, 10/01/2011 - Mon, 09/30/2013
Full Description: 

TERC, in collaboration with the Boston Arts Academy is developing an innovative studio learning environment for students in grades 7-9. This pilot project focuses on object-centered inquiry about water and water-related problems of local and global significance. The project promotes student learning through multi-faceted studies involving hydrology, history, health, digital media, web-based artifact generation, real world data collection, interactions with scientists and artists, and community exhibitions of student work. The primary goal of the Educating the Imagination project is to develop a more effective model for engaging and improving the science learning and achievement of underrepresented urban students.

Studio learning intentionally integrates experimentation with practices of analysis, interpretation, critique of work and conceptual development. During a four week summer studio program, students, guided by teachers and scientists, will produce research-based projects about water and create plans to exhibit their work in the Boston area during the school year. Students will be assessed along multiple dimensions ranging from the depth of their understanding of water science ideas, their ability to make claims and arguments, their use of multiple tools and modes of representation, and the quality of their presentations. Over a two year period researchers will collect data on the studio design model and student learning to determine which aspects of the studio are effective in engaging students in object-oriented inquiry related to important water science ideas and problems.

Educating the Imagination will provide valuable insights about the studio design model and its application to promote science learning. In addition, this project directly addresses the problem of inequality in opportunities to learn and participate in science by developing and testing an innovative, non-traditional learning model with underrepresented urban students. The results of this project could significantly change how we think about and structure STEM learning environments in urban settings.

Educating the Imagination: A Studio Design for Transformative Science Learning

Persistence of Teacher Change in Rural Schools: Assessing the Short- and Long-term Impact of Professional Development on K-2 Science Instruction

This research study is examining the persistence of improved teacher skills achieved during the K-2 Science & Technology Assistance for Rural Teachers and Small Districts project (K-2 STARTS). K-2 STARTS provided four years of professional development to teachers in 16 rural school districts with high populations of traditionally underserved students. Project data indicates that the project increased teacher content knowledge, pedagogical content knowledge, abilities to integrate science and literacy and to use research-based instructional strategies.

Project Email: 
cringst@wested.org
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1119589
Funding Period: 
Thu, 09/15/2011 - Sun, 08/31/2014
Project Evaluator: 
Loretta Kelley
Full Description: 

This research study is examining the persistence of improved teacher skills achieved during the K-2 Science & Technology Assistance for Rural Teachers and Small Districts project (K-2 STARTS) funded by the State of California.

K-2 STARTS provided four years of professional development to teachers in 16 rural school districts in California with high populations of traditionally underserved students. 39 teachers each received 110 hours of professional development. Project data indicate that the project met its goals by increasing teacher content knowledge, pedagogical content knowledge, abilities to integrate science and literacy and to use research-based instructional strategies. K-2 STARTS also improved the capacity of teachers to use science resources and to network with teachers from their own and other rural districts.

This project is doing a longitudinal research study by extending data collection for 35 teachers for two years after the end of K-2 STARTS. It is using the measures from the original evaluation, which include teacher surveys and interviews, classroom observations, surveys for school administrators, teacher-developed unit artifacts, and student science notebooks, and adding two more measures, administrative interviews and school/district documents. In the final year, the project is doing data analysis and dissemination. The project is exploring the persistence of the knowledge and skills of the teachers over time, as well as their continued use of science instructional practices. It will also study the persistence of school/district support for science education.

External evaluation is being conducted by Dr. Loretta Kelley of Kelley, Peterson, and Associates, Inc. It focuses on project progress through formative and summative components.

Longitudinal studies of the effects of teacher professional development are rare. The increased knowledge concerning the persistence of the new knowledge and skills obtained through K-2 STARTS professional development, and why and to what extent they decay over time, is a significant goal.

Persistence of Teacher Change in Rural Schools: Assessing the Short- and Long-term Impact of Professional Development on K-2 Science Instruction

Constructing and Critiquing Arguments in Middle School Science Classrooms: Supporting Teachers with Multimedia Educative Curriculum Materials

This project is developing Earth and Space Science multimedia educative curriculum materials (MECMs) and a system to facilitate teachers' learning and beliefs of scientific argumentation. The project is investigating the impact of the MECMs on teachers' beliefs about scientific argumentation and their related pedagogical content knowledge. The overarching research question focuses on how can multimedia educative curriculum materials provide support to middle school science teachers in implementing standards for constructing and critiquing arguments.

Project Email: 
sjloper@berkeley.edu
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1119584
Funding Period: 
Thu, 09/01/2011 - Sun, 08/31/2014
Project Evaluator: 
Naomi Hupert
Full Description: 

This project between Lawrence Hall of Science and Boston College is developing Earth and Space Science multimedia educative curriculum materials (MECM) and a system to facilitate teachers' learning and beliefs of scientific argumentation. The MECMs include videos, voice-over narratives, diagrammatic representations, images of student writings, and text. The PIs are investigating the impact of the MECMS on teachers' beliefs about scientific argumentation and their related pedagogical content knowledge. The overarching research question, with four sub questions, focuses on how can multimedia educative curriculum materials provide support to middle school science teachers in implementing standards for constructing and critiquing arguments. The four sub questions are: What factors impact teachers' implementation of argumentation instruction in the classroom? How can MECMs be designed to positively impact teachers' beliefs and their pedagogical content knowledge (PCK) about argumentation? What is the relationship between teachers' beliefs about the value of argumentation and their implementation of argumentation in the classroom? What impact do MECMs have on teachers' beliefs and PCK?

A mixed method approach is being used to assess teachers' beliefs and pedagogical content knowledge. The PIs are developing and pilot testing teachers' beliefs about scientific argumentation. They will use an iterative design process for the MECMs that will involve 50 teachers. Twenty-five phone interviews will be conducted to investigate factors that impact teachers' implementations of scientific argumentation. Three iterative cycles of design and testing include focus groups, a pilot of the MECMs in six classrooms, and a national field test of 30 classrooms. One hundred teachers will field test the assessment followed by collection of six case studies and data analyses. The project's formative and summative evaluations include monitoring and providing feedback for all activities, and assessments of program implementation and impact.

Teachers need support using field tested multimedia educative materials (MECMs) in learning and delivering science content using a scientific argumentation process. By delivering and engaging the teaching and learning process through iterative design of Earth and Space Science multimedia educative curriculum materials, this project would provide, if successful, teachers and students with the necessary literacy and knowledge about scientific argumentation. The MECMs and approach has the potential for broad implementation in middle schools and beyond for delivering Earth and Space science material to support and teach scientific argumentation.

Constructing and Critiquing Arguments in Middle School Science Classrooms: Supporting Teachers with Multimedia Educative Curriculum Materials

Teaching Evolution through Human Examples (TEtHE)

This three-year exploratory research and development project is assessing how the use of resource activities and teaching strategies focused on human evolution will affect the understanding, teaching and learning of evolution by high school AP biology teachers and students. The project will develop resource activities and teaching strategies with and for high school biology teachers. Professional development will also provide teachers with guidance on how to incorporate the activities and strategies into the classroom.  

Lead Organization(s): 
Award Number: 
1119468
Funding Period: 
Thu, 09/01/2011 - Sun, 08/31/2014
Project Evaluator: 
The Study Group
Full Description: 

Teaching Evolution through Human Examples (TEtHE), a three-year exploratory research and development project, is assessing how the use of resource activities and teaching strategies focused on human evolution will affect the understanding, teaching and learning of evolution by high school AP biology teachers and students. The guiding questions of the proposed project are 1) In what ways does using examples of human evolution to teach basic evolutionary concepts affect understanding of evolution among high school students? 2) In what ways do teaching strategies that focus on positive dialogue about human evolution help teachers overcome cultural challenges to teaching evolution concepts? 3) In what ways does using examples of human evolution to teach basic evolutionary concepts in conjunction with teaching strategies that focus on positive dialogue about human evolution affect understanding of evolution among high school students? TEtHE project will contribute to the field of evolution education, which is lacking on whether using teaching materials with a human emphasis along with strategies that increase teacher comfort and confidence in teaching evolution lead to greater understanding of evolution.

Project evaluation will focus on refining teaching materials and strategies and testing their efficacy in pilot studies in cooperation with the College Board and its professional development programs for the newly restructured AP course in biology. Studies include: independent assessment of teacher satisfaction with the resource activities as well as confidence and ease in use of the materials, independent review of the materials by the Advisory boards, and survey of all participating teachers to identify ways the materials were used. When addressing each question, the team will investigate validity, feasibility, usefulness, appropriateness, and student results. Methods for collection include: observation, open-response surveys, open-ended interviews, content assessments, and attitudinal surveys. The primary investigator is the Smithsonian Institute; the National Academies Teacher Advisory Board, the Understanding Evolution Teacher Advisor Board, and AP biology teachers from Washington DC serve as co-developers. The project has an external evaluator as well as an advisory board.

The TEtHE project will develop resource activities and teaching strategies with and for high school biology teachers. Professional development will also provide teachers with guidance on how to incorporate the activities and strategies into the classroom. The TEtHE project, over the course of three years, will involve over 100 AP biology teachers which will translate to reaching over 2000 AP biology students. The resources will be widely disseminated online at the end of the project, at national conferences, in national publications, and long range plans include incorporation into the national AP biology curriculum. This project could serve as a model for expanding effective methods for teaching evolution to Biology 1 classes, and contribute to an understanding of how to approach the teaching of scientific topics that intersect religious, ethical, and other areas of societal concern.

Teaching Evolution through Human Examples (TEtHE)

Cluster Randomized Trial of the Efficacy of Early Childhood Science Education for Low-income Children

The research goal of this project is to evaluate whether an early childhood science education program, implemented in low-income preschool settings produces measurable impacts for children, teachers, and parents. The study is determining the efficacy of the program on Science curriculum in two models, one in which teachers participate in professional development activities (the intervention), and another in which teachers receive the curriculum and teachers' guide but no professional development (the control).

Project Email: 
vanegere@msu.edu
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1119327
Funding Period: 
Mon, 08/15/2011 - Wed, 07/31/2013
Project Evaluator: 
Brian Dates, Southwest Counseling Services
Full Description: 

The research goal of this project is to evaluate whether an early childhood science education program, Head Start on Science, implemented in low-income preschool settings (Head Start) produces measurable impacts for children, teachers, and parents. The study is being conducted in eight Head Start programs in Michigan, involving 72 classrooms, 144 teachers, and 576 students and their parents. Partners include Michigan State University, Grand Valley State University, and the 8 Head Start programs. Southwest Counseling Solutions is the external evaluator.

The study is determining the efficacy of the Head Start on Science curriculum in two models, one in which 72 teachers participate in professional development activities (the intervention), and another in which 72 teachers receive the curriculum and teachers' guide but no professional development (the control). The teacher study is a multi-site cluster randomized trial (MSCRT) with the classroom being the unit of randomization. Four time points over two years permit analysis through multilevel latent growth curve models. For teachers, measurement instruments include Attitudes Toward Science (ATS survey), the Head Start on Science Observation Protocol, the Preschool Classroom Science Materials/Equipment Checklist, the Preschool Science Classroom Activities Checklist, and the Classroom Assessment Scoring System (CLASS). For students, measures include the "mouse house problem," Knowledge of Biological Properties, the physics of falling objects, the Peabody Picture Vocabulary Test-Fourth Edition, the Expressive Vocabulary Test-2, the Test of Early Mathematics Ability-3, Social Skills Improvement System-Rating Scales, and the Emotion Regulation Checklist. Measures for parents include the Attitudes Toward Science survey, and the Community and Home Activities Related to Science and Technology for Preschool Children (CHARTS/PS). There are Spanish versions of many of these instruments which can be used as needed. The external evaluation is monitoring the project progress toward its objectives and the processes of the research study.

This project meets a critical need for early childhood science education. Research has shown that very young children can achieve significant learning in science. The curriculum Head Start on Science has been carefully designed for 3-5 year old children and is one of only a few science programs for this audience with a national reach. This study intends to provide a sound basis for early childhood science education by demonstrating the efficacy of this important curriculum in the context of a professional development model for teachers.

Cluster Randomized Trial of the Efficacy of Early Childhood Science Education for Low-income Children

An Examination of Science and Technology Teachers' Conceptual Learning through Concept-based Engineering Professional Development

This project will determine the viability of an engineering concept-based approach to teacher professional development for secondary school science teachers in life science and in physical science. The project refines the conceptual base for engineering at the secondary level learning to increase the understanding of engineering concepts by the science teachers. The hypothesis is that when teachers and students engage with engineering design activities their understanding of science concepts and inquiry are also enhanced.

Project Email: 
rod.custer@bhsu.edu
Lead Organization(s): 
Award Number: 
1119167
Funding Period: 
Thu, 09/01/2011 - Mon, 10/31/2011
Project Evaluator: 
Karen Peterman
Full Description: 

Technology educators from Black Hills State University and Purdue University partner with science educators from the University of Massachusetts at Boston and Stevens Institute of Technology to determine the viability of an engineering concept-based approach to teacher professional development for secondary school science teachers in life science and in physical science. The project refines the conceptual base for engineering at the secondary level learning (previously developed by the PIs) to increase the understanding of engineering concepts by the science teachers. In a pilot test of two weeks of professional development with ten teachers from each discipline, teachers become familiar with engineering concepts and study the process of infusing engineering concepts into science curricula so that they can develop modules in their discipline to be taught during the following in the school year. The following summer the teachers debrief the process and develop additional modules for their discipline. The process is revised and repeated with 22 teachers from each discipline. Teachers are explicitly provided strategies to help them meet the needs of diverse learners. The outputs of this project include: 1) a preliminary framework for secondary level engineering education to be published in both research and practitioner journals; 2) a pilot tested and validated Engineering Concept Assessment; 3) engineering-infused curriculum modules in life and physical science; and 4) a professional development model to prepare science teachers to infuse engineering in their teaching.

The project compares student learning when particular concepts in physics and biology are taught through engineering design with learning the same concepts taught an earlier group of students with present reform techniques used in the discipline. The hypothesis is that when teachers and students engage with engineering design activities their understanding of science concepts and inquiry are also enhanced. The research component of the project employs an iterative design with the design of activities followed by development and implementation. An engineering concept assessment is developed and tested to examine teacher learning and to determine how engineering concepts can be infused into the science curricula for life and physical science. Other quantitative and qualitative instruments are developed to assess the teachers? understandings of the engineering concepts and their pedagogical implications.

There is increasing emphasis on integrative STEM education. New national and international assessments are developing engineering strands and emphasizing non-routine problem solving. The framework for the Next Generation Science Standards includes engineering as one of four strands. Stand alone engineering course are not likely to be widely used. This project develops engineering infused science units and determines the professional development needed to use them effectively.

An Examination of Science and Technology Teachers' Conceptual Learning through Concept-based Engineering Professional Development

Next Generation Preschool Math

This project will develop, test, and refine a curriculum supplement (a hands-on technology) that (1) promotes childrens' understanding of number (counting, comparing, and ordering) and fair sharing (equipartitioning); (2) uses interactive media on an emerging handheld platform (touch screen tablets), integrating new multi-touch activities with existing hands-on activities; (3) enhances opportunities for learning with interactive media through shared use with adult guides and peers; and (4) provides professional and technical support materials for preschool educators.

Partner Organization(s): 
Award Number: 
1119118
Funding Period: 
Mon, 08/01/2011 - Fri, 07/31/2015
Project Evaluator: 
Education Design, Inc.
Full Description: 

In this full research and development project, a team of learning scientists and media researchers at Education Development Center and SRI International will collaborate with educational media producers at WGBH to develop, test, and refine a curriculum supplement (a hands-on technology) that (1) promotes childrens' understanding of number (counting, comparing, and ordering) and fair sharing (equipartitioning); (2) uses interactive media on an emerging handheld platform (touch screen tablets), integrating new multi-touch activities with existing hands-on activities; (3) enhances opportunities for learning with interactive media through shared use with adult guides and peers; and (4) provides professional and technical support materials for preschool educators. The project investigates if and how engagement with activities in a media-rich curriculum supplement improves low-income young childrens' early learning of number and equipartitioning.

The project builds on sound research about learning trajectories to develop materials for fostering young childrens' learning. In addition, this project will generate new research findings about how engagement with activities in a media-rich curriculum supplement can improve low-income childrens' learning. The project uses use mixed methods (ethnographic observations and interviews and HLM analyses) to answer the research questions.

This project addresses a critical need to develop quality early childhood mathematics curriculum, particularly that aimed at low-income students. This project involves two important content areas. Both the content and the mode of delivery make major contributions to curriculum development and research. This project can provide much needed insights about how to effectively use technology for improving student learning.

Next Generation Preschool Math

An Innovative Approach to Earth Science Teacher Preparation: Uniting Science, Informal Science Education, and Schools to Raise Student Achievement

The American Museum of Natural History in New York City, in partnership with New York University, and in collaboration with five high-needs schools, is developing, implementing, and researching a five-year pilot Master of Arts in Teaching (MAT) program in Earth Science. The program is delivered by the Museum's scientific and education teams and its evaluation covers aspects of the program from recruitment to first year of teaching.

Project Email: 
mat@amnh.org
Lead Organization(s): 
Award Number: 
1119444
Funding Period: 
Thu, 09/01/2011 - Wed, 08/31/2016
Project Evaluator: 
David Silvernail, Center for Education and Policy, University of Southern Maine
Full Description: 

The American Museum of Natural History (AMNH), in collaboration with New York University's Institute for Education and Social Policy and the University of Southern Maine Center for Evaluation and Policy, will develop and evaluate a new teacher education program model to prepare science teachers through a partnership between a world class science museum and high need schools in metropolitan New York City (NYC). This innovative pilot residency model was approved by the New York State (NYS) Board of Regents as part of the state’s Race To The Top award. The program will prepare a total of 50 candidates in two cohorts (2012 and 2013) to earn a Board of Regents-awarded Masters of Arts in Teaching (MAT) degree with a specialization in Earth Science for grades 7-12. The program focuses on Earth Science both because it is one of the greatest areas of science teacher shortages in urban areas and because AMNH has the ability to leverage the required scientific and educational resources in Earth Science and allied disciplines, including paleontology and astrophysics.

The proposed 15-month, 36-credit residency program is followed by two additional years of mentoring for new teachers. In addition to a full academic year of residency in high-needs public schools, teacher candidates will undertake two AMNH-based clinical summer residencies; a Museum Teaching Residency prior to entering their host schools, and a Museum Science Residency prior to entering the teaching profession. All courses will be taught by teams of doctoral-level educators and scientists.

The project’s research and evaluation components will examine the factors and outcomes of a program offered through a science museum working with the formal teacher preparation system in high need schools. Formative and summative evaluations will document all aspects of the program. In light of the NYS requirement that the pilot program be implemented in high-need, low-performing schools, this project has the potential to engage, motivate and improve the Earth Science achievement and interest in STEM careers of thousands of students from traditionally  underrepresented populations including English language learners, special education students, and racial minority groups. In addition, this project will gather meaningful data on the role science museums can play in preparing well-qualified Earth Science teachers. The research component will examine the impact of this new teacher preparation model on student achievement in metropolitan NYC schools. More specifically, this project asks, "How do Earth Science students taught by first year AMNH MAT Earth Science teachers perform academically in comparison with students taught by first year Earth Science teachers not prepared in the AMNH program?.”

An Innovative Approach to Earth Science Teacher Preparation: Uniting Science, Informal Science Education, and Schools to Raise Student Achievement

Examining Formative Assessment Practices for English Language Learners in Science Classrooms (Collaborative Research: Li)

This is an exploratory study to identify critical aspects of effective science formative assessment (FA) practices for English Language Learners (ELLs), and the contextual factors influencing such practices. FA, in the context of the study, is viewed as a process contributing to the science learning of ELLs, as opposed to the administration of discrete sets of instruments to collect data from students. The study targets Spanish-speaking, elementary and middle school students.

Lead Organization(s): 
Award Number: 
1118951
Funding Period: 
Thu, 09/01/2011 - Sat, 08/31/2013
Project Evaluator: 
Advisory board members
Full Description: 

This is a two-year exploratory study to identify critical aspects of effective science formative assessment (FA) practices for English Language Learners (ELLs), and the contextual factors influencing such practices. Three institutions join efforts for this purpose: University of Colorado at Boulder, University of Colorado at Denver, and University of Washington. FA, in the context of the study, is viewed as a process contributing to the science learning of ELLs, as opposed to the administration of discrete sets of instruments to collect data from students. The study targets Spanish-speaking, elementary and middle school students. Findings from this study contribute to advance knowledge and understanding of FA as an inherent component of the science learning process in linguistically diverse classrooms, and to define a research agenda aimed at enhancing science teachers' ability to enact equitable and effective assessment practices for this student subpopulation.

Three research questions guide the work: (1) What FA practices are occurring in science classrooms that serve predominantly mainstream students and in those serving predominantly ELLs?; (2) How are teachers' FA practices for mainstream students different from or similar to those used with ELLs?; and (3) How do contextual factors and teachers' cultural and linguistic competencies influence FA practices? To address these questions, two conceptual frameworks are used--one for characterizing FA events; the other for examining FA events as a communication process. The study employs a mixed-methods research approach with emphasis on case studies. The sample size consists of three school districts in Colorado and Washington, 16 classrooms (8 elementary, 8 middle school), 16 teachers, and 96 ELLs. Classrooms are selected to represent a particular combination of four factors: (a) teacher ethnicity, (b) teacher formal academic preparation in teaching ELLs, (c) type of linguistic student background, and (d) grade level. Students are selected through a stratified random sample, identified by achievement level (i.e., low, medium, high), and linguistic background (i.e., mainstream, ELL). Data collection strategies to document the implementation of FA at the beginning, during, and at the end of a science unit include: (a) classroom observation protocols, (b) classroom video-recording, (c) video/artifact simulated recall, (d) assessment artifacts, (e) student interviews, (f) teacher questionnaires, (g) teacher interviews, (h) school principal interviews, and (i) school observations. Reliability and validity of most of the data-gathering instruments is determined through pilot studies. Data interpretation strategies include: (a) coding based on the two conceptual frameworks, (b) scoring rubrics to identify levels of effectiveness, and (c) narratives and profiles to describe FA patterns. Publications and the development of a website constitute the main dissemination strategies. A technical advisory board is responsible for formative and summative evaluation. Key evaluation questions are: (1) To what extent does the project enhance research on ELL FA practices through case studies?, and (2) How effectively do the project dissemination activities facilitate understanding of FA practices?

Major project outcomes include: (1) a description of the patterns of formal and informal FA practices for ELLs; (2) a comparison of the FA practices observed in classrooms that vary on the dimensions of teacher characteristics and linguistic diversity; and (3) an empirically and theoretically informed set of findings and strategies for supporting teachers to enact and enhance FA practices sensitive to cultural and linguistic diversity. Three main products are developed: (1) a monograph describing the FA practices observed across the different classrooms with concrete examples; (2) a description of possible professional development strategies to improve in-service FA practices for linguistically diverse students; and (3) a research-informed approach for analyzing FA practices. Besides filling the existing research gap on FA with ELLs, outcomes and products serve as a foundation for a future research agenda and a comprehensive project aimed at ensuring equitable science learning for all students, including ELLs.

Examining Formative Assessment Practices for English Language Learners in Science Classrooms (Collaborative Research: Li)

Promoting Science among English Language Learners (P-SELL) Scale-Up

This effectiveness study focuses on the scale-up of a model of curricular and teacher professional development intervention aimed at improving science achievement of all students, especially English language learners (ELLs). The model consists of three basic components: (a) inquiry-oriented science curriculum, (b) teacher professional development for science instruction with these students, and (c) school resources for science instruction.

Lead Organization(s): 
Award Number: 
1209309
Funding Period: 
Mon, 08/15/2011 - Fri, 07/31/2015
Project Evaluator: 
Lauren Scher
Full Description: 

This four-year effectiveness study focuses on the scale-up of a model of curricular and teacher professional development intervention aimed at improving science achievement of all students, especially English language learners (ELLs). The model consists of three basic components: (a) inquiry-oriented science curriculum, (b) teacher professional development for science instruction with these students, and (c) school resources for science instruction. The project's main goals are: (1) to evaluate the effect of the intervention on student achievement, (2) to determine the effect of the intervention on teacher knowledge, practices, and school resources, and (3) to assess how teacher knowledge, practices, and resources mediate student achievement. The project is conducted in the context of the Florida current science education policies and accountability system (e.g., adoption of the Next Generation Sunshine State Standards in Science, assessment of science at the fifth grade, a Race to the Top award state). The study draws on findings from research on a previous NSF-funded efficacy study (035331) in which the model to be scaled-up was tested in a single school district. The effectiveness study includes three (of 67) school districts as key partners, representative of racially, ethnically, linguistically, and socioeconomically diverse student populations; 64 elementary schools, 320 science teachers, and 24,000 fifth-grade students over a three-year period. Science learning is the primary subject matter, inclusive of life, physical, and earth/space sciences.

Six research questions corresponding to three research areas guide the proposed scope of work. For the research area of Student Science Achievement, questions are: (1) What is the effect of the intervention on fifth-grade students' science achievement, compared to "business as usual"?, and (2) To what extent are the effects of the intervention moderated by students' English as a Second Language (ESOL) level, SES status, and racial/ethnic backgrounds? For Teacher Knowledge and Practices as a research area, questions are: (3) What is the effect of the intervention on teachers' science knowledge and teaching practices?, and (4) To what extent is students' science achievement predicted by school resources for science instruction? For School Resources for Science, questions are: (5) What is the effect of the intervention on school resources for science instruction?, and (6) To what extent is student achievement predicted by school resources for science instruction? To assess the effect of the intervention on students' and teachers' outcomes, a cluster-randomized-control trial is used, resulting in a total of 64 randomly selected schools (after stratifying them by school-level percent of ESOL and Free Reduced Lunch students). All science teachers and students from the 64 schools participate in the project: 32 in the treatment group (project curriculum for fifth grade, teacher professional development, and instructional resources), and 32 in the control group (district-adopted fifth-grade curriculum, no teacher professional development, and no instructional resources). To address the research area of Student Science Achievement, formative assessment items are used at the end of each curriculum unit, along with two equated forms of a project-developed science test (to be used as pre-and posttests) with both treatment and control groups, in addition to the Florida's Comprehensive Assessment Tests-Science. Data interpretation for this research area employs a set of three-level HLMs (students, nested in classrooms, nested in schools). To address the research area of Teacher Knowledge and Practices and School Resources for Science, the project uses three measures: (a) two equated forms of a 35-items test of teacher science knowledge, (b) a classroom observation instrument measuring third-party ratings of teacher knowledge and teaching practices, and (c) a questionnaire measuring teachers' self-reports of science knowledge and teaching practices. All measures are administered to both treatment and control groups. Data interpretation strategies include a series of HLMs with emphasis on the relevant teacher outcomes as a function of time, and of school-level mediating variables. External project evaluation is conducted by Concentric Research and Evaluation using quantitative and qualitative methods and addressing both formative and summative components.

Project research findings contribute to the refinement of a model reflective of the new science standards in the State and the emerging national science standards. The value added of this effort consists of its potential to inform effective implementation of science curricula and teacher professional development in other learning settings, including ELLs and traditionally marginalized student populations at the elementary school level. It constitutes practically the only research study focused on the issue of scale-up and sustainability of effective science education practices with this student subpopulation, which has become prominent due to the dramatic growth of a racially, ethnically, and linguistically diverse school-aged population, low levels of U.S. student science achievement, and the role of science and mathematics in current accountability systems nationwide.

Promoting Science among English Language Learners (P-SELL) Scale-Up
Syndicate content