Handbook/Manual

A Framework for Assessing Environmental Literacy

This workshop developed a new, comprehensive, research-based framework for assessing environmental literacy. By bringing together, for the first time, experts in research, assessment, and evaluation from the fields of science education, environmental education, and related social science fields, this project accessed and built its work on the literature and the insights of many disciplines.

Award Number: 
1033934
Funding Period: 
Mon, 11/15/2010 - Wed, 10/31/2012
Project Evaluator: 
Joe Heimlich, OSU
Alternative video text
Alternative video text: 
A video of the National Press Club dissemination event is posted at www.NAAEE.net/Framework
Full Description: 
This workshop developed a new, comprehensive, research-based framework for assessing environmental literacy. By bringing together, for the first time, experts in research, assessment, and evaluation from the fields of science education, environmental education, and related social science fields, this project accessed and built its work on the literature and the insights of many disciplines. The North American Association for Environmental Education (NAAEE) worked with the leaders of the only two large-scale assessments of environmental literacy used in the U.S. to date (Programme for International Student Assessment [PISA] and the National Environmental Literacy Assessment [NELA]) to conduct the workshop. The project leaders analyzed PISA and NELA and used a multi-disciplinary search and review of the literature to prepare a draft framework. At the workshop and thereafter, a diverse array of invited experts critiqued that draft and provided suggestions for revision. Then, the leaders/organizers produced a final Environmental Literacy Framework and disseminated it both electronically and at a nationally advertised event to a wide audience of assessment specialists, funding and policy-making agencies, and organizations working to develop assessments and achieve environmental literacy. Many institutions and agencies have noted the need to create an environmentally literate population, and government and private entities are investing hundreds of millions of dollars in projects aimed at enhancing environmental literacy. Given the scope and scale of these investments and the interest in this arena on the part of federal agencies, professional organizations, and corporations, assessments for gauging our progress in transforming our preK-12 education system to achieve that end are needed. The new Framework for assessing environmental literacy provides a foundation for measuring the extent to which we are enabling all learners to acquire the knowledge, skills, dispositions, and behaviors vital for competently making decisions about local, regional, national and global issues.
A Framework for Assessing Environmental Literacy

Modeling Engineered Levers for the 21st Century Teaching of STEM (Collaborative Research: Schunn)

This project will develop three replacement units for biology and refine them through classroom testing. The units will be models of STEM integration by using the important concepts of proportional reasoning and algebraic thinking and engineering re-design to address big ideas in science while also promoting the learning of 21st century skills. The materials will be educative for teachers, and the teacher materials and professional development methods will work at scale and distance.

Project Email: 
birdy@pitt.edu
Lead Organization(s): 
Award Number: 
1027629
Funding Period: 
Wed, 09/01/2010 - Sun, 08/31/2014
Project Evaluator: 
Bill Bickel
Full Description: 

Research in biology has become increasingly mathematical, but high school courses in biology use little mathematics. To address this concern, this project will develop three replacement units for biology and refine them through classroom testing. The units will be models of STEM integration by using the important concepts of proportional reasoning and algebraic thinking and engineering re-design to address big ideas in science while also promoting the learning of 21st century skills. The materials build on existing work on the use of model eliciting activities and focus science and technology instruction on high-stakes weaknesses in mathematics and science. They address the scaling issue as part of the core design work by developing small units of curriculum that can be applied by early adopters in each context. The materials will undergo many rounds of testing and revision in the early design process with at least ten teachers each time. The materials will be educative for teachers, and the teacher materials and professional development methods will work at scale and distance.

Learning of science content will be measured through the use of existing instruments in wide use. Existing scales of task values, achievement goals and interest are used to measure student motivation. The work performed is guided by a content team; a scaling materials team; a scaling research team; the PI team of a cognitive scientist, a robotics educator, and a mathematics educator specializing in educational reform at scale; and the summative evaluation team lead by an external evaluator.

There is great interest in understanding whether integrated STEM education can interest more students in STEM disciplines. The focus on mathematics integrated with engineering in the context of a science topic is interesting and novel and could contribute to our understanding of integrating mathematics, engineering and science. The development team includes a cognitive scientist, a mathematics educator, teachers and scientists. The issues and challenges of interdisciplinary instruction will be investigated.

Modeling Engineered Levers for the 21st Century Teaching of STEM (Collaborative Research: Schunn)

Language-rich Inquiry Science with English Language Learners (LISELL)

This exploratory study develops and pilot-tests a model for improving science teaching and learning with middle school ELLs. Study goals include: (1) clarifying pedagogical constructs of language-rich science inquiry and the academic language of science and their relationships across the learning contexts of middle school science classrooms, teacher professional development and family science workshops, (2) developing and refining instruments to study these constructs in context, and (3) conducting pilot tests of the model and instruments.

Award Number: 
1019236
Funding Period: 
Sun, 08/15/2010 - Wed, 07/31/2013
Full Description: 

This exploratory study develops, pilot-tests, and refines a model for improving middle school English Language Learners' (ELLs) science learning. The model incorporates two pedagogical constructs (language-rich science inquiry and academic language development); and three learning settings (teacher professional development workshops, middle school science classrooms, and parent-student-teacher science workshops). The specific objectives of the study are: (1) to clarify the two pedagogical constructs and their relationships across the three learning contexts, (2) to develop and refine instruments that will be useful for the study of these constructs in these learning contexts, and (3) to conduct pilot tests of the model and instruments.

The study's development phase consists of the production, adaptation, and pilot testing of instructional strategies for teachers and learning materials for students. Instructional strategies for teachers are centered on three key inquiry practices: (a) coordinating theory and evidence, (b) controlling variables, and (c) cause and effect reasoning across 6th grade earth science, 7th grade life science, and 8th grade physical science. Learning materials for students consist of lessons in a workbook with units highlighting the study of academic language. Also, this phase of the study includes the development of resources to support parents' participation and measurement instruments to gather data during the research phase of the study.

The research phase of the study consists of pilot testing of the model. Two research questions guide the study: (1 What is the value for ELL students, their teachers and their parents of an instructional model that highlights language-rich science inquiry practices and academic language development strategies?; and (2)What is the value for ELL students, their teachers and their parents of an instructional model that is enacted in the contexts of middle school science classrooms, student-parent-teacher science workshops, and teacher professional development workshops? Assuming a quasi-experimental, pretest-posttest design, a power analysis defined a sample size of 1,000 middle school students (800 for the treatment group, and 200 for the control group) in 40 classrooms of three middle schools in the state of Georgia. A total of 12 teachers (8 science teachers and 2 English for Students of Other Languages teachers) were selected using a targeted strategy; and 40 randomly selected parents constitute the remaining population sample. The intervention consists of the use of teacher instructional strategies focused on exploring and elaborating cause-effect relationships, differentiating between evidence and theory, and identifying and controlling variables; students' use of instructional materials on academic language; and exploration of parents' science funds of knowledge. Data gathering strategies employ five instruments: (a) a teacher-focus-group interview protocol, (b) a teacher observation protocol, (c) a parent-student interview protocol, (d) a student academic language writing test, and (e) a student-constructed-response science inquiry test. Data interpretation strategies include qualitative analysis using narrative and semantic structure analysis and statistical analyses. An advisory board and an evaluator conduct the evaluation component of the study, inclusive of formative and summative aspects.

The outcome of this study is a research-informed and field-tested science instructional model focused on the improved learning of ELLs and a set of valid and reliable measuring instruments.

Language-rich Inquiry Science with English Language Learners (LISELL)

Using Routines as an Instructional Tool for Developing Students' Conceptions of Proof

This project will develop and systematically investigate a teaching model to assist teachers in developing ideas about proof in grades 2-5. The teaching model provides both a tool for learning on the part of elementary teachers and a model of practice from which they can learn as they implement it.

Lead Organization(s): 
Award Number: 
1019482
Funding Period: 
Wed, 09/01/2010 - Fri, 08/31/2012
Project Evaluator: 
Megan Franke
Full Description: 

Developers and researchers at TERC, the Education Development Center, and Mount Holyoke College are participating in the development and systematic investigation of a teaching model to assist teachers in developing ideas about proof in grades 2-5. The teaching model provides both a tool for learning on the part of elementary teachers and a model of practice from which they can learn as they implement it.

The project is a teaching experiment in which the model is iteratively implemented and refined, first with teachers experienced in incorporating ideas about proof into their classroom instruction (Phase 1), then with teachers who are relatively inexperienced, both in their own understanding of proof and in their knowledge of how their students can learn about proof (Phase 2). Research questions focus on developing the components of the model, the learning of teachers as they implement the model, and the learning of students as they engage in the instruction that is guided by the model, with particular attention to students with varied histories of achievement in grade-level work on number and operations.

The expected outcome is a teaching model that can be tested on a larger scale as well as instruments for assessing student learning and teacher understanding of proof. The model includes printed material with descriptions of the routines and instructional sequences, guidelines for implementing each component, and a teaching framework as well as written and video case examples.

Using Routines as an Instructional Tool for Developing Students' Conceptions of Proof

Oceans of Data: What is Needed to Support Students' Learning with Large Scientific Databases? (Collaborative Research: Krumhansl)

This project will address the question: In what ways can research on learning inform the design of interfaces and technology tools to be used by students accessing large scientific data bases? Oceans of Data will (1) conduct a systematic survey of the widely-dispersed research literature and (2) develop and disseminate a knowledge status report, a resource offering guidance for making these large scientific data bases accessible to and usable by high school science classes.

Award Number: 
1020002
Funding Period: 
Wed, 09/01/2010 - Fri, 08/31/2012
Full Description: 

This DR K-12 Exploratory Project conducted by Education Development Center, Inc.(EDC) and The Scripps Institution of Oceanography (Scripps)will address the question: In what ways can research on learning inform the design of interfaces and technology tools to be used by students accessing large scientific data bases? Expertise about this question is scattered among a variety of disciplines, including: science education research related to geology, climate science, and ecology; mathematics and statistics education research; and educational psychology. Consequently, there is no synthesis of knowledge about how to support precollege students' and teachers' use of large scientific data bases. Oceans of Data will therefore (1) conduct a systematic survey of the widely-dispersed research literature and (2) develop and disseminate a knowledge status report, a resource offering guidance for making these large scientific data bases accessible to and usable by high school science classes. This report will inform the work of three target audiences: (1) large science cyberinfrastructure projects concerned with serving student users; (2) intermediary developers (e.g., publishers, research and development organizations, and software development companies) of digital interfaces and tools that can make cyberinfrastructure data appropriate for use by pre-college learners; and (3) education researchers. Most immediately, the project results will be applied directly to the NSF-funded Ocean Observatory Initiative (OOI) cyberinfrastructure project at Scripps.

The project design for developing this resource involves a multi-stage review, coding, and analysis of the literature. The coding protocol framing this effort focuses on categories of data representations (such as maps, graphs, 3D representations, animations and multiple data representations) processes of working with data ( such as finding and selecting data, reading data representations, creating data representations, and pattern recognition) and cross-cutting themes (such as visual perception, spatial perception and visualization, cognitive load, and mental models) Work is being conducted under the aegis of an advisory committee: researchers and technology developers in the above-mentioned domains, expert teachers, and individuals representing the target audiences. Advisors will also evaluate the resulting product, as will an additional cadre of targeted end-users.

The Oceans of Data knowledge status report will present: the literature review results; recommendations for designing effective interfaces and technology tools for students; guidelines, based on tenets of universal design for learning (UDL) for designing software for diverse student populations; and suggested avenues for future research to address identified gaps. The project therefore will enable the bridging of science cyberinfrastructure projects in a number of disciplines with pre-college education. Ultimately, students will have unprecedented opportunities to analyze and draw conclusions from cyberinfrastructure data and, thus, to engage in new modes of data-driven science practice.

Oceans of Data: What is Needed to Support Students' Learning with Large Scientific Databases? (Collaborative Research: Krumhansl)

Bridging the Gap Between High School and College Physics: An Exploratory Study

This project will bring together two promising innovations: a high school course entitled Energizing Physics and the BEAR assessment system. The goal of this study is to develop and test a formative assessment system for Energizing Physics that has the potential to enable all students to learn physics, so they can succeed in college.

Project Email: 
csneider@pdx.edu
Award Number: 
1020385
Funding Period: 
Sun, 08/15/2010 - Tue, 07/31/2012
Project Evaluator: 
Myron (Mike) Atkin
Full Description: 

This exploratory research study will bring together two promising innovations that have the potential to help more students meet high standards and prepare for college and 21st century careers. One innovation is a new high school course entitled Energizing Physics, designed to help students with a wide range of capabilities by applying best practices and presenting a relatively small number of key concepts in depth. Another is the BEAR assessment system, designed to provide frequent formative assessment data to students and teachers. The goal is to develop and test a formative assessment system for Energizing Physics that has the potential to enable all students to learn how to learn physics, so they can succeed in their first physics course in college. Partners include course authors Aaron Osowiecki and Jesse Southworth from Boston Latin School in Boston, Massachusetts, Cary Sneider and graduate students at Portland State University in Portland, Oregon, and assessment specialists Mark Wilson and Karen Draney at the Graduate School of Education, University of California at Berkeley.

The project will proceed in five phases. Phase I: During the summer of 2010 project teams from Massachusetts and Oregon will meet with assessment experts in California for training in the BEAR assessment system. Phase II: During the subsequent year the team will collaborate remotely to embed the BEAR system into the course materials, and recruit eight teachers (four in Massachusetts and four in Oregon) who will test the new materials in a variety of high school settings. Phase III: Weeklong workshops will be held in Oregon and Massachusetts during the summer of 2011 to familiarize teachers with the course and assessment system. Phase IV: Teachers will present the course to their students, collect pre-post test data on students' conceptual understanding and problem solving abilities, as well as work samples, and report on successes and challenges. Teams will conduct classroom visits and interview teachers at school sites. Phase V: During the summer of 2012 the teams will analyze the results, modify the course materials as appropriate, and report on findings.

Given the substantial body of research on the value of formative evaluation for supporting learning, this exploratory study has the potential to develop a physics course that could help teachers support learning among students with a wide diversity of capabilities. Further, since this research builds on a similar study of the high school course Living by Chemistry, which also uses the BEAR formative evaluation system, it may be possible to generalize ways that high school science courses can be designed to help more students succeed in college science.

Bridging the Gap Between High School and College Physics: An Exploratory Study

Iterative Model Building (IMB): A Program for Training Quality Teachers and Measuring Teacher Quality

This project aims to improve professional development programs for pre-service teachers (PSTs) as a way to improve student learning in mathematics and science. PSTs engage in a series of teaching cycles, and then engage in lesson study groups to develop, teach, and analyze a whole-class lesson. The cycle is completed by reexamining students' knowledge in teaching experiments with pairs of students. These teaching cycles are called Iterative Model Building (IMB).

Lead Organization(s): 
Award Number: 
0732143
Funding Period: 
Wed, 08/15/2007 - Tue, 07/31/2012
Project Evaluator: 
Center for Evaluation and Education Policy
Iterative Model Building (IMB): A Program for Training Quality Teachers and Measuring Teacher Quality

Communication in Science Inquiry Project (CISIP)

CISIP is a professional development program that enables English and science teachers to help students to learn content and communicate scientifically. The CISIP program: Translates How Students Learn Science in the Classroom and Common Core State Standards for student success. Targets learning within a classroom discourse community that focuses on argumentation.Takes a team of science and English teachers at schools from middle level through university who collaborate.

Project Email: 
mlang10@cox.net
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
0353469
Funding Period: 
Thu, 07/01/2004 - Fri, 12/31/2010
Project Evaluator: 
M. J. Young
Communication in Science Inquiry Project (CISIP)

Curriculum Topic Study -- A Systematic Approach to Utilizing National Standards and Cognitive Research

This project is developing a series of print and web resource guides in science and mathematics based on curriculum topic study (CTS), an approach developed and tested successfully. CTS is used to provide a systematic way of intellectually engaging K-12 mathematics and science teachers with national standards and cognitive research. It is used to engage teachers in thought and discussion about both content and appropriate ways of teaching that content.

Award Number: 
0353315
Funding Period: 
Sat, 05/15/2004 - Fri, 04/30/2010
Curriculum Topic Study -- A Systematic Approach to Utilizing National Standards and Cognitive Research

Examining Coaching in Elementary (K-8) Mathematics Classrooms

This project conducts research on knowledge that contributes to successful coaching in two domains: coaching knowledge and mathematics content knowledge. The influence of these knowledge domains on both coaches and teachers is being examined in two ways: (1) by investigating correlations between assessments of coach and teacher knowledge and practice in each domain and (2) by investigating causal effects of targeted professional development for coaches.

Project Email: 
emc@math.montana.edu
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
0918326
Funding Period: 
Wed, 07/15/2009 - Sun, 07/31/2011
Examining Coaching in Elementary (K-8) Mathematics Classrooms
Syndicate content