Pilot Test

Promoting Spatial Thinking with Web-based Geospatial Technologies

This project will develop STEM spatial thinking skills of middle school learners by equipping teachers with earth science investigations and support materials. This project will design, develop, and test curriculum materials that use Web Geospatial Information Systems that includes advanced visualization and geospatial analysis capabilities. The project will analyze how educative curriculum materials can prepare teachers to implement Web-based geospatial science pedagogical approaches to teaching, and document the impacts on student learning.

Lead Organization(s): 
Award Number: 
1118677
Funding Period: 
Fri, 07/01/2011 - Sun, 06/30/2013
Project Evaluator: 
Dr. Jean Russo
Promoting Spatial Thinking with Web-based Geospatial Technologies

Measuring the Effects of a School-based, Data-driven Professional Learning Model for Raising Secondary Mathematics Achievement

This project is designing and implementing a professional development model that uses data from the Surveys of Enacted Curriculum (SEC) to improve mathematics instruction at the high school level.

Lead Organization(s): 
Award Number: 
1020310
Funding Period: 
Tue, 03/01/2011 - Thu, 02/28/2013
Project Evaluator: 
WestEd
Full Description: 

 

The Surveys of Enacted Curriculum Professional Development Model (SECPDM) project, at RMC Research Corporation in Oregon, is designing and implementing a professional development model that uses data from the Surveys of Enacted Curriculum (SEC) to improve mathematics instruction at the high school level. Teachers participating in the professional development work together at the school level to learn how to use the data gathered through the SEC to align their curriculum with state and district standards. The teachers work in professional development communities within schools to better understand the content embedded in curriculum materials and assessments, and to be able to use that understanding to improve their daily instruction.

The SEC collects data from K-12 teachers of mathematics, science, and English language arts on course content and instructional practices. Using this data, one can determine the alignment between instruction in a specific school and state standards or assessments. Efforts to use the SEC data for school improvement have been hampered by two key constraints: (1) The survey is lengthy and not easy to complete and (2) The results provide a year-end summary that does not reach teachers in time to adjust instruction for the current year. The SECPDM project is designing a teacher log system in which teachers enter brief reports more frequently and get useful feedback throughout the year. The project is also designing and conducting professional development that will help teachers learn to use the data and feedback to align their instruction with state standards, and it is helping teachers build professional development communities within their schools. This project includes teachers in Ohio, New York, and Oregon. The project is conducting a quasi-experimental research study to test the hypothesis that if a critical mass of mathematics teachers collaboratively implements the professional development plan, then (1) the mathematics courses will be better articulated and aligned with state standards and assessments, (2) teachers will improve their instructional practices, and (3) student achievement in mathematics will increase.

The SECPDM project has the potential to improve the use of the Survey of Enacted Curriculum (SEC) by making the data entry process easier for teachers and the survey data more useful. By piloting this model of professional development and analyzing their findings, the project is making a significant step towards improving the alignment of the mathematics curriculum in high schools, helping teachers use the SEC data to inform instruction, and improving student achievement in mathematics.

Measuring the Effects of a School-based, Data-driven Professional Learning Model for Raising Secondary Mathematics Achievement

The Challenge of Interdisciplinary Education: Math-Bio

This project continues research and development work on high school instructional materials that integrate biology, computing, and mathematics. The project goal is to develop and test a one-semester high school course. The course consists of some modules developed under a previous NSF grant as well as some new material. Intended deliverables include up to five new instructional modules and a coherent one-semester course suitable for the increasing state requirements for a fourth year of mathematics.

Project Email: 
IMB@dimacs.rutgers.edu
Lead Organization(s): 
Award Number: 
1020166
Funding Period: 
Wed, 09/15/2010 - Sun, 08/31/2014
Project Evaluator: 
Len Albright at CSU
Full Description: 

Developers and researchers at Rutgers University, Boston University, Colorado State University, and the Consortium for Mathematics and Its Applications (COMAP) are continuing research and development work on high school instructional materials that integrate biology, computing, and mathematics. The project goal is to develop and test a one-semester high school course. The course consists of some modules developed under a previous NSF grant as well as some new material.

COMAP leads the effort to develop the instructional materials and the process involves mathematicians, biologists, computer scientists, teachers, and writers. The materials are pilot- and field-tested in a number of schools and revised after each test. Subject matter experts review the materials for accuracy and teachers and education professionals review them for their usability. Researchers at Colorado State University collect and analyze data on student learning and interest at all stages of the pilot- and field-testing.

The intended deliverables include up to five new instructional modules and a coherent one-semester course suitable for the increasing state requirements for a fourth year of mathematics. The course is supported by a book in print and electronic format and includes teacher training support tools and activities to prepare teachers to present interdisciplinary bio-mathematics material.

The Challenge of Interdisciplinary Education: Math-Bio

Language-rich Inquiry Science with English Language Learners (LISELL)

This exploratory study develops and pilot-tests a model for improving science teaching and learning with middle school ELLs. Study goals include: (1) clarifying pedagogical constructs of language-rich science inquiry and the academic language of science and their relationships across the learning contexts of middle school science classrooms, teacher professional development and family science workshops, (2) developing and refining instruments to study these constructs in context, and (3) conducting pilot tests of the model and instruments.

Award Number: 
1019236
Funding Period: 
Sun, 08/15/2010 - Wed, 07/31/2013
Full Description: 

This exploratory study develops, pilot-tests, and refines a model for improving middle school English Language Learners' (ELLs) science learning. The model incorporates two pedagogical constructs (language-rich science inquiry and academic language development); and three learning settings (teacher professional development workshops, middle school science classrooms, and parent-student-teacher science workshops). The specific objectives of the study are: (1) to clarify the two pedagogical constructs and their relationships across the three learning contexts, (2) to develop and refine instruments that will be useful for the study of these constructs in these learning contexts, and (3) to conduct pilot tests of the model and instruments.

The study's development phase consists of the production, adaptation, and pilot testing of instructional strategies for teachers and learning materials for students. Instructional strategies for teachers are centered on three key inquiry practices: (a) coordinating theory and evidence, (b) controlling variables, and (c) cause and effect reasoning across 6th grade earth science, 7th grade life science, and 8th grade physical science. Learning materials for students consist of lessons in a workbook with units highlighting the study of academic language. Also, this phase of the study includes the development of resources to support parents' participation and measurement instruments to gather data during the research phase of the study.

The research phase of the study consists of pilot testing of the model. Two research questions guide the study: (1 What is the value for ELL students, their teachers and their parents of an instructional model that highlights language-rich science inquiry practices and academic language development strategies?; and (2)What is the value for ELL students, their teachers and their parents of an instructional model that is enacted in the contexts of middle school science classrooms, student-parent-teacher science workshops, and teacher professional development workshops? Assuming a quasi-experimental, pretest-posttest design, a power analysis defined a sample size of 1,000 middle school students (800 for the treatment group, and 200 for the control group) in 40 classrooms of three middle schools in the state of Georgia. A total of 12 teachers (8 science teachers and 2 English for Students of Other Languages teachers) were selected using a targeted strategy; and 40 randomly selected parents constitute the remaining population sample. The intervention consists of the use of teacher instructional strategies focused on exploring and elaborating cause-effect relationships, differentiating between evidence and theory, and identifying and controlling variables; students' use of instructional materials on academic language; and exploration of parents' science funds of knowledge. Data gathering strategies employ five instruments: (a) a teacher-focus-group interview protocol, (b) a teacher observation protocol, (c) a parent-student interview protocol, (d) a student academic language writing test, and (e) a student-constructed-response science inquiry test. Data interpretation strategies include qualitative analysis using narrative and semantic structure analysis and statistical analyses. An advisory board and an evaluator conduct the evaluation component of the study, inclusive of formative and summative aspects.

The outcome of this study is a research-informed and field-tested science instructional model focused on the improved learning of ELLs and a set of valid and reliable measuring instruments.

Language-rich Inquiry Science with English Language Learners (LISELL)

Virtual Learning Communities: An Online Professional Development Resource for STEM Teachers

This project will design, develop, and test a virtual learning community (VLC) to enhance the ability of first- and fourth-grade teachers to provide mathematics education. The goal is to produce a prototype of a VLC for first- and fourth-grade Everyday Mathematics teachers that integrates three primary elements: (a) learning objects rooted in practice, such as lesson video, (b) community-building tools offered by the internet, and (c) focused content that drives teachers' professional learning in mathematics.

Project Email: 
vlc@cemseprojects.org
Lead Organization(s): 
Award Number: 
1020083
Funding Period: 
Thu, 07/15/2010 - Sun, 06/30/2013
Project Evaluator: 
none
Full Description: 

Researchers and developers at the University of Chicago are conducting an exploratory project to design, develop, and test a virtual learning community (VLC) to enhance the ability of first- and fourth-grade teachers to provide mathematics education. The project deploys cyberlearning technologies to allow teachers to interact with one another and with experts across the U.S. The goal is to produce a prototype of a VLC for first- and fourth-grade Everyday Mathematics teachers that integrates three primary elements: (a) learning objects rooted in practice, such as lesson video, (b) community-building tools offered by the internet, and (c) focused content that drives teachers' professional learning in mathematics.

This VLC is developed during two engineering cycles in which the project team engages teachers as central partners. The quality and utility of the resultant VLC is tested against the anticipated outcomes of (a) sustained participation by teachers in the VLC and (b) changes in teachers' "professional vision" in mathematics education. Sustained participation is tracked using web analytics and user logs. Changes in professional vision are measured by on-line assessment tools used by approximately 150 teachers.

The VLC develops learning objects; community-building tools; and focused content. The VLC will be launched during the third year of the project by way of the Everyday Mathematics website, which has over 6000 visitors per day, and the University of Chicago School Mathematics Project newsletter, which has a circulation of 40,000. The potential audience is quite large since Everyday Mathematics is used in 185,000 classrooms.

Virtual Learning Communities: An Online Professional Development Resource for STEM Teachers

Bridging the Gap Between High School and College Physics: An Exploratory Study

This project will bring together two promising innovations: a high school course entitled Energizing Physics and the BEAR assessment system. The goal of this study is to develop and test a formative assessment system for Energizing Physics that has the potential to enable all students to learn physics, so they can succeed in college.

Project Email: 
csneider@pdx.edu
Award Number: 
1020385
Funding Period: 
Sun, 08/15/2010 - Tue, 07/31/2012
Project Evaluator: 
Myron (Mike) Atkin
Full Description: 

This exploratory research study will bring together two promising innovations that have the potential to help more students meet high standards and prepare for college and 21st century careers. One innovation is a new high school course entitled Energizing Physics, designed to help students with a wide range of capabilities by applying best practices and presenting a relatively small number of key concepts in depth. Another is the BEAR assessment system, designed to provide frequent formative assessment data to students and teachers. The goal is to develop and test a formative assessment system for Energizing Physics that has the potential to enable all students to learn how to learn physics, so they can succeed in their first physics course in college. Partners include course authors Aaron Osowiecki and Jesse Southworth from Boston Latin School in Boston, Massachusetts, Cary Sneider and graduate students at Portland State University in Portland, Oregon, and assessment specialists Mark Wilson and Karen Draney at the Graduate School of Education, University of California at Berkeley.

The project will proceed in five phases. Phase I: During the summer of 2010 project teams from Massachusetts and Oregon will meet with assessment experts in California for training in the BEAR assessment system. Phase II: During the subsequent year the team will collaborate remotely to embed the BEAR system into the course materials, and recruit eight teachers (four in Massachusetts and four in Oregon) who will test the new materials in a variety of high school settings. Phase III: Weeklong workshops will be held in Oregon and Massachusetts during the summer of 2011 to familiarize teachers with the course and assessment system. Phase IV: Teachers will present the course to their students, collect pre-post test data on students' conceptual understanding and problem solving abilities, as well as work samples, and report on successes and challenges. Teams will conduct classroom visits and interview teachers at school sites. Phase V: During the summer of 2012 the teams will analyze the results, modify the course materials as appropriate, and report on findings.

Given the substantial body of research on the value of formative evaluation for supporting learning, this exploratory study has the potential to develop a physics course that could help teachers support learning among students with a wide diversity of capabilities. Further, since this research builds on a similar study of the high school course Living by Chemistry, which also uses the BEAR formative evaluation system, it may be possible to generalize ways that high school science courses can be designed to help more students succeed in college science.

Bridging the Gap Between High School and College Physics: An Exploratory Study

Data Games: Tools and Materials for Learning Data Modeling (Collaborative Research: Finzer)

This project is developing software and curriculum materials in which data generated by students playing computer games form the raw material for mathematics classroom activities. Students play a short video game, analyze the game data, conjecture improved strategies, and test their strategies in another round of the game.

Award Number: 
0918735
Funding Period: 
Tue, 09/01/2009 - Fri, 08/31/2012
Project Evaluator: 
James Hammerman
Full Description: 

 

Students playing computer games generate large quantities of rich, interesting, highly variable data that mostly evaporates into the ether when the game ends. What if in a classroom setting, data from games students played remained accessible to them for analysis? In software and curriculum materials being developed by the Data Games project at UMass Amherst and KCP Technologies, data generated by students playing computer games form the raw material for mathematics classroom activities. Students play a short video game, analyze the game data, conjecture improved strategies, and test their strategies in another round of the game.

 

The video games are embedded in TinkerPlots and Fathom, two data analysis learning environments widely used in grades 5–8 and 8–14 respectively. The game data appear in graphs in real time, allowing several cycles of strategy improvement in a short time. The games are designed so that these cycles im- prove understanding of specific data modeling and/or mathematics concepts. Lessons will be embedded in LessonLink from Key Curriculum Press to facilitate their integration into standard curricula. The three- year project expands research in students’ understanding of data modeling and their ability to learn mathematical content embedded in data-rich contexts.

 

Data Games: Tools and Materials for Learning Data Modeling (Collaborative Research: Finzer)

Communication in Science Inquiry Project (CISIP)

CISIP is a professional development program that enables English and science teachers to help students to learn content and communicate scientifically. The CISIP program: Translates How Students Learn Science in the Classroom and Common Core State Standards for student success. Targets learning within a classroom discourse community that focuses on argumentation.Takes a team of science and English teachers at schools from middle level through university who collaborate.

Project Email: 
mlang10@cox.net
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
0353469
Funding Period: 
Thu, 07/01/2004 - Fri, 12/31/2010
Project Evaluator: 
M. J. Young
Communication in Science Inquiry Project (CISIP)

The Scientific Thinker Project: A Study of Teaching and Learning Concepts of Evidence and Nature of Scientific Evidence in Elementary School

Current curriculum materials for elementary science students and teachers fail to provoke the following essential questions during science instruction: What is evidence? Why do you need evidence? The goal of this project is to identify whether and how elementary school students formulate answers to these questions and develop concepts of evidence and understandings of the nature of scientific evidence.

Lead Organization(s): 
Award Number: 
0918533
Funding Period: 
Sat, 08/01/2009 - Sat, 07/31/2010
The Scientific Thinker Project: A Study of Teaching and Learning Concepts of Evidence and Nature of Scientific Evidence in Elementary School

Application of Evidence-centered Design to States Large-scale Science Assessment

This project aims to (1) determine ways in which Evidence-Centered Design enhances the quality of large-scale, technology-based science assessments for middle school grades and high school equivalency; (2) implement resulting procedures in operational test development; (3) evaluate the efficiency, effectiveness and generalizability of these procedures, and (4) disseminate findings to the assessment community.

Award Number: 
0733172
Funding Period: 
Sat, 09/01/2007 - Fri, 08/31/2012
Project Evaluator: 
Haynie Research and Evaluation--Doreen Finkelstein, Kathleen Haynie
Full Description: 

 The project began as a collaborative research effort among six organizations—a non-profit research company (SRI International), a university (University of Maryland), a commercial test publishing company (Pearson), Minnesota’s (MN) state department of education, a software engineering firm (Codeguild, Inc.), and an educational evaluation firm (Haynie Research and Evaluation). Due to changes in the affiliation of key personnel, the project transitioned to a collaboration among five organizations--SRI International, ETS, University of Maryland, Pearson and Haynie Research and Evaluation. Together these groups designed and implemented several studies to document the influence of evidence-centered design when applied to Pearson's science assessment design and development processes.

The goals of the project are: (1) to determine leverage points by which ECD can enhance the quality of large-scale technology-based assessments and the efficiency of their design, (2) to implement resulting procedures in operational test development cycles, (3) to evaluate efficiency, effectiveness and generalizability of these procedures, (4) to develop two software wizards to support design of task-based scenarios and assessment items, and (5) to disseminate findings to the assessment community.

This project will develop an exemplar set of design patterns based on the critical benchmarks identified in the Minnesota Academic Standards for science and on the GED science practice indicators and content targets. It is of particular interest in this project that elements of ECD will be applied to an existing large-scale accountability and credentialing assessments, in the context of existing test development and delivery processes.  The project is constrained to maintain adherence to existing test specifications, “look and feel” of tasks, timelines, and delivery and scoring procedures.  Rather than designing new assessment systems or re-engineering existing ones, the present project seeks to identify and implement ideas from ECD in existing large-scale, high-stakes testing programs. Principles of ECD have been implemented in several training workshops for assessment designers and item writers to support the development of scenario-based science tasks. The project's technical report series is available at http: //ecd.sri.com. 

 

 

 

Application of Evidence-centered Design to States Large-scale Science Assessment
Syndicate content