Assessment

Teacher Education: Learning the Practice of Statistics

This exploratory project is to enhance the ability of teachers to provide high quality STEM education for all students by developing research-based materials that enable teachers to facilitate students' progress toward statistical understanding.

Lead Organization(s): 
Award Number: 
1119016
Funding Period: 
Tue, 11/01/2011 - Thu, 10/31/2013
Full Description: 

This exploratory project is to enhance the ability of teachers to provide high quality STEM education for all students by developing research-based materials that enable teachers to facilitate students' progress toward statistical understanding. The exploratory project has two phases. The first phase will focus on modeling student learning of difficult statistical concepts by constructing and developing a set of student learning progressions. Informed by the first phase, the second phase will focus on developing, implementing, supporting, and pilot testing instructional materials for teachers aimed at increasing knowledge and effective practice of statistical concepts. Formative and summative assessments will be used to evaluate (a) the materials, (b) the participant activities and experiences with the materials, and (c) the implementation process.

Both Common Core State Standards for Mathematics and National Council of Teachers of Mathematics standards clearly recommend the emphasis of statistics education in K-12 schools. In recent years, researchers have started to explore issues related to statistics education in Grades K-8, but little work has been done at the high school level. This exploratory project addresses a critical need in mathematics education and fills an important gap in teacher education related to high school statistics.

Teacher Education: Learning the Practice of Statistics

Educating the Imagination: A Studio Design for Transformative Science Learning

<!--[if gte mso 9]> 0 0 1 81 468 TERC 3 1 548 14.0 <![endif]--> <!--[if gte mso 9]> Normal 0 false false false EN-US JA X-NONE <![endif]--><!--[if gte mso 9]> <![endif]--> <!--[if gte mso 10]> <! /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:Cambria; mso-ascii-font-family:Cambria; mso-ascii-theme-font:minor-latin; mso-hansi-font-family:Cambria; mso-hansi-theme-font:minor-latin;} --> <!--[endif] --> <!--StartFragment-->

Educating the Imagination will develop a studio approach to science for underrepresented high school students. The approach integrates scientific and artistic habits of mind and forms of engagement for meaningful learning in water-related sciences. Youth will a) investigate significant water-related phenomena, b) develop creative responses to the phenomena that foster new understandings and possibilities for action, and c) exhibit their responses community-wide to involve others in re-imagining water locally and globally.

<!--EndFragment-->

 

<!--EndFragment--> <!--[if gte mso 9]> 0 0 1 25 144 TERC 1 1 168 14.0 <![endif]--> <!--[if gte mso 9]> Normal 0 false false false EN-US JA X-NONE <![endif]--><!--[if gte mso 9]> <![endif]--> <!--[if gte mso 10]> <! /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:Cambria; mso-ascii-font-family:Cambria; mso-ascii-theme-font:minor-latin; mso-hansi-font-family:Cambria; mso-hansi-theme-font:minor-latin;} --> <!--[endif] --> <!--StartFragment--><!--EndFragment-->

Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1135120
Funding Period: 
Sat, 10/01/2011 - Mon, 09/30/2013
Full Description: 

TERC, in collaboration with the Boston Arts Academy is developing an innovative studio learning environment for students in grades 7-9. This pilot project focuses on object-centered inquiry about water and water-related problems of local and global significance. The project promotes student learning through multi-faceted studies involving hydrology, history, health, digital media, web-based artifact generation, real world data collection, interactions with scientists and artists, and community exhibitions of student work. The primary goal of the Educating the Imagination project is to develop a more effective model for engaging and improving the science learning and achievement of underrepresented urban students.

Studio learning intentionally integrates experimentation with practices of analysis, interpretation, critique of work and conceptual development. During a four week summer studio program, students, guided by teachers and scientists, will produce research-based projects about water and create plans to exhibit their work in the Boston area during the school year. Students will be assessed along multiple dimensions ranging from the depth of their understanding of water science ideas, their ability to make claims and arguments, their use of multiple tools and modes of representation, and the quality of their presentations. Over a two year period researchers will collect data on the studio design model and student learning to determine which aspects of the studio are effective in engaging students in object-oriented inquiry related to important water science ideas and problems.

Educating the Imagination will provide valuable insights about the studio design model and its application to promote science learning. In addition, this project directly addresses the problem of inequality in opportunities to learn and participate in science by developing and testing an innovative, non-traditional learning model with underrepresented urban students. The results of this project could significantly change how we think about and structure STEM learning environments in urban settings.

Educating the Imagination: A Studio Design for Transformative Science Learning

Cluster Randomized Trial of the Efficacy of Early Childhood Science Education for Low-income Children

The research goal of this project is to evaluate whether an early childhood science education program, implemented in low-income preschool settings produces measurable impacts for children, teachers, and parents. The study is determining the efficacy of the program on Science curriculum in two models, one in which teachers participate in professional development activities (the intervention), and another in which teachers receive the curriculum and teachers' guide but no professional development (the control).

Project Email: 
vanegere@msu.edu
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1119327
Funding Period: 
Mon, 08/15/2011 - Wed, 07/31/2013
Project Evaluator: 
Brian Dates, Southwest Counseling Services
Full Description: 

The research goal of this project is to evaluate whether an early childhood science education program, Head Start on Science, implemented in low-income preschool settings (Head Start) produces measurable impacts for children, teachers, and parents. The study is being conducted in eight Head Start programs in Michigan, involving 72 classrooms, 144 teachers, and 576 students and their parents. Partners include Michigan State University, Grand Valley State University, and the 8 Head Start programs. Southwest Counseling Solutions is the external evaluator.

The study is determining the efficacy of the Head Start on Science curriculum in two models, one in which 72 teachers participate in professional development activities (the intervention), and another in which 72 teachers receive the curriculum and teachers' guide but no professional development (the control). The teacher study is a multi-site cluster randomized trial (MSCRT) with the classroom being the unit of randomization. Four time points over two years permit analysis through multilevel latent growth curve models. For teachers, measurement instruments include Attitudes Toward Science (ATS survey), the Head Start on Science Observation Protocol, the Preschool Classroom Science Materials/Equipment Checklist, the Preschool Science Classroom Activities Checklist, and the Classroom Assessment Scoring System (CLASS). For students, measures include the "mouse house problem," Knowledge of Biological Properties, the physics of falling objects, the Peabody Picture Vocabulary Test-Fourth Edition, the Expressive Vocabulary Test-2, the Test of Early Mathematics Ability-3, Social Skills Improvement System-Rating Scales, and the Emotion Regulation Checklist. Measures for parents include the Attitudes Toward Science survey, and the Community and Home Activities Related to Science and Technology for Preschool Children (CHARTS/PS). There are Spanish versions of many of these instruments which can be used as needed. The external evaluation is monitoring the project progress toward its objectives and the processes of the research study.

This project meets a critical need for early childhood science education. Research has shown that very young children can achieve significant learning in science. The curriculum Head Start on Science has been carefully designed for 3-5 year old children and is one of only a few science programs for this audience with a national reach. This study intends to provide a sound basis for early childhood science education by demonstrating the efficacy of this important curriculum in the context of a professional development model for teachers.

Cluster Randomized Trial of the Efficacy of Early Childhood Science Education for Low-income Children

Transforming Teaching through Implementing Inquiry (T2I2)

This project explores the use of cyberinfrastructure to significantly enhance the delivery and quality of professional development for grades 8-12 engineering, technology, and design educators. The goal of the project is to study whether the use of highly interactive cyberinfrastructure increases the educator's teaching competencies and how to effectively teach. Student achievement is measured by comparing state assessments in: the curriculum's technology, engineering, and design assessment, end-of-grade mathematics assessment, and end-of-grade science assessment.

Partner Organization(s): 
Award Number: 
1118942
Funding Period: 
Mon, 08/01/2011 - Fri, 07/31/2015
Full Description: 

Transforming Teaching Through Implementing Inquiry (T2I2) is a full research and development project that explores the use of cyberinfrastructure to significantly enhance the delivery and quality of professional development (PD) for grades 8-12 engineering, technology, and design educators. The goal of the project is to study whether the use of highly interactive cyberinfrastructure increases this target audience's: 1) understanding of engineering design concepts and ability to effectively teach them 2) understanding of how to address student learning needs 3) ability to manage, monitor, and adjust the learning environment 4) use of self assessment to enhance teaching ability and 5) engagement in a community of practice. These issues are of particular interest because of the limited resources in place to prepare pre-service engineering and CTE teachers, as well as a lack of in-service PD.

The content for the PD is grounded in the materials and processes of two projects reviewed by the National Research Council's (NRC) report review committee: Technology Education: Learning by Design for Middle Schools" and "Engineering by Design for High Schools." By incorporating an object-oriented generic system design (learning objects), the cyberinfrastructure is set to be reusable, adaptable, and scalable. These learning objects allow for customization of the learning experience, whereby learning facilitators or learners themselves can configure the system based on their specific needs. Delivering learning objects in an online framework enables teachers to develop and grow in a network community.

A mixed methods approach is used to determine effects of professional development. Student achievement is measured by comparing each site's state assessments in the following areas: the curriculum's technology, engineering, and design assessment, end-of-grade mathematics assessment, and end-of-grade science assessment. Both formative and summative evaluation strategies inform the development and implementation of the project. As such, the project will advance theory, design, and practice in middle and high school enginee

Transforming Teaching through Implementing Inquiry (T2I2)

PROJECT ATOMS: Accomplished Elementary Teachers of Mathematics and Science

The project is studying the impact of the mathematics and science intensive pre-service preparation program for elementary school teachers.  The project includes assessments of pre-service teachers' math and science content, teacher performance, self-report surveys, and teacher interviews. Each of the study dimensions (Knowledge Dimension, Teaching Performance, and Perspectives on the Program) will be assessed at three time points across this longitudinal study, providing a model for elementary teacher development of STEM teaching.

Lead Organization(s): 
Award Number: 
1118894
Funding Period: 
Thu, 09/01/2011 - Sun, 08/31/2014
Full Description: 

The project is studying the impact of the mathematics and science intensive pre-service preparation program for elementary school teachers at North Carolina State University called the Accomplished Elementary Teachers of Mathematics and Science (ATOMS). Faculty in NCSU's Department of Elementary Education, researchers at the Duke University Sanford School of Public Policy's Education Research Data Center and the NC State College Professional Education Office are involved in conducting this project.

The project includes assessments of pre-service teachers' math and science content, teacher performance, self-report surveys, and teacher interviews. Researchers are also tracking participants' perspectives on the program and comparing knowledge dimensions and teaching performance of a sub-sample of ATOMS teachers to a similar group of non-ATOMS teachers. Each of the study dimensions (Knowledge Dimension, Teaching Performance, and Perspectives on the Program) will be assessed at three time points across this longitudinal study, providing a model for elementary teacher development of STEM teaching.

The study has potential to advance current understanding regarding teacher preparation, especially in terms of supporting elementary teachers' instruction in science and math. The project is also innovative and potentially transformative by asking interesting and pertinent questions of how teachers can affect the learning of their students. Besides generating new knowledge, this project also has the potential to impact STEM education research. The ATOMS pre-service teacher preparation program may serve as a model for effective pre-service teacher education across the nation if the researchers can clearly demonstrate the effect of participating in the program in changing teachers' knowledge, attitudes, and skills, as well as their students' achievement. Investigators propose the dissemination of findings to both K-12 audiences and institutions of higher education. Additionally, key findings will be bulleted for policy makers in brief reports or brochures sent to deans of Colleges of Education nationwide, highlighting recommendations based on the findings.

PROJECT ATOMS: Accomplished Elementary Teachers of Mathematics and Science

Computer-supported Math Discourse among Teachers and Students (Collaborative Research: Powell)

This project will design, develop, and test an online collaborative learning environment where students and teachers solve mathematical problems and communicate their thinking.  This online collaborative learning environment will help increase the quality and quantity of math discourse among mathematics teachers and students.  The researchers will also examine the impact of the online collaborative learning environment on students' significant mathematical discourse and achievement.

Lead Organization(s): 
Award Number: 
1118888
Funding Period: 
Thu, 09/01/2011 - Sat, 08/31/2013
Full Description: 

This full research and development project is to design, develop, and test a cutting-edge learning environment where students and teachers solve mathematical problems and communicate their thinking with others through the virtual environment. The major focus is to increase the quality and quantity of significant math discourse among mathematics teachers and their students by using the virtual learning environment. The researchers will test the usability of the learning environment for engaging students in high quality discourse. The researchers will also examine the impact of the virtual learning environment on student significant mathematical discourse and achievement.

The project uses a design research method as well as summative evaluations to achieve research and development goals. Mixed methods will be used to examine the impact of the virtual learning environment on student significant mathematical discourse and achievement.

The findings of the project contribute to the field in three ways: (1) The virtual learning environment can be both an effective pedagogical tool and a research tool in mathematics education; (2) It will contribute to our understanding about the nature of mathematical discourse online as well as about ways to foster the quality and quantity of significant math discourse among teachers and their students; and (3) This project can provide insights into effective online deliveries of courses.

Computer-supported Math Discourse among Teachers and Students (Collaborative Research: Powell)

Computer-supported Math Discourse among Teachers and Students (Collaborative Research: Stahl)

This project will design, develop, and test an online collaborative learning environment where students and teachers solve mathematical problems and communicate their thinking.  This online collaborative learning environment will help increase the quality and quantity of math discourse among mathematics teachers and students.  The researchers will also examine the impact of the online collaborative learning environment on students' significant mathematical discourse and achievement.

Project Email: 
Gerry.Stahl@drexel.edu
Lead Organization(s): 
Partner Organization(s): 
Award Number: 
1118773
Funding Period: 
Thu, 09/01/2011 - Sat, 08/31/2013
Full Description: 

This full research and development project is to design, develop, and test a cutting-edge online collaborative learning environment where students and teachers solve mathematical problems and communicate their thinking with others. The major focus is to increase the quality and quantity of significant math discourse among mathematics teachers and their students by using this online collaborative learning environment. This online collaborative learning environment is based on PIs' prior work called Virtual Math Teams that integrates synchronous and asynchronous media with the first multi-user dynamic-math-visualization application. The researchers will test the usability of the online ollaborative learning environment for engaging students in high quality discourse. The researchers will also examine the impact of the online ollaborative learning environment on students' significant mathematical discourse and achievement.

The project uses a design research method as well as summative evaluations to achieve research and development goals. Discourse analysis and regression models will be used to examine the impact of the online collaborative learning environment on student significant mathematical discourse and achievement.

The findings of the project contribute to the field in three ways: (1) The online collanorative learning environment can be both an effective pedagogical tool and a research tool in mathematics education; (2) It will contribute to our understanding about the nature of mathematical discourse online as well as about ways to foster the quality and quantity of significant math discourse among teachers and their students; and (3) This project can provide insights into effective online deliveries of courses.

Computer-supported Math Discourse among Teachers and Students (Collaborative Research: Stahl)

Promoting Spatial Thinking with Web-based Geospatial Technologies

This project will develop STEM spatial thinking skills of middle school learners by equipping teachers with earth science investigations and support materials. This project will design, develop, and test curriculum materials that use Web Geospatial Information Systems that includes advanced visualization and geospatial analysis capabilities. The project will analyze how educative curriculum materials can prepare teachers to implement Web-based geospatial science pedagogical approaches to teaching, and document the impacts on student learning.

Lead Organization(s): 
Award Number: 
1118677
Funding Period: 
Fri, 07/01/2011 - Sun, 06/30/2013
Project Evaluator: 
Dr. Jean Russo
Promoting Spatial Thinking with Web-based Geospatial Technologies

Completing, Validating, and Linking Learning Trajectories for K-8 Rational Number Reasoning Tied to the Common Core Standards

This project will build and validate learning trajectories (LTs) in mathematics for fraction, ratio, and for decimal and percent to represent learning by grades 3-7 students. A system will be developed to automate data collection for field testing assessment items to determine students' attainment of proficiency levels. Three LTs will be produced and validated along with over 125 assessment items for each of these three trajectories. These assessment items will be useful for diagnosing student learning.

Lead Organization(s): 
Award Number: 
1118858
Funding Period: 
Mon, 08/01/2011 - Fri, 07/31/2015
Full Description: 

This project will build and validate learning trajectories (LTs) in mathematics for fraction, ratio, and for decimal and percent to represent learning by grades 3-7 students. A system will be developed to automate data collection for field testing assessment items to determine students' attainment of proficiency levels. Three LTs will be produced and validated along with over 125 assessment items for each of these three trajectories. These assessment items will be useful for diagnosing student learning. Technologies such as mobile phones, tablets, and computers will be used to deliver, analyze, and report diagnostic data on students. The learning trajectories will be available both electronically and in print. The levels of proficiencies will be provided with the outcome spaces, the exemplary items, the student work, and videos of student responses. Publications will provide data on analysis of the diagnostic items and assessments. The project will be done by researchers at the North Carolina State University in collaboration with RoleModel Software Inc.,and the University of Maryland.

The learning trajectories will be developed through literature reviews, whole class teaching experiments, clinical interviews, and large-scale assessments. Students in grade 3 will be observed and interviewed while engaging in work on fractions, ratios, decimal, and precents. Some of these students will be observed longitudinally over the two years. Other students from grades 4 through 8 will be interviewed. For each of the three trajectories, about 150 assessment items will be developed and field tested with a large group.

Three learning trajectories will be developed and made available electronically with supporting materials. The learning trajectories will be done in coordination with the Common Core State Standards (CCSS) in mathematics. Because the learning trajectories and materials will be informative to teachers who will be implementing the CCSS, the work has the potential to appeal to and reach a very large audience. Publications will provide data on analysis of the diagnostic items and assessments. The researchers will seek ways for a greater audience to have access to the software for accessing and retrieving items.

Completing, Validating, and Linking Learning Trajectories for K-8 Rational Number Reasoning Tied to the Common Core Standards

Multiple Instrumental Case Studies of Inclusive STEM-focused High Schools: Opportunity Structures for Preparation and Inspiration (OSPrl).

The aim of this project is to examine opportunity structures provided to students by inclusive STEM-focused high schools, with an emphasis on studying schools that serve students from underrepresented groups. The project is studying inclusive STEM-focused high schools across the United States to determine what defines them. The research team initially identified ten candidate critical components that define STEM-focused high schools and is refining and further clarifying the critical components through the research study.

Lead Organization(s): 
Award Number: 
1118851
Funding Period: 
Thu, 09/01/2011 - Mon, 08/31/2015
Full Description: 

The aim of this project is to examine opportunity structures provided to students by inclusive STEM-focused high schools, with an emphasis on studying schools that serve students from underrepresented groups. In contrast to highly selective STEM-focused schools that target students who are already identified as gifted and talented in STEM, inclusive STEM-focused high schools aim to develop new sources of STEM talent, particularly among underrepresented minority students, to improve workforce development and prepare STEM professionals. A new NRC report, Successful K-12 STEM Education (2011), identifies areas in which research on STEM-focused schools is most needed. The NRC report points out the importance of providing opportunities for groups that are underrepresented in the sciences, especially Blacks, Hispanics, and low-income students who disproportionately fall out of the high-achieving group in K-12 education. This project responds specifically to the call for research in the NRC report and provides systematic data to define and clarify the nature of such schools.

The project is studying inclusive STEM-focused high schools across the United States to determine what defines them. The research team initially identified ten candidate critical components that define STEM-focused high schools and is refining and further clarifying the critical components through the research study. The first phase of the study is focusing on 12 well-established and carefully planned schools with good reputations and strong community and business support, in order to capture the critical components as intended and implemented. Case studies of these high-functioning schools and a cross-case analysis using a set of instruments for gauging STEM design and implementation are contributing toward building a theory of action for such schools that can be applied more generally to STEM education. The second phase of the study involves selecting four school models for further study, focusing on student-level experiences and comparing student outcomes against comprehensive schools in the same district. Research questions being studied include: 1) Is there a core set of likely critical components shared by well-established, promising inclusive STEM-focused high schools? Do other components emerge from the study? 2) How are the critical components implemented in each school? 3) What are the contextual affordances and constraints that influence schools' designs, their implementation, and student outcomes? 4) How do student STEM outcomes in these schools compare with school district and state averages? 5) How do four promising such schools compare with matched comprehensive high schools within their respective school districts, and how are the critical components displayed? 6) From the points of view of students underrepresented in STEM fields, how do education experiences at the schools and their matched counterparts compare? And 7) How do student outcomes compare?

The research uses a multiple instrumental case study design in order to describe and compare similar phenomena. Schools as critical cases are being selected through a nomination process by experts, followed by screening and categorization according to key design dimensions. Data sources include school documents and public database information; a survey, followed by telephone interviews that probe for elaborated information, to provide a systematic overview of the candidate components; on-site visitations to each school provide data on classroom observations at the schools; interviews with students, teachers and administrators in focus groups; and discussions with critical members of the school community that provide unique opportunities to learn such as mentors, business leaders, and members of higher education community that provide outside of school learning experiences. The project is also gathering data on a variety of school-level student outcome indicators, and is tracking the likely STEM course trajectories for students, graduation rates, and college admission rates for students in the inclusive STEM-focused schools, as compared to other schools in the same jurisdiction. Analysis of the first phase of the study aims to develop rich descriptions that showcase characteristics of the schools, using axial and open coding, to determine a theory of action that illustrates interconnections among context, design, implementation, and outcome elements. Analysis of the second phase of the study involves similar processes on four levels: school, student, databases, and a synthesis of the three. Evaluation of the project consists of an internal advisory board and an external advisory board, both of which provide primarily formative feedback on research procedures.

Research findings, as well as case studies, records of instrument and rubric development and use, annual reports, and conference proposals and papers are being provided on a website, in order to provide an immediate and ongoing resource for education leaders, researchers and policymakers to learn about research on these schools and particular models. An effort is also being made to give voice to the experiences of high school students from the four pairs of high schools studied in the second phase of the study. Findings are also being disseminated by more traditional means, such as papers in peer-reviewed journals and conference presentations.

Multiple Instrumental Case Studies of Inclusive STEM-focused High Schools: Opportunity Structures for Preparation and Inspiration (OSPrl).
Syndicate content