This exploratory research and development project engages high-school students as student-tutors who create screen-capture videos that demonstrate step-by-step solutions to mathematical problems and explicate the use of interactive applets. The project has three development goals (a model for creating the media, a model for collaboration with teachers, and enhancements to a Lesson Study model) and three research goals (to test conjectures about student change, to analyze reconfigured roles for teachers and students, and to advance a theory of personalized learning communities.) The project tests whether the mathematical and communication skills of student-tutors improve in the process of making the video materials. It also tests whether teachers and the student users of the videos benefit from them. Further, the project will examine whether the process of creating and disseminating the videos is replicable and scalable.

The project uses design research methods as well as both formative and summative evaluations to achieve the research and development goals. The investigators pose a series of thoughtful research questions and plan to use a variety of research methods to collect and analyze data to answer them.

The project is potentially transformative. The advances in technology present opportunities and challenges for improving student learning. Built on strong theoretical and empirical foundations and prior work, the project takes full advantages of the opportunities of tutoring using 21st-century technologies - marrying screen-capture video with a model of student-delivered tutoring. The project will contribute to an understanding of how teachers and student-tutors change and exercise creativity through participating in digital media production. The findings of the project will have broader impact in at least three dimensions: (1) The videos created by students will be helpful for other students' learning; (2) The research on engaging students in creating videos can not only help us understand the effective use of technology, but also help us understand the mechanism for developing students' generative thinking and creativity; and (3) This project can provide insights about how to integrate 21st-Century technology into regular classrooms.

This project scales and further tests the Target Inquiry (TI) professional development model. The TI model involves teachers in three core experiences: 1) a research experience for teachers, 2) materials adaptation, and 3) an action research project. The original program was implemented with high school chemistry teachers at Grand Valley State University (GVSU), and was shown to result in significant increases, with large effect sizes, in teachers' understanding of science inquiry and quality of instruction, and in science achievement of those teachers' students. The scale-up and further testing would involve adding physics, biology and geology at Grand Valley State University, and implementing the program at Miami University (MU) with chemistry teachers. Three research questions will be studied:

1) How do the three TI core experiences influence in-service high school science teachers' (i) understanding of the nature of science; (ii) attitudes and beliefs about inquiry instruction; and (iii) classroom instructional methods in the derivatives of the TI model?

2) How does teacher participation in TI affect students' process skills (scientific reasoning and metacognition) and conceptual understanding of science in the derivatives of the TI model?

3) What are the challenges and solutions related to implementing TI in science disciplines beyond chemistry and in other regions?

The research design is quasi-experimental and longitudinal, incorporating implementation with research, and using quantitative and qualitative methods blended in a design research framework. A total of 54 middle and high school science teachers are being recruited for the study. The TI group is completing the TI program (N = 27; 15 at GVSU; 12 at MU) while the comparison group (same sizes and locations) is not. The comparison group is matched according to individual characteristics and school demographics. All teachers are being studied, along with their students, for 4 years (pre-program, post-RET, post-MA, post-AR/post-program). TI teachers are taking 15 credits of graduate level science courses over three years, including summers. Courses include a graduate seminar focused on preparing for the research experience, the research experience in a faculty member's science lab during the summer, application of research to teaching, action research project development, adaptation and evaluation of inquiry-focused curricula, and interpretation and analysis of classroom data from action research. Consistent feedback from professional development, teachers, and evaluation, including the previous implementation, contributes to a design-based approach. Teacher factors being studied include nature of science, inquiry teaching knowledge and beliefs, and quality of inquiry instruction. Student factors being studied include scientific reasoning; metacognition, self-efficacy, and learning processes in science; and content knowledge and conceptual understanding. Only established quantitative and qualitative instruments are being used. Quantitative analysis includes between-group comparisons by year on post-tests, with pre-tests as covariates, and multi-level models with students nested with teachers, and teachers within sites, with the teacher level as the primary unit of change. Trends over time between the treatment and comparison groups are being examined. The evaluation is using a combination of pre/post causal comparative quantitative measures and relevant qualitative data from project leaders and participants, as well as from the comparison group, to provide formative and summative evaluation input.

Outcomes of the project include documentation and understanding of the impacts on science teachers' instruction and student outcomes of research experiences for teachers when they are supported by materials adaptation and action research, and an understanding of what it takes to scale the model to different science disciplines and a different site. The project is also producing a website of instructional materials for middle and secondary science.

The goal of this project is to develop two tests (instruments) to assess conceptual understanding of statistics.

The instruments are based on the levels A/B and on level C of statistical understanding development as described in the American Statistical Association Guidelines for Assessment and Instruction of Statistics Education (GAISE) framework. These instruments will be used to assess knowledge of statistics by grades 6-12 students. The instruments will have multiple-choice and constructed response (CR) items. The CR items will have scoring rubrics. The assessments will be pilot tested in school districts in six states. The instruments will be used by teachers to analyze students' growth in understanding of statistics and will be useable for both formative and summative purposes. An assessment blueprint will be developed based on the GAISE framework for selecting and constructing both fixed-choice and open-ended items. An evidenced-based designed process will be used to develop the assessments. The blueprint will be used by the test development committee to develop items. These items will be reviewed by the advisory board considering the main statistics topics to be included on the assessments. Through a layering process, the assessments will be piloted, revised, and field tested with students in grades 6-12 in six states. A three-parameter IRT model will be used in analyzing the items. The work will be done by researchers at the University of Florida with the support of those at the University of Minnesota, the Educational Testing Service, and Kenyon College. Researchers from TERC will conduct a process evaluation with several feedback and redesign cycles.

The assessments will be aligned with the Common Core State Standards for mathematics (CCSSM) and made available as open-source to teachers through a website. The research team will interact with the state consortia developing assessments to measure students? attainment of the CCSSM. As such, the assessments have the potential of being used by a large proportion of students in the country. The more conceptually-based items will provide teachers with concrete examples of what statistics students in grades 6-12 should know.

The Lynch School of Education and the Urban Ecology Institute at Boston College are partnering with the Center for Applied Special Technology (CAST) to develop, test, evaluate and disseminate a year-long set of urban ecology course materials for use in high school-level capstone science courses. The standards-based materials emphasize locally-relevant field studies and incorporate principles of Universal Design for Learning and Educative Curriculum. Other features include (1) an on-line resource center that links to professional development resources, (2) a student-written urban environment newspaper called "Green Times," and (3) a writing support toolkit. Evaluation and research studies focus on measuring effectiveness of the materials in promoting content understanding, self-efficacy in science and inquiry abilities of students in urban high schools, particularly those from underrepresented groups.

This workshop developed a new, comprehensive, research-based framework for assessing environmental literacy. By bringing together, for the first time, experts in research, assessment, and evaluation from the fields of science education, environmental education, and related social science fields, this project accessed and built its work on the literature and the insights of many disciplines. The North American Association for Environmental Education (NAAEE) worked with the leaders of the only two large-scale assessments of environmental literacy used in the U.S. to date (Programme for International Student Assessment [PISA] and the National Environmental Literacy Assessment [NELA]) to conduct the workshop. The project leaders analyzed PISA and NELA and used a multi-disciplinary search and review of the literature to prepare a draft framework. At the workshop and thereafter, a diverse array of invited experts critiqued that draft and provided suggestions for revision. Then, the leaders/organizers produced a final Environmental Literacy Framework and disseminated it both electronically and at a nationally advertised event to a wide audience of assessment specialists, funding and policy-making agencies, and organizations working to develop assessments and achieve environmental literacy. Many institutions and agencies have noted the need to create an environmentally literate population, and government and private entities are investing hundreds of millions of dollars in projects aimed at enhancing environmental literacy. Given the scope and scale of these investments and the interest in this arena on the part of federal agencies, professional organizations, and corporations, assessments for gauging our progress in transforming our preK-12 education system to achieve that end are needed. The new Framework for assessing environmental literacy provides a foundation for measuring the extent to which we are enabling all learners to acquire the knowledge, skills, dispositions, and behaviors vital for competently making decisions about local, regional, national and global issues.

The University of California Museum of Paleontology (UCMP) will bring together an experienced group of evolution educators in order to inform the development and maintenance of an effective resource for improving evolution education at the college level. This effort falls under the umbrella of UCMP's highly successful Understanding Evolution (UE) project (http://evolution.berkeley.edu), which currently receives over one million page requests per month during the school year. UE was originally designed around the needs of the K-12 education community; however, increasingly, the site is being used by the undergraduate education community. UCMP intends to embark on an effort to enhance the utility of the UE site for that population, increase awareness of the site at the college level, and secure the project's future so that it can continue to serve K-16 teachers and students. To inform and guide these efforts, UCMP proposes to establish and convene a UE Advisory Board, which will be charged with helping to: (1) identify the characteristics and needs of college-level target learners and their instructors with respect to evolution, (2) articulate the recommended components for expanding the UE site to include an Undergraduate Lounge in which students and their instructors will be able to access a variety of resources for increasing understanding of evolution, (3) develop a strategic plan for increasing awareness of UE within the undergraduate education community, and (4) develop a strategic plan for maintenance and continued growth of the UE site.

This project--led by science educators at Michigan State University, the National Geographic Society, the Natural Resource Ecology Laboratory (NREL) at Colorado State University, the Berkeley Evaluation and Assessment Research (BEAR) Center, and AAAS Project 2061, and including schools in California, Colorado, Maryland, Michigan, and Washington--builds on prior efforts with learning progressions, and is focused on key carbon-transforming processes in socio-ecological systems at multiple scales, including cellular and organismal metabolism, ecosystem energetics and carbon cycling, carbon sequestration, and combustion of fossil fuels.

The project uses an iterative design research process to develop and refine a suite of tools for reasoning and test efficacy of those tools in geographically and culturally diverse schools. The project team is:

1. Refining and validating a detailed learning progression framework covering the middle and high school years; ultimately, the framework will describe the development of students' capacity to use fundamental principles such as conservation of matter and energy to reason about carbon-transforming processes at multiple scales.

2. Refining 'Tools for Reasoning' that make hidden scientific principles - matter, energy, and scale - visible to students; the power of these tools lies in their flexible use for different processes, systems, scales, and curricular contexts.

3. Developing and refining flexible teaching strategies that engage students in cognitive apprenticeship in the practices of environmental science literacy: a) inquiry and argumentation, b) explanations and predictions, and c) decision-making about environmental issues.

4. Using and refining existing summative assessments, and developing and testing formative assessment tools; these assessment tools will provide teachers and researchers with immediate information about their students' intellectual resources and will be linked to the learning progression framework.

5. Developing, field testing, and assessing the effectiveness of six middle school and six high school units that use project tools and enact project principles; the units introduce students to fundamental principles, engage them in reasoning about carbon-transforming processes at organismal scale, and at landscape and global scales. Each unit includes a) an online formative assessment and b) activity sequences that use tools for reasoning and teaching strategies.

6. Developing, field testing, and assessing professional development materials in both face-to-face and facilitated online forms; the materials introduce teachers to learning progressions in environmental science literacy, assessment tools, tools for reasoning, teaching strategies, and teaching materials and activities, and also address difficulties that teachers encounter in using learning progressions and enacting teaching strategies.

The primary project outcomes will be coordinated instructional tools that are useful to professionals at all levels in the science education system--classroom teachers, professional developers, and developers of curricula, standards and assessments.

Research on student learning has developed separate progressions for scientific argumentation, explanation and scientific modeling. Engaging Learners in Scientific Practices develops a learning progression that characterizes how learners integrate and interrelate scientific argumentation, explanation and scientific modeling, building ever more sophisticated versions of practice over time using the three common elements of sense-making, persuading peers and developing consensus. The learning progression is constructed through improvements in students' performance and understanding of scientific practice as measured by their attention to generality of explanation, attention to clarity of communication and audience understanding, attention to evidentiary support, and attention to mechanistic versus descriptive accounts. The project is led by researchers at Northwestern University, the University of Texas, Wright State University, Michigan State University, and the BEAR assessment group. Two cohorts of 180 students each are followed for two years from 4th to 5th grade in Illinois and two cohorts of 180 students each are followed for two years from 5th to 6th grade in Michigan The elementary school students will work with FOSS curriculum units modified to embed supports for scientific practices. Two cohorts of 500 middle school students are followed for three years from 6th to 8th grade as they work with coordinated IQWST units over three years. The outcome measures include analyses of classroom discourse, pre- and pos-test assessments of student learning, and reflective interviews grounded in students' own experiences with practices in the classroom to assess their growth across the dimensions. The BEAR team is responsible for validation and calibration of the frameworks and instruments, and design of the scheme for analysis of the data. Horizon Research performs the formative and summative evaluation. The project will produce an empirically-tested learning progression for scientific practices for grades 4-8 along with tested curriculum materials and validated assessment items that support and measure students' ability in the scientific practices of explanation, argumentation and modeling. In the process of development, an understanding is gained about how to design and test this learning progression. The framework is articulated on a website for use by other researchers and developers. The project also builds capacity by educating several graduate students.

The Changing Curriculum, Changing Practice project, led by mathematics educators at the Education Development Center, is studying the impact of implementing a NSF-funded, high school mathematics curriculum that emphasizes mathematical habits of mind. This curriculum focuses on ways of thinking and doing mathematics in contrast with curricula that focus on mathematical topics. The project is studying the development of teachers' mathematical knowledge for teaching and their capacity to align their instruction with the new curriculum. The project includes a moderate level of professional development and the development of valid and reliable instruments to assess teachers' mathematical knowledge for teaching and their instructional practices.

This four-year, mixed-methods study is investigating the conjecture that high school teachers' implementation of a curriculum emphasizing mathematical habits of mind will lead to measurable changes in teachers' mathematical knowledge and their instruction. The investigators are also interested in the relationships among (1) teachers' prior knowledge, (2) their use of the curriculum and (3) the school-level support for implementation. The investigators are studying the implementation of the curriculum by 70 teachers in 12 schools that vary in socio-economic status of the students and geographic location. The research design includes observations of the instruction of a sub-sample of nine teachers to obtain a finer-grained measure of instructional practice. They are developing or adapting existing instruments that measure teachers' knowledge and alignment of instruction with the goals of teaching mathematical habits of mind. Using the Instructional Quality Assessment rubric during visits to the classroom, they are assessing students' opportunities to develop mathematical thinking skills. The use of mixed-methods approaches will allow the researchers to analyze the data from multiple perspectives.

This study is part of a long-term effort to help high school students develop specific mathematical habits of mind. The current study is building on previous curriculum development and also developing insights for future studies investigating students' adoption of mathematical habits of mind. The current project is an important effort to understand the roles teachers play in implementing curricular changes that have the potential for improving student achievement in mathematics. Teachers are the critical bridging agents who connect curriculum and learners. This study will help to explain how teachers' knowledge, teachers' instruction, and teachers' contexts within schools contribute to or detract from the faithful implementation of the goals intended by a curriculum. It will lay a foundation for understanding future efforts to assess what students learn and how they learn it.