Assessment

A Design-Based Process in Characterizing Experienced Teachers’ Formative Assessment Enactment in Science Classrooms

Formative assessment can facilitate teachers’ abilities to elicit and notice the disciplinary substance of students’ thinking and to respond based on this. Following a design-based process, we developed principled practical knowledge to create resources that might guide experienced teachers in examining their formative assessment practice and provide researchers with tools to study formative assessment enactment.

Author/Presenter

Hannah Sevian

Vesal Dini

Year
2019
Short Description

Formative assessment can facilitate teachers’ abilities to elicit and notice the disciplinary substance of students’ thinking and to respond based on this. Following a design-based process, we developed principled practical knowledge to create resources that might guide experienced teachers in examining their formative assessment practice and provide researchers with tools to study formative assessment enactment.

Conceptual Profile of Substance: Representing Heterogeneity of Thinking in Chemistry Classrooms

Teachers face challenges when building the concept of substance with students because tensions of meanings emerge from students’ daily life and canonical ideas developed in classrooms. A powerful tool to address learning, pedagogical, and research challenges is the conceptual profile theory. According to this theory, people employ various ways of conceptualizing the world to signify experiences. Conceptual profiles are models of the heterogeneity of modes of thinking and speaking about a given scientific concept which are used in a variety of contexts.

Author/Presenter

Hannah Sevian

Eduardo F. Mortimer 

Year
2020
Short Description

Teachers face challenges when building the concept of substance with students because tensions of meanings emerge from students’ daily life and canonical ideas developed in classrooms. A powerful tool to address learning, pedagogical, and research challenges is the conceptual profile theory. According to this theory, people employ various ways of conceptualizing the world to signify experiences. Conceptual profiles are models of the heterogeneity of modes of thinking and speaking about a given scientific concept which are used in a variety of contexts. To better understand the heterogeneity of thinking/speaking about substance, the present study aimed to answer: (1) What are the zones that constitute the conceptual profile of substance?; and (2) What ways of thinking and speaking about substance do teachers and students exhibit when engaged in a classroom formative assessment activity?

Investigating How Teachers' Formative Assessment Practices Change Across a Year

Teaching chemistry as a practice rather than as a mere collection of facts demands that teachers modify their practices, particularly their approach to formative assessment (FA). In this study, we investigated how teachers’ FA practices changed as a result of their participation in a professional development program designed with a Chemical Thinking perspective. Four FA portfolio chapters were collected from 19 secondary school teachers over the course of a year.

Author/Presenter

Timothy N. Abell

Hannah Sevian

Year
2021
Short Description

Teaching chemistry as a practice rather than as a mere collection of facts demands that teachers modify their practices, particularly their approach to formative assessment (FA). In this study, we investigated how teachers’ FA practices changed as a result of their participation in a professional development program designed with a Chemical Thinking perspective.

Analyzing Chemistry Teachers’ Formative Assessment Practices Using Formative Assessment Portfolio Chapters

Author/Presenter

Timothy N. Abell

Hannah Sevian

Year
2020
Short Description

The effective use of formative assessment (FA) has been demonstrated to confer positive impacts on student learning. To understand why and how FA works, it is necessary to characterize teachers’ FA practices, but because both teaching practice and learning depend on the nature of the discipline, there are disciplinary aspects to examining this. This study aimed to develop an analysis of chemistry teachers’ FA practices through the lens of the chemical thinking framework.

Teachers’ Noticing, Interpreting, and Acting on Students’ Chemical Ideas in Written Work

Formative assessment is an important component of teaching as it enables teachers to foster student learning by uncovering, interpreting, and advancing student thinking. In this work, we sought to characterize how experienced chemistry teachers notice and interpret student thinking shown in written work, and how they respond to what they learn about it. Drawing on qualitative methods from different educational fields, we analyzed data collected during focus groups of middle and high school teachers.

Author/Presenter

Stephanie A. Murray

Robert Huie

Rebecca Lewis

Scott Balicki

Michael Clinchot

Gregory Banks

Vicente Talanquer

Hannah Sevian

Year
2020
Short Description

Formative assessment is an important component of teaching as it enables teachers to foster student learning by uncovering, interpreting, and advancing student thinking. In this work, we sought to characterize how experienced chemistry teachers notice and interpret student thinking shown in written work, and how they respond to what they learn about it.

Co-Designing for Privacy, Transparency, and Trust in K-12 Learning Analytics

The process of using Learning Analytics (LA) to improve teaching works from the assumption that data should be readily shared between stakeholders in an educational organization. However, the design of LA tools often does not account for considerations such as data privacy, transparency and trust among stakeholders. Research in human-centered design of LA does attend to these questions, specifically with a focus on including direct input from K-12 educators.

Author/Presenter

June Ahn

Fabio Campos

Ha Nguyen

Maria Hays

Jan Morrison

Year
2021
Short Description

The process of using Learning Analytics (LA) to improve teaching works from the assumption that data should be readily shared between stakeholders in an educational organization. However, the design of LA tools often does not account for considerations such as data privacy, transparency and trust among stakeholders. Research in human-centered design of LA does attend to these questions, specifically with a focus on including direct input from K-12 educators. In this paper, we present a series of design studies to articulate and refine conjectures about how privacy and transparency might influence better trust-building and data sharing within four school districts in the United States.

When Should I Use a Measure to Support InstructionalImprovement at Scale? The Importance of Considering BothIntended and Actual Use in Validity Arguments

Despite the ease of accessing a wide range of measures, little attention is given to validity arguments when considering whether to use the measure for a new purpose or in a different context. Making a validity argument has historically focused on the intended interpretation and use.

Author/Presenter

Marsha Ing

Starlie Chinen

Kara Jackson

Thomas M. Smith

Year
2021
Short Description

Despite the ease of accessing a wide range of measures, little attention is given to validity arguments when considering whether to use the measure for a new purpose or in a different context. Making a validity argument has historically focused on the intended interpretation and use. There has been a press to consider both the intended and actual interpretations and how users make sense of the data when constructing validity arguments, but the practice is not widespread.This paper contributes to existing research on validity by highlighting the value of attending to the actual interpretation and use of a measure aimed at supporting instructional improvement in mathematics.

Training a New Generation of Problem Solvers: How Can Education Programs Develop the Problem-Solving Skills of Today's Schoolchildren and Tomorrow's STEM Workforce?

Songer, N.B. (2022 April) Training a new generation of problem solvers: How can education programs develop the problem-solving skills of today's schoolchildren and tomorrow's STEM workforce? Open Access Government.

Author/Presenter

Nancy Butler Songer

Lead Organization(s)
Year
2022
Short Description

This article addresses the need and potential for students to develop problem-solving skills as part of STEM learning.

Examining the Responding Component of Teacher Noticing: A Case of One Teacher’s Pedagogical Responses to Students’ Thinking in Classroom Artifacts

In this study, we investigated how an experienced fourth-grade teacher responded to her students’ thinking as part of her teacher noticing practice in a formative assessment context. Our primary purpose in doing this work was to decompose the responding component of teacher noticing and use our findings to present an emerging framework characterizing the multidimensional nature of this practice. We present two key outcomes based on the findings of this work. First, we show how a formative assessment context situated outside of instruction can engage teachers in practice-based noticing.

Author/Presenter

Melissa Luna

Sarah Selmer

Lead Organization(s)
Year
2021
Short Description

In this study, we investigated how an experienced fourth-grade teacher responded to her students’ thinking as part of her teacher noticing practice in a formative assessment context. Our primary purpose in doing this work was to decompose the responding component of teacher noticing and use our findings to present an emerging framework characterizing the multidimensional nature of this practice.

Fourth-Grade Students' Sensemaking during Multi-step Problem Solving

The purpose of this study was to investigate fourth-grade students’ sensemaking of a word problem. Sensemaking occurs when students connect their understanding of situations with existing knowledge. We investigated students’ sensemaking through inductive task analysis of their strategies and solutions to a problem that involved determining the difference between two quantities and number of groups within the task. This analysis provided useful themes about students’ strategy use across the sensemaking domains.

Author/Presenter

Gabriel Matney

Jonathan D.Bostic

Miranda Fox

Tiara Hicks

Toni May

Greg Stone

Year
2022
Short Description

The purpose of this study was to investigate fourth-grade students’ sensemaking of a word problem. Sensemaking occurs when students connect their understanding of situations with existing knowledge. We investigated students’ sensemaking through inductive task analysis of their strategies and solutions to a problem that involved determining the difference between two quantities and number of groups within the task.