Assessment

Investigating the Presence of Mathematics and the Levels of Cognitively Demanding Mathematical Tasks in Integrated STEM Units

Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been conducted within the context of science classrooms, ignoring mathematics. Also missing from the literature is research that examines the level of cognitive demand required from mathematical tasks present within integrated STEM lessons.

Author/Presenter

Elizabeth N. Forde

Latanya Robinson

Joshua A. Ellis

Emily A. Dare

Year
2023
Short Description

Effective K-12 integrated STEM education should reflect an intentional effort to adequately represent and facilitate each of its component disciplines in a meaningful way. However, most research in this space has been conducted within the context of science classrooms, ignoring mathematics. Also missing from the literature is research that examines the level of cognitive demand required from mathematical tasks present within integrated STEM lessons. In order to seek insight pertaining to this gap in the literature, we sought to better understand how science teachers use mathematics within K-12 integrated STEM instruction.

Design Considerations for a Middle School Computer Science Pedagogical Content Knowledge Instrument

K- 12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK) . We respond to this need by describing the design of a CS-PCK instrument for ‘Algorithms and Programming’ that measures three broad constructs: (a) teachers’ understanding of standards and standards-alignment, (b) teachers’ formative assessment practices, and (c) teachers’ self-efficacy for teaching and assessing CS.

Author/Presenter

Satabdi Basu

Daisy Rutstein

Carol Tate

Arif Rachmatullah

Hui Yang

Lead Organization(s)
Year
2022
Short Description

K- 12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK). We respond to this need by describing the design of a CS-PCK instrument for ‘Algorithms and Programming’ that measures three broad constructs: (a) teachers’ understanding of standards and standards-alignment, (b) teachers’ formative assessment practices, and (c) teachers’ self-efficacy for teaching and assessing CS.

Standards-Aligned Instructional Supports to Promote Computer Science Teachers' Pedagogical Content Knowledge

The rapid expansion of K-12 CS education has made it critical to support CS teachers, many of whom are new to teaching CS, with the necessary resources and training to strengthen their understanding of CS concepts and how to effectively teach CS. CS teachers are often tasked with teaching different curricula using different programming languages in different grades or during different school years, and tend to receive different professional development (PD) for each curriculum they are required to teach.

Author/Presenter
Satabdi Basu

Daisy Rutstein

Carol Tate

Arif Rachmatullah

Hui Yang

Lead Organization(s)
Year
2022
Short Description

This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS standards and ability to adapt instruction based on student understanding of concepts underlying the CS standards.

Unpacking Response Process Issues Encountered When Developing a Mathematics Teachers’ Pedagogical Content Knowledge (PCK) Assessment

It is essential for items in assessments of mathematics’ teacher knowledge to evoke the desired response processes – to be interpreted and responded to by teachers as intended by item developers. In this study, we sought to unpack evidence that middle school mathematics teachers were not consistently interacting as intended with constructed response (i.e. open-ended) items designed to assess their pedagogical content knowledge (PCK).

Author/Presenter

Martha L. Epstein

Hamza Malik

Kun Wang

Chandra H. Orrill

Year
2023
Short Description

It is essential for items in assessments of mathematics’ teacher knowledge to evoke the desired response processes – to be interpreted and responded to by teachers as intended by item developers. In this study, we sought to unpack evidence that middle school mathematics teachers were not consistently interacting as intended with constructed response (i.e. open-ended) items designed to assess their pedagogical content knowledge (PCK).

Finding the Right Grain-Size for Measurement in the Classroom

This article introduces a new framework for articulating how educational assessments can be related to teacher uses in the classroom. It articulates three levels of assessment: macro (use of standardized tests), meso (externally developed items), and micro (on-the-fly in the classroom). The first level is the usual context for educational measurement, but one of the contributions of this article is that it mainly focuses on the latter two levels.

Author/Presenter

Mark Wilson

Year
2023
Short Description

This article introduces a new framework for articulating how educational assessments can be related to teacher uses in the classroom. It articulates three levels of assessment: macro (use of standardized tests), meso (externally developed items), and micro (on-the-fly in the classroom).

Examining How Using Dichotomous and Partial Credit Scoring Models Influence Sixth-Grade Mathematical Problem-Solving Assessment Outcomes

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Author/Presenter

Toni A. May

Kristin L. K. Koskey

Jonathan D. Bostic

Gregory E. Stone

Lance M. Kruse

Gabriel Matney

Year
2023
Short Description

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Examining How Using Dichotomous and Partial Credit Scoring Models Influence Sixth-Grade Mathematical Problem-Solving Assessment Outcomes

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Author/Presenter

Toni A. May

Kristin L. K. Koskey

Jonathan D. Bostic

Gregory E. Stone

Lance M. Kruse

Gabriel Matney

Year
2023
Short Description

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Examining How Using Dichotomous and Partial Credit Scoring Models Influence Sixth-Grade Mathematical Problem-Solving Assessment Outcomes

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Author/Presenter

Toni A. May

Kristin L. K. Koskey

Jonathan D. Bostic

Gregory E. Stone

Lance M. Kruse

Gabriel Matney

Year
2023
Short Description

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Examining How Using Dichotomous and Partial Credit Scoring Models Influence Sixth-Grade Mathematical Problem-Solving Assessment Outcomes

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Author/Presenter

Toni A. May

Kristin L. K. Koskey

Jonathan D. Bostic

Gregory E. Stone

Lance M. Kruse

Gabriel Matney

Year
2023
Short Description

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed response items. The present study compared the impact of both scoring methods on the internal structure and consequential validity of a middle-grades problem-solving assessment called the problem solving measure for grade six (PSM6).

Validating the Use of Student-Level Instruments to Examine Preservice Teachers' Mathematical Problem Solving

Problem solving is a central focus of mathematics teaching and learning. If teachers are expected to support students' problem-solving development, then it reasons that teachers should also be able to solve problems aligned to grade level content standards. The purpose of this validation study is twofold: (1) to present evidence supporting the use of the Problem Solving Measures Grades 3–5 with preservice teachers (PSTs), and (2) to examine PSTs' abilities to solve problems aligned to grades 3–5 academic content standards.

Author/Presenter

Timothy D. Folger

Maria Stewart

Jonathan Bostic

Toni A. May

Year
2022
Short Description

Problem solving is a central focus of mathematics teaching and learning. If teachers are expected to support students' problem-solving development, then it reasons that teachers should also be able to solve problems aligned to grade level content standards. The purpose of this validation study is twofold: (1) to present evidence supporting the use of the Problem Solving Measures Grades 3–5 with preservice teachers (PSTs), and (2) to examine PSTs' abilities to solve problems aligned to grades 3–5 academic content standards.