Assessment

Think Alouds: Informing Scholarship and Broadening Partnerships through Assessment

Think alouds are valuable tools for academicians, test developers, and practitioners as they provide a unique window into a respondent’s thinking during an assessment. The purpose of this special issue is to highlight novel ways to use think alouds as a means to gather evidence about respondents’ thinking. An intended outcome from this special issue is that readers may better understand think alouds and feel better equipped to use them in practical and research settings.

Author/Presenter

Jonathan David Bostic

Lead Organization(s)
Year
2021
Short Description

Introduction to special issue focusing on think alouds and response process evidence. This work cuts across STEM education scholarship and introduces readers to robust means to engage in think alouds.

Gathering Response Process Data for a Problem-Solving Measure through Whole-Class Think Alouds

Response process validity evidence provides a window into a respondent’s cognitive processing. The purpose of this study is to describe a new data collection tool called a whole-class think aloud (WCTA). This work is performed as part of test development for a series of problem-solving measures to be used in elementary and middle grades. Data from third-grade students were collected in a 1–1 think-aloud setting and compared to data from similar students as part of WCTAs. Findings indicated that students performed similarly on the items when the two think-aloud settings were compared.

Author/Presenter

Jonathan David Bostic

Toni A. Sondergeld

Gabriel Matney

Gregory Stone

Tiara Hicks

Lead Organization(s)
Year
2021
Short Description

This is a description of a new methodological tool to gather response process validity evidence. The context is scholarship within mathematics education contexts.

Gathering Response Process Data for a Problem-Solving Measure through Whole-Class Think Alouds

Response process validity evidence provides a window into a respondent’s cognitive processing. The purpose of this study is to describe a new data collection tool called a whole-class think aloud (WCTA). This work is performed as part of test development for a series of problem-solving measures to be used in elementary and middle grades. Data from third-grade students were collected in a 1–1 think-aloud setting and compared to data from similar students as part of WCTAs. Findings indicated that students performed similarly on the items when the two think-aloud settings were compared.

Author/Presenter

Jonathan David Bostic

Toni A. Sondergeld

Gabriel Matney

Gregory Stone

Tiara Hicks

Lead Organization(s)
Year
2021
Short Description

This is a description of a new methodological tool to gather response process validity evidence. The context is scholarship within mathematics education contexts.

On the Alignment of Teachers’ Mathematical Content Knowledge Assessments with the Common Core State Standards

Instruments designed to measure teachers’ knowledge for teaching mathematics have been widely used to evaluate the impact of professional development and to investigate the role of teachers’ knowledge in teaching and student learning. These instruments assess a mixture of content knowledge and pedagogical content knowledge. However, little attention has been given to the content alignment between such instruments and curricular standards, particularly in regard to how content knowledge and pedagogical content knowledge items are distributed across mathematical topics.

Author/Presenter

Yasemin Copur-Gencturk

Erik Jacobson

Richard Rasiej

Year
2021
Short Description

This article provides content maps for two widely used teacher assessment instruments in the USA relative to the widely adopted Common Core State Standards. This common reference enables comparisons of content alignment both between the instruments and between parallel forms within each instrument.

The Role of Instructional Materials in the Relationship Between the Official Curriculum and the Enacted Curriculum

Author/Presenter

Jeffrey Choppin

Amy Roth McDuffie

Corey Drake

Jon Davis

Lead Organization(s)
Year
2020
Short Description

The authors studied how the distal policy mechanisms of curricular aims and objectives articulated in official curriculum documents influenced classroom instruction, and the factors that were associated with the enactment of those curricular aims and objectives.

Development and Validation of a High School STEM Self‐Assessment Inventory

The development of inclusive STEM high schools that have no academic admission requirements has been a national goal in the United States. However, there is no umbrella organization that gives guidance for structuring such schools. The purpose of this study was to develop and validate a self‐assessment using critical components of successful inclusive STEM high schools for school personnel and educational researchers who wish to better understand their STEM programs and identify areas of strength. A multi‐phase methodology was employed.

Author/Presenter

Erin Peters Burton

Tara S. Behrend

Shari Matray

Clarissa Hudson

Michael Ford

Lead Organization(s)
Year
2020
Short Description

The purpose of this study was to develop and validate a self‐assessment using critical components of successful inclusive STEM high schools for school personnel and educational researchers who wish to better understand their STEM programs and identify areas of strength.

Developing a Problem-Solving Measure for Grade 4

Problem solving is central to mathematics learning (NCTM, 2014). Assessments are needed that appropriately measure students’ problem-solving performance. More importantly, assessments must be grounded in robust validity evidence that justifies their interpretations and outcomes (AERAet al., 2014). Thus, measures that are grounded in validity evidence are warranted for use by practitioners and scholars. The purpose of this presentation is to convey validity evidence for a new measure titled Problem-Solving Measure for grade four (PSM4).

Author/Presenter

Jonathan Bostic

Gabriel Matney

Toni A. Sondergeld

Gregory E. Stone

Year
2019
Short Description

The purpose of this presentation is to convey validity evidence for a new measure titled Problem-Solving Measure for grade four (PSM4), an assessment within the previously published PSM series designed for elementary and middle grades students.

Developing a Problem-Solving Measure for Grade 4

Problem solving is central to mathematics learning (NCTM, 2014). Assessments are needed that appropriately measure students’ problem-solving performance. More importantly, assessments must be grounded in robust validity evidence that justifies their interpretations and outcomes (AERAet al., 2014). Thus, measures that are grounded in validity evidence are warranted for use by practitioners and scholars. The purpose of this presentation is to convey validity evidence for a new measure titled Problem-Solving Measure for grade four (PSM4).

Author/Presenter

Jonathan Bostic

Gabriel Matney

Toni A. Sondergeld

Gregory E. Stone

Year
2019
Short Description

The purpose of this presentation is to convey validity evidence for a new measure titled Problem-Solving Measure for grade four (PSM4), an assessment within the previously published PSM series designed for elementary and middle grades students.

Does Early Algebra Matter? The Effectiveness of an Early Algebra Intervention in Grades 3 to 5

A cluster randomized trial design was used to examine the effectiveness of a Grades 3 to 5 early algebra intervention with a diverse student population. Forty-six schools in three school districts participated. Students in treatment schools were taught the intervention by classroom teachers during regular mathematics instruction. Students in control schools received only regular mathematics instruction.

Author/Presenter

Maria Blanton

Rena Stroud

Ana Stephens

Angela Murphy Gardiner

Despina A. Stylianou

Eric Knuth

Isil Isler-Baykal

Susanne Strachota

Lead Organization(s)
Year
2019
Short Description

A cluster randomized trial design was used to examine the effectiveness of a Grades 3 to 5 early algebra intervention with a diverse student population.

Does Early Algebra Matter? The Effectiveness of an Early Algebra Intervention in Grades 3 to 5

A cluster randomized trial design was used to examine the effectiveness of a Grades 3 to 5 early algebra intervention with a diverse student population. Forty-six schools in three school districts participated. Students in treatment schools were taught the intervention by classroom teachers during regular mathematics instruction. Students in control schools received only regular mathematics instruction.

Author/Presenter

Maria Blanton

Rena Stroud

Ana Stephens

Angela Murphy Gardiner

Despina A. Stylianou

Eric Knuth

Isil Isler-Baykal

Susanne Strachota

Lead Organization(s)
Year
2019
Short Description

A cluster randomized trial design was used to examine the effectiveness of a Grades 3 to 5 early algebra intervention with a diverse student population.