Assessment

Uncovering Middle School CS Students’ Understanding of Variables and Control Structures: A Cognitive Think-Aloud Approach

This poster presents findings on middle school students’ understanding of core computer science (CS) concepts, such as variables and control structures, using cognitive think-aloud interviews with eight students. Each student worked on 16-22 formative assessment tasks designed to assess understanding on the ‘Algorithms and Programming’ middle school CS standards. Our study describes students’ interpretations of the CS concepts and discusses potential factors influencing student interpretations. Significance and next steps are described.

Author/Presenter

Hui Yang

Satabdi Basu

Daisy Rutstein

Arif Rachmatullah

Carol Tate

Christopher Ortiz

Eliese Rulifson

Lead Organization(s)
Year
2023
Short Description

This poster presents findings on middle school students’ understanding of core computer science (CS) concepts, such as variables and control structures, using cognitive think-aloud interviews with eight students.

Exploring Middle School Students’ Understanding of Algorithms Using Standards-aligned Formative Assessments: Teacher and Researcher Perspectives

‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the learning targets, and use the tasks to explore student understanding of, and challenges with, the various aspects of the standard.

Author/Presenter

Satabdi Basu

Daisy Rutstein

Carol Tate

Arif Rachmatullah

Hui Yang

Christopher Ortiz

Lead Organization(s)
Year
2023
Short Description

‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the learning targets, and use the tasks to explore student understanding of, and challenges with, the various aspects of the standard.

Designing Standards-aligned Formative Assessments to Explore Middle School Students’ Understanding of Algorithms

'Algorithms’ is a core CS concept included in the K-12 CS learning standards, yet student challenges with understanding and using algorithms are still not well documented. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the fine-grained learning targets, and use the tasks to explore student understanding of and challenges with the various concepts underlying the standard.

Author/Presenter

Satabdi Basu

Daisy Wise Rutstein

Arif Rachmatullah

Carol Tate

Hui Yang

Christopher Ortiz

Lead Organization(s)
Year
2023
Short Description

'Algorithms’ is a core CS concept included in the K-12 CS learning standards, yet student challenges with understanding and using algorithms are still not well documented. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the fine-grained learning targets, and use the tasks to explore student understanding of and challenges with the various concepts underlying the standard.

Technology-based Innovative Assessment

This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and automaticity to review the technological developments of innovative assessments and identify how they have been advanced to meet researcher and practitioner needs.

Author/Presenter

Xiaoming Zhai

Eric Wiebe

Year
2023
Short Description

This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and automaticity to review the technological developments of innovative assessments and identify how they have been advanced to meet researcher and practitioner needs.

Technology-based Innovative Assessment

This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and automaticity to review the technological developments of innovative assessments and identify how they have been advanced to meet researcher and practitioner needs.

Author/Presenter

Xiaoming Zhai

Eric Wiebe

Year
2023
Short Description

This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and automaticity to review the technological developments of innovative assessments and identify how they have been advanced to meet researcher and practitioner needs.

Technology-based Innovative Assessment

This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and automaticity to review the technological developments of innovative assessments and identify how they have been advanced to meet researcher and practitioner needs.

Author/Presenter

Xiaoming Zhai

Eric Wiebe

Year
2023
Short Description

This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and automaticity to review the technological developments of innovative assessments and identify how they have been advanced to meet researcher and practitioner needs.

Technology-based Innovative Assessment

This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and automaticity to review the technological developments of innovative assessments and identify how they have been advanced to meet researcher and practitioner needs.

Author/Presenter

Xiaoming Zhai

Eric Wiebe

Year
2023
Short Description

This section presents an overview of critical developments in technology-driven, classroom-based innovative assessment practices. It uses a framework organized around cognitive constructs, assessment functionality, and automaticity to review the technological developments of innovative assessments and identify how they have been advanced to meet researcher and practitioner needs.

Iterative Cognitive Interview Design to Uncover Children’s Spatial Reasoning

Cognitive interviews play an important role in articulating the intended construct of educational assessments. This paper describes the iterative development of protocols for cognitive interviews with kindergarten through second-grade children to understand how their spatial reasoning skill development aligns with intended constructs. We describe the procedures used to gather evidence of construct relevance and improved alignment to task-based interview items through multiple pilot rounds before conducting cognitive interviews.

Author/Presenter

Elizabeth R. Thomas

Robyn K. Pinilla

Leanne R. Ketterlin-Geller

Cassandra Hatfield

Year
2023
Short Description

Cognitive interviews play an important role in articulating the intended construct of educational assessments. This paper describes the iterative development of protocols for cognitive interviews with kindergarten through second-grade children to understand how their spatial reasoning skill development aligns with intended constructs.

Connecting Classroom Assessment with Learning Goals and Instruction Through Theories of Learning

In this report section, we discuss the importance of aligning classroom assessments with learning goals and instructional practices to both shape and evaluate students’ learning opportunities. We describe a plausible solution for improving alignment by integrating theories of learning in the design of classroom assessments. We discuss ways in which the specification of theories of learning as learning progressions can improve alignment between classroom assessments and instruction by focusing on the content, task design, and data generated from classroom assessments.

Author/Presenter

Leanne R. Ketterlin-Geller

Christopher J. Harris

Year
2023
Short Description

In this report section, we discuss the importance of aligning classroom assessments with learning goals and instructional practices to both shape and evaluate students’ learning opportunities.

Developing and Using a Scalable Assessment to Measure Preservice Elementary Teachers' Ccontent Knowledge for Teaching About Matter

There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However, there are limited instruments that can be easily administered and scored on a large scale to assess and study elementary science teachers' CKT.

Author/Presenter

Katherine E. Castellano

Jamie N. Mikeska

Lead Organization(s)
Year
2023
Short Description

There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However, there are limited instruments that can be easily administered and scored on a large scale to assess and study elementary science teachers' CKT. Such measures would support strategic monitoring of large groups of science teachers' CKT and the investigation of comparative questions about science teachers' CKT longitudinally across the professional continuum or across teacher education or professional development sites. To address this gap, this study focused on designing an automatically scorable summative assessment that can be used to measure preservice elementary teachers' (PSETs') CKT in one high-leverage science content area: matter and its interactions.