Middle

Can Generative AI and ChatGPT Outperform Humans on Cognitive-Demanding Problem-Solving Tasks in Science?

This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four 2019 NAEP science assessment tasks were coded by content experts using a two-dimensional cognitive load framework, including task cognitive complexity and dimensionality.

Author/Presenter

Xiaoming Zhai

Matthew Nyaaba

Wenchao Ma

Lead Organization(s)
Year
2024
Short Description

This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items.

Can Generative AI and ChatGPT Outperform Humans on Cognitive-Demanding Problem-Solving Tasks in Science?

This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four 2019 NAEP science assessment tasks were coded by content experts using a two-dimensional cognitive load framework, including task cognitive complexity and dimensionality.

Author/Presenter

Xiaoming Zhai

Matthew Nyaaba

Wenchao Ma

Lead Organization(s)
Year
2024
Short Description

This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items.

Promoting Students’ Informal Inferential Reasoning Through Arts-Integrated Data Literacy Education

Purpose

Author/Presenter

Camillia Matuk

Ralph Vacca

Anna Amato

Megan Silander

Kayla DesPortes

Peter J. Woods

Marian Tes

Year
2023
Short Description

Arts-integration is a promising approach to building students’ abilities to create and critique arguments with data, also known as informal inferential reasoning (IIR). However, differences in disciplinary practices and routines, as well as school organization and culture, can pose barriers to subject integration. The purpose of this study is to describe synergies and tensions between data science and the arts, and how these can create or constrain opportunities for learners to engage in IIR.

Promoting Students’ Informal Inferential Reasoning Through Arts-Integrated Data Literacy Education

Purpose

Author/Presenter

Camillia Matuk

Ralph Vacca

Anna Amato

Megan Silander

Kayla DesPortes

Peter J. Woods

Marian Tes

Year
2023
Short Description

Arts-integration is a promising approach to building students’ abilities to create and critique arguments with data, also known as informal inferential reasoning (IIR). However, differences in disciplinary practices and routines, as well as school organization and culture, can pose barriers to subject integration. The purpose of this study is to describe synergies and tensions between data science and the arts, and how these can create or constrain opportunities for learners to engage in IIR.

Promoting Students’ Informal Inferential Reasoning Through Arts-Integrated Data Literacy Education

Purpose

Author/Presenter

Camillia Matuk

Ralph Vacca

Anna Amato

Megan Silander

Kayla DesPortes

Peter J. Woods

Marian Tes

Year
2023
Short Description

Arts-integration is a promising approach to building students’ abilities to create and critique arguments with data, also known as informal inferential reasoning (IIR). However, differences in disciplinary practices and routines, as well as school organization and culture, can pose barriers to subject integration. The purpose of this study is to describe synergies and tensions between data science and the arts, and how these can create or constrain opportunities for learners to engage in IIR.

Understanding the Effect of Differences in Prior Knowledge on Middle School Students’ Collaborative Interactions and Learning

We investigated how the level of variance in students’ prior knowledge may have influenced their collaborative interactions and science learning in small groups. We examined learning outcomes from 102 groups from seven science teachers’ classes and discourse from two contrasting groups: Homogeneous versus heterogeneous. We examined individual and group outcomes using hierarchical linear modeling (HLM) to explore the effect of membership in a homogeneous or heterogeneous group on students’ learning.

Author/Presenter

Sadhana Puntambekar

Dana Gnesdilow

Sinan Yavuz

Year
2023
Short Description

We investigated how the level of variance in students’ prior knowledge may have influenced their collaborative interactions and science learning in small groups. We examined learning outcomes from 102 groups from seven science teachers’ classes and discourse from two contrasting groups: Homogeneous versus heterogeneous. We examined individual and group outcomes using hierarchical linear modeling (HLM) to explore the effect of membership in a homogeneous or heterogeneous group on students’ learning. We then used social network analyses (SNA) to identify any differences in interaction patterns between the two contrasting groups as they conducted multiple compost simulations. Finally, we examined students’ discussions in these groups to better understand their interactions.

Learning to Listen: Cultivating Pre-Service Teachers’ Attunement to Student Thinking

Reform efforts in science and mathematics education highlight students’ experiences and sensemaking repertoires as valuable resources for instruction. Yet, there is much to learn about how to cultivate teachers’ capacity for eliciting, understanding, and responding to students’ contributions. We argue that the first step of this cultivation is teachers’ learning to listen: to attune and attend to the novel ways that students make sense of scientific phenomena and the natural world.

Author/Presenter

Shannon G. Davidson

Lama Z. Jaber

Allison Metcalf

Year
2024
Short Description

Reform efforts in science and mathematics education highlight students’ experiences and sensemaking repertoires as valuable resources for instruction. Yet, there is much to learn about how to cultivate teachers’ capacity for eliciting, understanding, and responding to students’ contributions. We argue that the first step of this cultivation is teachers’ learning to listen: to attune and attend to the novel ways that students make sense of scientific phenomena and the natural world.

Characteristics of Mathematics Coaches’ Suggestions to Teachers

We developed an analytic framework related to the suggestions coaches provided to mathematics teachers as they engaged in content-focused coaching cycles. We analyzed 712 suggestions from nine coaches and 58 coaching conversations. Analysis focused on what the suggestion entailed and how suggestions were made. Most suggestions focused on revising or adding a task feature or asking questions to advance students’ thinking. Most suggestions were not contingent on what happened during the lesson and were specific and clear about content and timing, especially when focused on lesson design.

Author/Presenter

Julie M. Amador

Ryan Gillespie

Jeffrey Choppin

Cynthia D. Carson

Year
2023
Short Description

We developed an analytic framework related to the suggestions coaches provided to mathematics teachers as they engaged in content-focused coaching cycles. We analyzed 712 suggestions from nine coaches and 58 coaching conversations. Analysis focused on what the suggestion entailed and how suggestions were made.

Understanding the Cognitive Processes of Mathematical Problem Posing: Evidence from Eye Movements

This study concerns the cognitive process of mathematical problem posing, conceptualized in three stages: understanding the task, constructing the problem, and expressing the problem. We used the eye tracker and think-aloud methods to deeply explore students’ behavior in these three stages of problem posing, especially focusing on investigating the influence of task situation format and mathematical maturity on students’ thinking.

Author/Presenter

Ling Zhang

Naiqing Song

Guowei Wu

Jinfa Cai

Lead Organization(s)
Year
2023
Short Description

This study concerns the cognitive process of mathematical problem posing, conceptualized in three stages: understanding the task, constructing the problem, and expressing the problem. We used the eye tracker and think-aloud methods to deeply explore students’ behavior in these three stages of problem posing, especially focusing on investigating the influence of task situation format and mathematical maturity on students’ thinking.

Exploring the Noticing of Science Teachers: What Teachers' Notice and Using Video to Capture Teacher Knowledge

Knowing how science teachers develop their professional knowledge has been a challenge. One potential way to determine the professional knowledge of teachers is through videos. In the study described here, the authors recruited 60 elementary and secondary science teachers, showed them one of two 10-min videos, and recorded and analyzed their comments when watching the videos. The coding focused on their noticing of student learning, teacher's teaching, types of teaching practices, and the use of interpretative frames.

Author/Presenter

Julie A. Luft

Yuxi Huang

Harleen Singh

Hatice Ozen-Tasdemir

Joe DeLuca

Shelby Watson

Elizabeth Ayano

Brooke A. Whitworth

Lead Organization(s)
Year
2023
Short Description

Knowing how science teachers develop their professional knowledge has been a challenge. One potential way to determine the professional knowledge of teachers is through videos. In the study described here, the authors recruited 60 elementary and secondary science teachers, showed them one of two 10-min videos, and recorded and analyzed their comments when watching the videos.