Educational Technology

Combining Natural Language Processing with Epistemic Network Analysis to Investigate Student Knowledge Integration within an AI Dialog

In this study, we used Epistemic Network Analysis (ENA) to represent data generated by Natural Language Processing (NLP) analytics during an activity based on the Knowledge Integration (KI) framework. The activity features a web-based adaptive dialog about energy transfer in photosynthesis and cellular respiration. Students write an initial explanation, respond to two adaptive prompts in the dialog, and write a revised explanation. The NLP models score the KI level of the initial and revised explanations. They also detect the ideas in the explanations and the dialog responses.

Author/Presenter

Weiying Li

Hsin-Yi Chang

Allison Bradford

Libby Gerard

Marcia C. Linn

Year
2024
Short Description

In this study, we used Epistemic Network Analysis (ENA) to represent data generated by Natural Language Processing (NLP) analytics during an activity based on the Knowledge Integration (KI) framework. The activity features a web-based adaptive dialog about energy transfer in photosynthesis and cellular respiration.

Best of Both Worlds: Developing an Innovative, Integrated, Intelligent, and Interactive System of Technologies Supporting In-Person and Digital Experiences for Early Mathematics

Mathematics is a core component of cognition. Unfortunately, most young children and teachers cannot access research-based early childhood mathematics resources. Building on a quarter-century of research, we are developing and evaluating an innovative, integrated, intelligent, and interactive system of technologies based on empirically validated learning trajectories that provide the best personal and digital tools for assessing and supporting children’s mathematics learning.

Author/Presenter

Douglas H. Clements

Shannon S. Guss

Julie Sarama

Daniela Alvarez-Vargas

Lead Organization(s)
Year
2024
Short Description

Mathematics is a core component of cognition. Unfortunately, most young children and teachers cannot access research-based early childhood mathematics resources. Building on a quarter-century of research, we are developing and evaluating an innovative, integrated, intelligent, and interactive system of technologies based on empirically validated learning trajectories that provide the best personal and digital tools for assessing and supporting children’s mathematics learning.

Integrating the Plate Tectonic and Rock Genesis Systems for Secondary School Students

This paper describes how plate tectonics and rock genesis, two topics that are typically addressed separately in secondary Earth science classes, can be taught together as an integrated system. We define the TecRocks Reasoning Framework, developed to support student reasoning about rock formation situated in the context of plate tectonics. We also explain how we leveraged the framework in the designs of a new curriculum, interactive computer simulation, and assessment instrument. We show how the instrument was used to evaluate the curriculum, which included the computer simulation.

Author/Presenter

Amy Pallant

Christopher Lore

Hee-Sun Lee

Stephanie Seevers

Trudi Lord

Lead Organization(s)
Year
2024
Short Description

This paper describes how plate tectonics and rock genesis, two topics that are typically addressed separately in secondary Earth science classes, can be taught together as an integrated system.

A Comparison of Responsive and General Guidance to Promote Learning in an Online Science Dialog

Students benefit from dialogs about their explanations of complex scientific phenomena, and middle school science teachers cannot realistically provide all the guidance they need. We study ways to extend generative teacher–student dialogs to more students by using AI tools. We compare Responsive web-based dialogs to General web-based dialogs by evaluating the ideas students add and the quality of their revised explanations.

Author/Presenter

Libby Gerard

Marcia C. Linn

Marlen Holtmann

Year
2024
Short Description

Students benefit from dialogs about their explanations of complex scientific phenomena, and middle school science teachers cannot realistically provide all the guidance they need. We study ways to extend generative teacher–student dialogs to more students by using AI tools.

Using Artificial Intelligence to Support Peer-to-Peer Discussions in Science Classrooms

In successful peer discussions students respond to each other and benefit from supports that focus discussion on one another’s ideas. We explore using artificial intelligence (AI) to form groups and guide peer discussion for grade 7 students. We use natural language processing (NLP) to identify student ideas in science explanations. The identified ideas, along with Knowledge Integration (KI) pedagogy, informed the design of a question bank to support students during the discussion. We compare groups formed by maximizing the variety of ideas among participants to randomly formed groups.

Author/Presenter

Billings, K., Chang, H-Y., Brietbart, J., & Linn, M.C. 

Short Description

We use natural language processing (NLP) to identify student ideas in science explanations. The identified ideas, along with Knowledge Integration (KI) pedagogy, informed the design of a question bank to support students during the discussion. We compare groups formed by maximizing the variety of ideas among participants to randomly formed groups. 

Using Artificial Intelligence to Support Peer-to-Peer Discussions in Science Classrooms

In successful peer discussions students respond to each other and benefit from supports that focus discussion on one another’s ideas. We explore using artificial intelligence (AI) to form groups and guide peer discussion for grade 7 students. We use natural language processing (NLP) to identify student ideas in science explanations. The identified ideas, along with Knowledge Integration (KI) pedagogy, informed the design of a question bank to support students during the discussion. We compare groups formed by maximizing the variety of ideas among participants to randomly formed groups.

Author/Presenter

Billings, K., Chang, H-Y., Brietbart, J., & Linn, M.C. 

Short Description

We use natural language processing (NLP) to identify student ideas in science explanations. The identified ideas, along with Knowledge Integration (KI) pedagogy, informed the design of a question bank to support students during the discussion. We compare groups formed by maximizing the variety of ideas among participants to randomly formed groups. 

An Empirical Investigation of Neural Methods for Content Scoring of Science Explanations

With the widespread adoption of the Next Generation Science Standards (NGSS), science teachers and online learning environments face the challenge of evaluating students’ integration of different dimensions of science learning. Recent advances in representation learning in natural language processing have proven effective across many natural language processing tasks, but a rigorous evaluation of the relative merits of these methods for scoring complex constructed response formative assessments has not previously been carried out.

Author/Presenter

Riordan, B., Bichler, S., Bradford, A., King Chen, J., Wiley, K., Gerard, L., & Linn, M.C.

Short Description

We present a detailed empirical investigation of feature-based, recurrent neural network, and pre-trained transformer models on scoring content in real-world formative assessment data. We demonstrate that recent neural methods can rival or exceed the performance of feature-based methods. We also provide evidence that different classes of neural models take advantage of different learning cues, and pre-trained transformer models may be more robust to spurious, dataset-specific learning cues, better reflecting scoring rubrics.

An Empirical Investigation of Neural Methods for Content Scoring of Science Explanations

With the widespread adoption of the Next Generation Science Standards (NGSS), science teachers and online learning environments face the challenge of evaluating students’ integration of different dimensions of science learning. Recent advances in representation learning in natural language processing have proven effective across many natural language processing tasks, but a rigorous evaluation of the relative merits of these methods for scoring complex constructed response formative assessments has not previously been carried out.

Author/Presenter

Riordan, B., Bichler, S., Bradford, A., King Chen, J., Wiley, K., Gerard, L., & Linn, M.C.

Short Description

We present a detailed empirical investigation of feature-based, recurrent neural network, and pre-trained transformer models on scoring content in real-world formative assessment data. We demonstrate that recent neural methods can rival or exceed the performance of feature-based methods. We also provide evidence that different classes of neural models take advantage of different learning cues, and pre-trained transformer models may be more robust to spurious, dataset-specific learning cues, better reflecting scoring rubrics.

How Does an Adaptive Dialog Based on Natural Language Processing Impact Students from Distinct Language Backgrounds?

This study takes advantage of advances in Natural Language Processing (NLP) to build an idea detection model that can identify ideas grounded in students’ linguistic experiences. We designed adaptive, interactive dialogs for four explanation items using the NLP idea detection model and investigated whether they similarly support students from distinct language backgrounds. The curriculum, assessments, and scoring rubrics were informed by the Knowledge Integration (KI) pedagogy.

Author/Presenter

Holtman, M., Gerard, L., Li, W., Linn, M.C., Steimel, K., & Riordan, B. 

Year
2023
Short Description

This study takes advantage of advances in Natural Language Processing (NLP) to build an idea detection model that can identify ideas grounded in students’ linguistic experiences.

How Does an Adaptive Dialog Based on Natural Language Processing Impact Students from Distinct Language Backgrounds?

This study takes advantage of advances in Natural Language Processing (NLP) to build an idea detection model that can identify ideas grounded in students’ linguistic experiences. We designed adaptive, interactive dialogs for four explanation items using the NLP idea detection model and investigated whether they similarly support students from distinct language backgrounds. The curriculum, assessments, and scoring rubrics were informed by the Knowledge Integration (KI) pedagogy.

Author/Presenter

Holtman, M., Gerard, L., Li, W., Linn, M.C., Steimel, K., & Riordan, B. 

Year
2023
Short Description

This study takes advantage of advances in Natural Language Processing (NLP) to build an idea detection model that can identify ideas grounded in students’ linguistic experiences.