CAREER: Bridging the Digital Accessibility Gap in STEM Using Multisensory Haptic Platforms
In this project, we investigate haptic systems that are readily available for rendering visual STEM content through sight, sound, and touch. We use combinations of visual display, text-to-speech, vibrations, and the movement of one’s hands for interacting with STEM content (such as charts and graphs in math and science-based simulations) multimodally on touchscreens. Our investigations extend into "smart" tangible manipulatives that pair with interactive PhET simulations and enable rich kinesthetic manipulation of on-screen content through touch.