Accessible Simulations

Learners can already use multiple input methods to interact with simulations, for example, by using a mouse, track pad, or touch. The addition of keyboard navigation expands options for input methods, allowing input through key presses on the keyboard, and also through assistive devices such as switches, joysticks, alternative keyboards, electronic pointing devices, sip-and-puff systems, and more.

Our design strategy for alternative input and keyboard access is to:

• Indicate where a learner is in their exploration with a bold visual focus highlight (common to all sims)
• Follow known accessible design patterns (see ARIA Authoring Practices) to ensure interactions are as familiar as possible for learners who use alternative input methods
• Provide in-sim guidance for essential interactions in the form of a brief Keyboard Shortcuts dialog
• Provide in-sim interaction hints in the form of help text for custom interactions

Sonification is the use of non-speech sounds (such as musical tones) to convey information. For learners accessing the interactive descriptions within the simulations, the use of sonification complements the descriptions and provides a pathway for conveying information that is continuous in nature – often difficult to convey with words. For learners visually exploring the simulation, sound and sonification provide an additional mode of conveying complex relationships.

System Requirements

Not all browsers support web audio. To hear sounds in sonified simulations please use one of the following browsers:

• Chrome
• Firefox
• Safari

We are designing interactive descriptions that are read aloud by screen reader software. These descriptions provide an output modality accessible to learners who are blind or have low vision that use screen reader software. Interactive descriptions dynamically update and respond to a learner's interactions. This gives learners access to a robust non-visual experience that allows them to navigate and interact with the sim's interactive objects. Learners can access a complete description of the sim's current state at anytime during their exploration. When they interact with objects, the sim responds automatically providing descriptions of the relevant changes happening to the objects and surrounding context of the sim.

Using screen reader software and a keyboard on a PC laptop computer, learners can navigate and read through the simulation's state descriptions using the Arrow keys (i.e., screen reader cursor keys). Learners can skim and scan the state descriptions using their screen reader commands (e.g., navigate by regions, by headings, and by interactive elements).

With continued research and development on input methods, some simulations' interactive descriptions are now also accessible on iOS devices. Using an iPad or iPhone, the built-in screen reader, VoiceOver, and Safari, learners can explore and interact in a robust interactive non-visual experience.

At present the interactive described experience is accessible using screen reader software and the necessary input method (keyboard or gesture) in the following screen reader-browser combinations:

• NVDA and Firefox on Windows
• JAWS and Chrome on Windows
• VoiceOver and Safari on Mac OS
• VoiceOver and Safari on iOS (iPad or iPhone)

Voicing is a customizable feature that uses Web Speech to voice simulation information. With the simulation open, enable Voicing in the Preferences Menu under the Audio tab to support collaboration with and between diverse learners or to meet the needs of diverse teaching scenarios. It is available on most platforms in browsers that support web speech.

Because it is customizable, teachers and learners have a lot of control over what is spoken aloud when interacting and may find it helpful during class demonstrations or during group collaborations. The amount of spoken content can vary from none at all during interaction, when Sim Voicing is set to off in the Voicing Toolbar, to hearing a range of other details. Once Voicing is enabled, the default setting is limited to names of interactive objects or controls and on-screen text. Teachers and learners can choose to add object details and changes about what they are interacting with, surrounding context changes as a result of interacting, and even helpful hints by checking the checkboxes available under Sim Voicing Options.

In addition to customizing the amount of information that is spoken aloud, teachers and learners can customize the Voice by adjusting speech rate, pitch, or even choosing a particular voice from a list of voices available on their system.

The Voicing feature includes a Toolbar that appears along the left side of the simulation when Voicing is enabled. The Toolbar provides on-demand access to an overview, details about the current state of the simulation, and a hint about how a learner might want to proceed. This information is always available whether or not Sim Voicing is on or off. The toolbar is collapsible, and if needed it can be fully hidden from the Preferences Menu.

While the Voicing feature shares some features with traditional screen readers, it works quite differently – it only voices information through direct interaction. There is no cursor access to chunks of information. This means the selected amount of details are spoken aloud only once a learner clicks on (or touches) or moves their keyboard focus to an object or piece of text that has been made voice-able. Also, unlike traditional screen reader software, Voicing only reads out information about the simulation. It does not read out structural or functional information common to the screen reader experience. A learner accessing the simulation through a screen reader may wish to pause/disable their screen reader software if they want to use the Voicing feature.