Accessible Simulations

A sim with alternative input adds keyboard accessibility to the traditional sim inputs of mouse and touch. Students can navigate and fully engage with the sims interactions using a keyboard. Simulations with the alternative input may contain descriptions that identify interactive objects and values. These simple descriptions, if available, are accessible with screen reader software.

A sim with sound and sonification has added sounds designed to create an immersive and meaningful experience for all students including students with vision impairments. Sonifications are sounds carefully mapped to changing values that represent the scientific concepts in the sim. Thus, sonified interactions provide access to the science in a non-visual mode (i.e., sound). Sound effects are also used in sim sound design to help students make connections with things that happen in real-life (e.g. rubbing sound for rubbing a foot on a carpet). Independently or together, these sounds enhance the learning experience for all students. Sounds can be turned off using the global sound button on the sim menu bar.

A sim with interactive description provides a fully described interactive experience that is keyboard accessible, dynamically updates, and automatically responds to changes a user makes as they interact with the simulation. Using screen reader software, interactive description provides a robust engaging interactive experience for students who are blind or have a severe vision impairment.

A mobile accessible sim provides a fully described interactive experience that is accessible with VoiceOver and its special screen reader touch gestures. Using VoiceOver and touch gestures students can engage in a dynamic described experience along side peers using the visual sim. Mobile accessibility provides an engaging described interactive experience for students who are blind or have a severe vision impairment. Students must have access to and know how to use a touch device with the latest iOS, such as an iPad or iPhone.

The prototype icon indicates that the simulation’s listed accessibility features are in their design phase. Everyone is welcome to try the simulations and to provide helpful feedback, keeping in mind that prototypes are in progress, not yet final, and fully tested.

Balloons and Static Electricity_氣球和靜電引力

  • Features: Alternative Input, Interactive Description, , ,
  • Published Version: Balloons and Static Electricity_氣球和靜電引力
  • Why does a balloon stick to your sweater? Explore the charges in the sweater, balloons, and the wall as you investigate!<br/><br/>HTML5 版本之翻譯:<br/>翁佳驥 (2016~)

Coulomb's Law_庫侖定律

Friction_摩擦

  • Features: Alternative Input, Interactive Description, Sound and Sonification, ,
  • Published Version: Friction_摩擦
  • 摩擦導致物質變熱和融化摩擦兩物體,把它們變熱了,當其中一個達到融化的溫度,粒子間的引力斷裂如同物質融化了。<br/><br/>翻譯者:<br/>潘建宏 (2009)<br/>潘建宏 (2010)<br/><br/>HTML5 版本之翻譯:<br/>翁佳驥 (2016~)

Gravity Force Lab_萬有引力實驗室

  • Features: Alternative Input, Interactive Description, Mobile Accessibility Sound and Sonification, ,
  • Published Version: Gravity Force Lab_萬有引力實驗室
  • 將兩物互相作用的萬有引力圖形化。可以改變物體的性質,並觀察萬有引力如何改變。<br/><br/>翻譯者:<br/>江易原 (2010)<br/><br/>HTML5 版本之翻譯:<br/>翁佳驥 (2016~)

Gravity Force Lab: Basics_萬有引力實驗室:基礎

John Travoltage_約翰屈伏塔

  • Features: Alternative Input, Interactive Description, Sound and Sonification, ,
  • Published Version: John Travoltage_約翰屈伏塔
  • 玩玩約翰的腳與手臂,看看何時他會被電到!<br/><br/>HTML5 版本之翻譯:<br/>翁佳驥 (2016~)

Molarity_莫耳濃度

  • Features: Alternative Input, Interactive Description, Mobile Accessibility Sound and Sonification, ,
  • Published Version: Molarity_莫耳濃度
  • 哪些因素決定溶液的濃度?我們可以藉由調整溶質的量與溶液的體積,來學習莫耳數、體積 (公升),與莫耳濃度之間的關係。可以更換溶質並比較不同的化學藥品溶於水的情形。<br/><br/>翻譯者:<br/>江易原 (2012)<br/><br/>HTML5 版本之翻譯:<br/>翁佳驥 (2016~)

Molecules and Light_分子與光

  • Features: Alternative Input, , , ,
  • Published Version: Molecules and Light_分子與光
  • 您知道溫室效應氣體如何影響氣候,您知道為什麼臭氧層很重要?您可以藉由本模擬,知道大氣中光與分子有怎樣的交互作用。<br/><br/>翻譯者:<br/>江易原 (2011)<br/><br/>HTML5 版本之翻譯:<br/>翁佳驥 (2016~)

Ohm's Law_歐姆定律

  • Features: Alternative Input, Interactive Description, Mobile Accessibility Sound and Sonification, ,
  • Published Version: Ohm's Law_歐姆定律
  • 觀看歐姆定律方程式與簡易電路的關係。調整電壓和電阻,並查看按照歐姆定律電流的改變,方程式中符號的字體大小將配合電路圖而改變。<br/><br/>翻譯者:<br/>楊森吉 (2009)<br/>楊森吉 (2010)<br/><br/>HTML5 版本之翻譯:<br/>翁佳驥 (2016~)

Resistance in a Wire_電線的電阻

  • Features: Alternative Input, Interactive Description, Sound and Sonification, ,
  • Published Version: Resistance in a Wire_電線的電阻
  • 學習物理知識導線的電阻。改變導線的電阻率、長度與截面積,並觀察它們對導線電阻的影響。方程式中符號字體大小將配合導線圖而改變。<br/><br/>翻譯者:<br/>潘建宏 (2009)<br/>潘建宏 (2010)<br/><br/>HTML5 版本之翻譯:<br/>翁佳驥 (2016~)

Capacitor Lab: Basics

  • Features: Alternative Input, , ,
  • Prototype Version: CLB 1.0.0-dev.14
  • An early exploration (2015) into how to make a sim accessible has taken place for Capacitor Lab Basics. The sim is keyboard navigable with some auditory descriptions when using 'Forms' mode with a screen reader. We are working on updating the content and the interactions, so that the simulation can be accessed by a screen reader in any mode. This prototype has been tested with NVDA and Firefox.

Forces and Motion: Basics

  • Features: Alternative Input, , ,
  • Prototype Version: FAMB 2.0.0-accessible-instance.2
  • An early exploration (2015) into how to make a sim accessible has taken place for Forces and Motion Basics. It has working keyboard navigation and auditory descriptions for the 'Net Force' screen when the screen reader is in 'Forms' mode. We are working on updating the content so that it can be read by the screen reader in any mode. Notes for the main interaction: Press 'Enter' or 'Spacebar' to enter a group of pullers. Once in the group, use 'Arrow' keys to choose which puller you wish to select. Press 'Enter' or 'Spacebar' to select puller and move to knot selection. Use 'Arrow' keys to choose between different knots. Press 'Escape' to leave a group of pullers or knots, 'Tab' to leave group and go to next element. This prototype has been tested with NVDA and Firefox.

Molecules and Light

  • Features: Alternative Input, Interactive Description, Sound and Sonification, Mobile Accessibility
  • Prototype Version: MAL 1.5.0-dev.50
  • Turn light source on to explore. Observe what happens in the observation window as you set up different combinations of light source and molecule. Note this prototype supports browser zooming options, so zoom in for a closer look, if you need to.

Plinko Probability

  • Features: Alternative Input, , ,
  • Prototype Version: PP 1.2.0-dev.3
  • Drop balls to begin observations. Note this sim does not yet have a Keyboard Shortcuts dialog, and simple descriptions are in progress.

Reactants, Products and Leftovers

  • Features: Alternative Input, , ,
  • Prototype Version: RPAL 1.2.0-dev.3
  • Build sandwiches, then investigate molecules to explore reactants products and leftovers. Note this sim does not yet have a Keyboard Shortcuts dialog, and simple descriptions are in progress.

Rutherford Scattering

  • Features: Alternative Input, , ,
  • Prototype Version: RS 1.1.0-dev.4
  • Stream alpha particles to begin observations in Rutherford’s experiment. Note this sim does not yet have a Keyboard Shortcuts dialog.

Students can already use multiple input methods to interact with the simulation, for example, by using a mouse, trackpad, or touch. The addition of Keyboard Navigation expands options for input methods, allowing input through key presses on the keyboard, and also through assistive devices such as switches, joysticks, alternative keyboards, electronic pointing devices, sip-and-puff systems, and more.

Our design strategy for keyboard navigation and keyboard access is to:

  • use a bold visual focus highlight (common to all sims) that indicates where a student is in their exploration
  • follow known accessible design patterns (see ARIA Authoring Practices) to ensure interactions are as familiar as possible for students who use alternative input
  • provide in-sim guidance for essential interactions in the form of a brief Keyboard Shortcuts dialog

We are designing descriptions that are read aloud by screen reader software. These descriptions provide an additional output mechanism for the simulations. Simple and dynamic descriptions, together, give students access to a non-visual layer that provides a robust text-based mode of the scene layout, navigation, interactions, and dynamic state information as the simulation changes, and dynamic feedback of what is happening (i.e., alerts) during interaction. Sims with descriptions will have already been made keyboard accessible, as well.

Future research will focus on making the descriptions available to more students. At present the descriptions are accessible using screen reader software in the following screen reader-browser combinations:

  • NVDA and Firefox on Windows
  • JAWS and Chrome on Windows
  • VoiceOver and Safari on Mac OS

Using screen reader software students can navigate and read through the simulation at any time using the Arrow keys (i.e., screen reader cursor keys). Students can skim and scan using their screen reader commands (e.g., navigate by regions, by headings, and by interactive elements).

In addition, regardless of which screen reader software is being used, students can use the Tab key and Shift plus the Tab key to navigate forwards and backwards through possible sim interactions.

Two-phase approach to description design

The design of the dynamic descriptions that provide the fully described version of the sim are complex and take the longest to design and test. In efforts to create broader access sooner we have two phases for description design:

  1. In phase 1 we design the simulation’s simple descriptions which provide orientation of the simulation’s layout and names for the interactive elements.
  2. In phase 2 we design the simulation’s dynamic descriptions which include all dynamic state information and the dynamic interactive alerts that describe what is happening.

In our research, we refer to simple descriptions as static descriptions, i.e., descriptions that essentially do not change. Dynamic descriptions and interactive alerts are the descriptions that are designed in phase 2 and create a fully described interactively experience. For a discussion of our research on description, please see our paper on description strategies (Smith, Lewis & Moore, 2017). Based on what we have learned in design research, we are making every effort to release keyboard navigable simulations with their simple static descriptions to provide minimal non-visual access. The fully described dynamic experience requires a longer research, design and development cycle.

Sonification is the use of non-speech sounds (such as musical tones) to convey information. For students accessing the descriptions within the simulations, the use of sonification will complement the text-based descriptions and provide a pathway for conveying information that is continuous in nature – which can be difficult to convey with words. For students visually exploring the simulation, sonification provides a new mode of conveying complex relationships. Sims with sonification are tested using browsers that support web audio. These include:

  • Chrome
  • Firefox
  • Safari