Difference between revisions of "Accessibility Testing"

From Dreamwidth Notes
Jump to: navigation, search
(Keyboard-only Users: alternatives to multi-select dropdown lists)
(Dyslexia: +more problematic elements from UX/dyslexia article)
 
(14 intermediate revisions by 8 users not shown)
Line 1: Line 1:
Accessibility is not the same as usability, but it overlaps because a lot of disabilities make it harder to deal with stuff which doesn't have great usability to begin with.
+
Accessibility is not the same as usability, but it overlaps because a lot of disabilities make it harder to deal with stuff that doesn't have great usability to begin with.
  
Some accessibility features can be tested automatically with tools - eg [http://validator.w3.org/check?uri=referer markup validation], [http://www.blackwidows.co.uk/resources/color-contrast-analyser.php colour contrast analysis] - but much of it comes down to human judgement.  
+
Some accessibility features can be tested automatically with tools, but much of it comes down to human judgment. In fact, some accessible pages will fail markup validation because some validators don't understand accessibility markup such as WAI-ARIA. The W3C [http://www.w3.org/WAI/eval/selectingtools.html explains the limitations of validation tools and how to choose one].
  
Good description here of what can and can't be tested: [http://jimthatcher.com/testing1.htm What accessibility testing is possible]  
+
[http://jimthatcher.com/testing1.htm Jim Thatcher's analysis of what accessibility testing is possible] is a good start, but is not comprehensive. For example, it misses contrast levels appropriate for dyslexics, moving image problems that people with some neuro deficits have, everything important being keyboard-only accessible, and probably other things.
Even that site misses some stuff - contrast levels appropriate for dyslexics, moving image problems that people with some neuro deficits have, everything important being keyboard-only accessible, and probably other things.
+
  
 
== General ==
 
== General ==
 +
 
These things are generally good things to do and also have implications for disability accessibility.
 
These things are generally good things to do and also have implications for disability accessibility.
  
* Pages need to validate fully to whatever DTD they've specified.
+
* Pages need to validate fully to whatever DTD they've specified. '''Note:''' If adding accessible markup stops a validation tool from working, it may be out-of-date. Make sure that the tool is up-to-date, but don't remove the accessible markup.
* Pages should degrade gracefully in the absence of capabilities for Flash, JavaScript, images, CSS, etc.
+
* Pages should degrade gracefully in the absence of capabilities for Flash, JavaScript, images, CSS, and so forth. Whenever possible, the absence of those capabilities should give as rich a user experience as their presence.
* Proper semantic markup should be used, eg headers for headings, ACRONYM and ABBR tags, EM/STRONG rather than I/B tags.
+
* Proper semantic markup should be used: headers for headings, ACRONYM and ABBR tags, EM/STRONG rather than I/B tags, and so forth. The product should never change user-entered HTML tags if avoidable, ''especially'' if doing so will move away from semantic toward formatting-based markup.
** This especially.  The site should rewrite I/B tags, made in posts, into EM/STRONG, instead of the other way around which is what the current LJ code does. And the headers, oh my god, the headers. [[User:Branchandroot|branchandroot]]
+
* WAI-ARIA roles and landmarks should be used.
  
 
== Blindness ==
 
== Blindness ==
 +
 
This is the disability people usually think about when they discuss web accessibility, but it's important to remember it's not the only one.
 
This is the disability people usually think about when they discuss web accessibility, but it's important to remember it's not the only one.
  
* CAPTCHAs need audio options.
+
* Screen reader friendliness. Try very hard to get general screen reader users to do testing for us, rather than sighted people using screen readers which is a bad approximation. However, sighted developers and testers can still perform minimalist screen reader testing. See our list of [[Adaptive technology#Screenreaders|screen readers]].
* Screen reader friendliness. Try very hard to get general screen reader users to do testing for us, rather than sighted people using screen readers which is a bad approximation.
+
* Check tab order for everything, especially things which are AJAXey and therefore have changing tab order.
** JAWS
+
 
** WindowEyes
+
=== Relevant reading ===
** VoiceOver
+
** NVDA
+
** Orca?
+
** others?
+
* Check tab order for everything, especially things which are AJAXey and therefore have changing tab order
+
  
Relevant reading:
 
 
* [http://webaim.org/projects/screenreadersurvey/ WebAIM screen reader survey results]
 
* [http://webaim.org/projects/screenreadersurvey/ WebAIM screen reader survey results]
  
 
== Color Blindness ==
 
== Color Blindness ==
  
* Things which are usually signalled to users through colour changes in interface elements must have some other signalling mechanism (such as change of image shape) in addition
+
Things which are usually signalled to users through colour changes in interface elements must have some other signalling mechanism (such as change of image shape) in addition to colour.
 +
 
 +
=== Tools & Resources ===
 +
 
 +
* [http://colorfilter.wickline.org/ Colorblindness Web Page Filter]
 +
* [http://michelf.com/projects/sim-daltonism/ Sim Daltonism] -- A program for Mac OS X that simulates different kinds of color blindness.
  
 
== Deafness ==
 
== Deafness ==
  
* Any official videos put on the site (eg "how to use" screencasts) should have captions available.
+
Any official videos put on the site (such as "how to use" screencasts) should have captions available.
  
 
== Deafblindness ==
 
== Deafblindness ==
This disability is a double-whammy as many of the solutions to problems faced by blind or deaf users rely on the other sense - eg audio alternatives to CAPTCHAs.
 
  
* CAPTCHAs are completely inaccessible and an alternative such as emailing support needs to be available whenever CAPTCHAs are used. Currently I think this is only journal creation, if that.
+
This disability is a double-whammy, as many of the solutions to problems faced by blind or deaf users rely on the other sense -- e.g., audio alternatives to CAPTCHAs.
 +
 
 
* Even captions for videos will probably be inaccessible. Separate methods of obtaining the information such as transcripts are needed.
 
* Even captions for videos will probably be inaccessible. Separate methods of obtaining the information such as transcripts are needed.
* Information needs to be concise. Many deafblind users will be using braille displays which give a single line of text that's 40 characters long.
+
* Information needs to be concise. Many deafblind users will be using Braille displays that give a single line of text that's 40 characters long.
  
 
== Dyslexia ==
 
== Dyslexia ==
  
* Contrast (too high can be a problem)
+
A too-high or too-low contrast can be a problem.  Other elements that can make things difficult for people with dyslexia: justified text; double-spacing after periods; long, unbroken blocks of text; serif fonts; italicized text.  ([http://uxmovement.com/content/6-surprising-bad-practices-that-hurt-dyslexic-users/ source])
* CAPTCHAs can be inaccessible, even with audio alternatives, due to visual and auditory "noise"
+
  
== Keyboard-only Users ==
+
== Keyboard-only users ==
  
* Make sure anything triggered usually by mouse movements (eg :hover attributes) which is needed for site use has a keyboard-accessible alternative.
+
* Make sure anything triggered by mouse movements (such as hover attributes) that's needed for site use has a keyboard-accessible alternative.
* Check tab order for everything, especially things which are AJAXey
+
* Check tab order for everything, especially things which are AJAXey.
* Potentially hideable alternative text for all images which are used for site navigation and control (e.g. the "tag/memory/etc." icons) for direct keyboard access. Note this is not the same as alt tags.
+
* There must be alternatives to places where one would need to control-click to select multiple elements of a list. For example, choosing tags, where the current keyboard alternative is to remember the names of your tags and type them in.
* Must have alternatives in places where you would usually control-click to select multiple elements off a drop-down list (e.g. choosing tags, where the keyboard alternative currently is to remember the names of your tags and type them in).
+
* Test with the [https://addons.mozilla.org/en-US/firefox/addon/879 mouseless browsing] Firefox addon.
  
== Low Vision ==
+
== Low vision ==
  
* Contrast (low is a problem)
+
* Too-low contrast is a problem.
* CAPTCHAs need audio equivalents
+
* The default font size should be reasonable.
* Default font size should be reasonable
+
* Robustness of layout to font size increases (command-+ / ctrl-+) must be tested in Internet Explorer, Firefox, Safari, Opera, and Chrome.
* Robustness of layout to font size increases (eg command-+/ctrl-+) must be tested.
+
* For those browsers that have the capability (Firefox 3 and all versions of Opera), page size increases -- scaling images as well as text -- must be tested.
** IE
+
* Alternate layouts with less visual "clutter"/"noise" may be needed for some people (equivalent to LJ's Lynx site scheme).
** Firefox
+
** Safari
+
** Opera
+
** Others?
+
* For those browsers that have the capability, page size increases - scaling images as well as text - must also be tested.
+
** Firefox3
+
** Beta versions of Safari?
+
** Others?
+
* Alternate layouts with less visual "clutter"/"noise" may be needed for some people (equivalent to LJ's Lynx site scheme)
+
  
 
== Mouse use problems ==
 
== Mouse use problems ==
Users who are able to use a mouse but have some difficulty with it. Keyboard equivalents are a solution to some in this group, but some in this group will have no ability to use a physical keyboard either - only an on-screen keyboard (again, requiring mousing) will be used.
+
 
 +
This refers to users who are able to use a mouse but have some difficulty with it. Keyboard equivalents are a solution to some users in this group, but others will have no ability to use a physical keyboard, either -- only an on-screen keyboard (again, requiring mousing) will be used.
  
 
* Mouse targets need to be as large as possible.
 
* Mouse targets need to be as large as possible.
* Minimise/eliminate use of any elements which require a mouse click-and-drag as this is most difficult for many users.
+
* Minimise/eliminate use of any elements that require clicking and dragging, as this is most difficult for many users.
 
* Remember [http://en.wikipedia.org/wiki/Fitt%27s_law Fitt's law].
 
* Remember [http://en.wikipedia.org/wiki/Fitt%27s_law Fitt's law].
  
== Neurological Problems ==
+
== Neurological problems ==
This category would include people on the autism spectrum, people with traumatic brain injuries, stroke survivors, and several other groups.
+
 
 +
This category includes people on the autism spectrum, people with traumatic brain injuries, stroke survivors, and several other groups.
  
 
* Anything on the page that moves (Flash, animated GIFs, etc.) can be sufficiently distracting to make the page unreadable.
 
* Anything on the page that moves (Flash, animated GIFs, etc.) can be sufficiently distracting to make the page unreadable.
* CAPTCHAs can be inaccessible, even with audio alternatives, due to visual and auditory "noise"
+
* [http://www.webaim.org/articles/evaluatingcognitive/ Evaluating cognitive usability].
  
== Resources ==
+
== Speech Recognition Users ==
  
 +
All of the issues listed for keyboard users apply to speech recognition users. See our list of [[Adaptive technology#Speech-recognition|speech recognition systems]].
 +
 +
== Tools to help test accessibility ==
 +
 +
=== Using commonly installed tools to test ===
 +
* [http://www.webaim.org/resources/opera/ Using Opera to test accessibility]
 +
 +
=== Freely available specialized testing tools ===
 
* [http://www.blackwidows.co.uk/resources/color-contrast-analyser.php Color Contrast Analyser] checks for contrast which is too high as well as contrast that is too low.
 
* [http://www.blackwidows.co.uk/resources/color-contrast-analyser.php Color Contrast Analyser] checks for contrast which is too high as well as contrast that is too low.
 +
* [http://www.webaim.org/articles/nvda/ using nVDA to evaluate screenreader usability]
 +
* [http://firefox.cita.uiuc.edu/ Firefox accessibility extension from UIUC]
 +
* [http://www.standards-schmandards.com/projects/fangs/ Fangs] Firefox screen reader emulator
 +
 +
=== Validators ===
 +
 +
* [http://validator.w3.org/check?uri=referer Markup validation W3C validator]
 +
* [http://www.w3.org/WAI/ER/tools/ Searchable list of evaluation tools] hosted at W3C
 +
* [http://wave.webaim.org/ Wave] and [http://wave.webaim.org/toolbar Wave toolbar]
 +
 +
== Testing external tools  for accessible integration ==
 +
 +
* [[JavaScript widget testing]]
  
 
[[Category:Accessibility]]
 
[[Category:Accessibility]]
 +
[[Category:Testing]]

Latest revision as of 14:19, 31 March 2013

Accessibility is not the same as usability, but it overlaps because a lot of disabilities make it harder to deal with stuff that doesn't have great usability to begin with.

Some accessibility features can be tested automatically with tools, but much of it comes down to human judgment. In fact, some accessible pages will fail markup validation because some validators don't understand accessibility markup such as WAI-ARIA. The W3C explains the limitations of validation tools and how to choose one.

Jim Thatcher's analysis of what accessibility testing is possible is a good start, but is not comprehensive. For example, it misses contrast levels appropriate for dyslexics, moving image problems that people with some neuro deficits have, everything important being keyboard-only accessible, and probably other things.

General

These things are generally good things to do and also have implications for disability accessibility.

  • Pages need to validate fully to whatever DTD they've specified. Note: If adding accessible markup stops a validation tool from working, it may be out-of-date. Make sure that the tool is up-to-date, but don't remove the accessible markup.
  • Pages should degrade gracefully in the absence of capabilities for Flash, JavaScript, images, CSS, and so forth. Whenever possible, the absence of those capabilities should give as rich a user experience as their presence.
  • Proper semantic markup should be used: headers for headings, ACRONYM and ABBR tags, EM/STRONG rather than I/B tags, and so forth. The product should never change user-entered HTML tags if avoidable, especially if doing so will move away from semantic toward formatting-based markup.
  • WAI-ARIA roles and landmarks should be used.

Blindness

This is the disability people usually think about when they discuss web accessibility, but it's important to remember it's not the only one.

  • Screen reader friendliness. Try very hard to get general screen reader users to do testing for us, rather than sighted people using screen readers which is a bad approximation. However, sighted developers and testers can still perform minimalist screen reader testing. See our list of screen readers.
  • Check tab order for everything, especially things which are AJAXey and therefore have changing tab order.

Relevant reading

Color Blindness

Things which are usually signalled to users through colour changes in interface elements must have some other signalling mechanism (such as change of image shape) in addition to colour.

Tools & Resources

Deafness

Any official videos put on the site (such as "how to use" screencasts) should have captions available.

Deafblindness

This disability is a double-whammy, as many of the solutions to problems faced by blind or deaf users rely on the other sense -- e.g., audio alternatives to CAPTCHAs.

  • Even captions for videos will probably be inaccessible. Separate methods of obtaining the information such as transcripts are needed.
  • Information needs to be concise. Many deafblind users will be using Braille displays that give a single line of text that's 40 characters long.

Dyslexia

A too-high or too-low contrast can be a problem. Other elements that can make things difficult for people with dyslexia: justified text; double-spacing after periods; long, unbroken blocks of text; serif fonts; italicized text. (source)

Keyboard-only users

  • Make sure anything triggered by mouse movements (such as hover attributes) that's needed for site use has a keyboard-accessible alternative.
  • Check tab order for everything, especially things which are AJAXey.
  • There must be alternatives to places where one would need to control-click to select multiple elements of a list. For example, choosing tags, where the current keyboard alternative is to remember the names of your tags and type them in.
  • Test with the mouseless browsing Firefox addon.

Low vision

  • Too-low contrast is a problem.
  • The default font size should be reasonable.
  • Robustness of layout to font size increases (command-+ / ctrl-+) must be tested in Internet Explorer, Firefox, Safari, Opera, and Chrome.
  • For those browsers that have the capability (Firefox 3 and all versions of Opera), page size increases -- scaling images as well as text -- must be tested.
  • Alternate layouts with less visual "clutter"/"noise" may be needed for some people (equivalent to LJ's Lynx site scheme).

Mouse use problems

This refers to users who are able to use a mouse but have some difficulty with it. Keyboard equivalents are a solution to some users in this group, but others will have no ability to use a physical keyboard, either -- only an on-screen keyboard (again, requiring mousing) will be used.

  • Mouse targets need to be as large as possible.
  • Minimise/eliminate use of any elements that require clicking and dragging, as this is most difficult for many users.
  • Remember Fitt's law.

Neurological problems

This category includes people on the autism spectrum, people with traumatic brain injuries, stroke survivors, and several other groups.

  • Anything on the page that moves (Flash, animated GIFs, etc.) can be sufficiently distracting to make the page unreadable.
  • Evaluating cognitive usability.

Speech Recognition Users

All of the issues listed for keyboard users apply to speech recognition users. See our list of speech recognition systems.

Tools to help test accessibility

Using commonly installed tools to test

Freely available specialized testing tools

Validators

Testing external tools for accessible integration