Detailed audit results

Numbers

142 test cases

13 tools tested

40% most issues found by a tool

We sometimes update specific test results for individual tools. See the changelog for full details. We last made updates on 13 April 2018.

What each result means

Positive result

  • Issue found The tool found the issue.
  • Issue found (paid) Only the paid version of the tool found the issue.

Mostly positive results

  • Warning only The tool noticed the issue, but only threw up a warning.
  • User to check The tool pointed out the potentially problematic bit of code and asked us to check ourselves whether it was an issue.

Neutral result

  • Noticed but not a fail The tool noticed this was potentially a problem, but didn’t see it as a full-scale issue or give a warning.

Negative results

  • Not found The tool didn’t find the issue.
Table of results
Test case Google Accessi­bility Developer Tools Tenon WAVE HTML_­Code­Sniffer aXe Asqa­tasun Sort­Site EIII AChecker Nu Html Checker Site­improve FAE AS­Lint
Content identified by location Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check Not found
Plain language is not used Not found Not found Not found Not found Not found Not found Issue found (paid) Not found Not found Not found Not found Not found Not found
Content is not in correct reading order in source code Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Content is not organised into well-defined groups or chunks, using headings, lists, and other visual mechanisms Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
First instance of abbreviation not expanded Not found Not found Not found Not found Not found Not found Issue found (paid) Not found Not found Not found Not found Not found Not found
Wide page forces users to scroll horizontally Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Colour alone is used to convey content Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check User to check
Small text does not have a contrast ratio of at least 4.5:1 so does not meet AA Issue found Not found Issue found Not found Issue found Issue found Issue found (paid) Not found Not found Not found Issue found Issue found Not found
Large text does not have a contrast ratio of at least 3:1 so does not meet AA Issue found Not found Issue found Not found Issue found Issue found Issue found (paid) Not found Not found Not found Issue found Not found Not found
Small text does not have a contrast ratio of at least 7:1 so does not meet AAA Issue found Not found Issue found Not found Issue found Issue found Issue found (paid) Not found Not found Not found Issue found Issue found Not found
Large text does not have a contrast ratio of at least 4.5:1 so does not meet AAA Issue found Not found Issue found Not found Issue found Issue found Issue found (paid) Not found Not found Not found Issue found Not found Not found
Focus not visible Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check Not found
Inadequate line height used Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
All caps text found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Warning only
Blink element found Not found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found User to check Warning only
Italics used on long sections of text Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Warning only
Marquee element found Not found Issue found Issue found Not found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found
Long lines of text Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Very small text found Not found Not found Warning only Not found Not found Not found Issue found Not found Not found Not found Not found Not found Issue found
Justified text found Not found Issue found Warning only Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Text language changed without required change in direction Not found Issue found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
html element has an empty lang attribute Issue found Issue found Not found Issue found Issue found Issue found Issue found Issue found Not found Not found Issue found Issue found Issue found
lang attribute not used to identify change of language Not found Not found Not found Not found Not found User to check Not found Not found Not found Not found Not found User to check Not found
Text language is in the wrong direction Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
html element has an invalid value in the lang attribute Not found Not found Not found Not found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found
lang attribute used to identify change of language, but with invalid value Not found Not found User to check Not found Issue found Issue found Issue found Not found Issue found Issue found Issue found Issue found Not found
html element is missing a lang attribute Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Issue found Issue found Issue found
html element has lang attribute set to wrong language Not found Not found Not found Not found Not found Issue found Not found Not found Not found Not found Not found Not found Not found
lang attribute used to identify change of language, but with wrong language Not found Not found Not found Not found Not found User to check Not found Not found Not found Not found Not found Not found Not found
Inappropriate page title Not found Not found Not found User to check Not found User to check Not found Not found User to check Not found Not found User to check Not found
Empty page title Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Issue found Issue found Issue found Issue found
Missing page title Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found
Empty heading Not found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Warning only Issue found Warning only Issue found
Missing H1 Not found Not found Warning only Issue found Not found Issue found Issue found Not found Not found Not found Issue found Warning only Issue found
Text formatting used instead of an actual heading Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Headings not structured in a hierarchical manner Not found Not found Warning only Issue found Issue found Issue found Not found Not found Issue found Not found Issue found Issue found Issue found
LI element with no parent Not found Issue found Not found Not found Issue found Not found Issue found Not found Issue found Issue found Not found User to check Not found
List not marked up as a list Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
DT or DD elements that are not contained within a DL element Not found Issue found Not found Not found Issue found Not found Issue found Not found Issue found Issue found Not found Not found Not found
Improperly nested lists Not found Issue found Not found Not found Issue found Not found Issue found Not found Issue found Issue found Not found User to check Not found
Table with column headers and double row headers Not found Not found User to check Issue found Not found User to check Issue found Not found Issue found Not found User to check Issue found Not found
Table has no scope attributes Not found Not found User to check Issue found Not found User to check Not found Not found Issue found Not found Not found Not found Not found
Table nested within table header Not found Issue found Not found Not found Not found Not found Issue found Not found Not found Not found Not found Not found Not found
Table nested within table Not found Issue found Not found Not found Not found Not found Issue found Not found Not found Not found Not found Not found Not found
Table has no table headings Issue found Warning only User to check User to check Issue found User to check Issue found Not found User to check Not found Not found Issue found Issue found
Table with inconsistent numbers of columns in rows Not found Not found Not found User to check Not found Not found Not found Not found Not found Issue found User to check Not found Not found
Table that only has TH elements in it Not found Issue found Not found Not found Issue found Not found Not found Not found Warning only Not found Not found Not found Not found
Table is missing a caption Not found Not found User to check User to check Not found User to check Not found Not found User to check Not found Issue found Warning only Issue found
Table used for layout Not found Warning only Noticed but not a fail Noticed but not a fail Not found User to check Issue found Not found User to check Not found Not found User to check Not found
Table has an empty table header Not found Issue found Issue found Not found Not found Not found Not found Not found Not found Not found Issue found Not found Not found
Table with some empty cells Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Image has alt and title that are different Not found Issue found Not found Not found Not found User to check Not found Not found Not found Not found Not found Not found Not found
Image with presentation role has non-empty alt Not found Issue found Not found Not found Not found Not found Issue found Not found Not found Not found Not found Not found Not found
Image with no alt attribute Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found
Background image that conveys information does not have a text alternative Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check
Image has empty alt and non-empty title Not found Issue found Not found Issue found Not found User to check Issue found Not found Not found Not found Issue found Not found Issue found
A distraction is present, an animated gif Not found Not found Not found Not found Not found Not found Issue found Not found Warning only Not found Not found User to check Not found
Image that conveys information has an empty alt attribute Not found Not found User to check User to check Not found User to check Not found Not found Warning only User to check User to check User to check User to check
Image that conveys information has inappropriate alt text Not found Not found User to check User to check Not found User to check Not found Not found Warning only User to check Not found User to check User to check
Image alt attribute contains image file name Not found Issue found Warning only User to check Not found User to check Issue found Not found Warning only User to check Issue found Issue found User to check
Image with partial text alternative Not found Not found User to check User to check Not found User to check Not found Not found User to check User to check Not found User to check User to check
Embedded video file is missing text alternative Not found Not found User to check User to check User to check Not found Not found Not found Not found Not found User to check User to check Issue found
Flashing content doesn't have warning Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Embedded audio file is missing text alternative Not found Not found User to check User to check User to check Not found Not found Not found Not found Not found User to check Issue found Issue found
Image link with no alternative text Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Issue found Not found Issue found Issue found Issue found
Link to javascript, invalid hypertext reference Not found Issue found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check
Uninformative link text Not found Issue found Warning only User to check Not found User to check Issue found Not found Warning only Not found Issue found User to check Not found
Link launches new window with no warning Not found Not found Not found User to check Not found User to check Issue found (paid) Not found Not found Not found Not found Not found Warning only
Links not separated by printable characters Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Link text with identical title Not found Issue found Warning only Not found Not found Issue found Not found Not found Not found Not found Not found Not found Not found
Links to a sound file, no transcript Not found Not found Warning only Not found Not found Not found Not found Not found Warning only Not found Not found Not found Not found
Identifying links by colour alone Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check Not found
Link to PDF does not include information on file format and file size Not found Not found Warning only Not found Not found User to check Not found Not found Not found Not found Not found Not found Not found
Link to #, invalid hypertext reference Not found Issue found Not found Not found Issue found Not found Not found Not found Not found Not found Not found Not found User to check
Blank link text Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Not found Issue found Issue found
Links with the same text go to different pages Not found Not found Not found Not found Not found User to check Not found Not found Not found Not found Issue found Warning only Not found
Link text does not make sense out of context Issue found Not found Not found Not found Not found User to check Not found Not found Warning only Not found Not found User to check Not found
Adjacent links going to the same destination Not found Not found Warning only Not found Not found Not found Issue found Not found Not found Not found Issue found Not found Not found
Link contains only a full stop Issue found Not found Not found User to check Not found Issue found Not found Not found Warning only Not found Not found User to check Not found
Image link alt text repeats text in the link Not found Not found Warning only Not found Issue found User to check Issue found Not found Not found Not found Issue found Not found Not found
Link not clearly identifiable and distinguishable from surrounding text Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Issue found Not found Not found
Link to a multimedia file, no transcript Not found Not found Warning only Not found Not found Not found Not found Not found Warning only Not found Not found Not found Not found
Non-specific link text Issue found Issue found Warning only User to check Not found Issue found Issue found Not found Warning only Not found Issue found User to check Issue found
Link to an image, no text alternative Not found Issue found Not found Not found Not found Not found Not found Issue found Not found Not found Not found Not found Not found
Image button has no alt attribute Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found
Empty button Issue found Issue found Issue found Issue found Issue found Not found Issue found Issue found Not found Not found Not found Issue found Noticed but not a fail
Uninformative alt attribute value on image button Not found Issue found User to check User to check Not found User to check Not found Not found Warning only Not found Not found Not found User to check
Empty alt attribute on image button Not found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found
Errors identified by colour only Not found Not found Not found User to check Not found Not found Not found Not found Warning only Not found Not found User to check User to check
Labels missing when they would look clumsy for some form controls Not found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Issue found Issue found Issue found
Error messages - no suggestion for corrections given, e.g. required format Not found Not found Not found Not found Not found User to check Not found Not found Not found Not found Not found User to check Not found
Left aligned form labels with too much white space Not found Not found Not found Not found Not found User to check Not found Not found Warning only Not found Not found Not found Not found
Group of radio buttons not enclosed in a fieldset Not found Not found Warning only Not found Issue found User to check Issue found Not found Not found Not found Not found Issue found Issue found
Form element has no label Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Issue found Issue found Issue found
Fieldset without a legend Not found Not found Warning only Issue found Not found Issue found Not found Issue found Not found Not found Not found Issue found Not found
Empty legend Not found Not found Not found Issue found Not found Issue found Not found Issue found Not found Not found Not found Issue found Noticed but not a fail
Label element with for= attribute but not matching id= attribute of form control Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Issue found Issue found Issue found
Group of check boxes not enclosed in a fieldset Not found Not found Warning only Not found Issue found User to check Not found Not found Not found Not found Not found Not found Issue found
Empty label found Not found Issue found Issue found Not found Issue found User to check Issue found Issue found Issue found Not found Issue found Issue found Issue found
Two unique labels, but identical for= attributes Not found Not found Issue found Not found Issue found Not found Not found Not found Issue found Not found Not found Not found Not found
Errors identified with a poor colour contrast Warning only Not found Issue found Issue found Issue found Issue found Issue found Not found Not found Not found Issue found Issue found Issue found
Non-unique field label found Not found Issue found Not found Not found Not found Not found Issue found Issue found Not found Not found Not found Issue found Not found
Missing labels in checkboxes Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Issue found Issue found Issue found
Field hint not associated with input Not found Not found Not found Not found Not found User to check Not found Not found Not found Not found Not found Not found Not found
Placeholder no label Issue found Issue found Issue found Issue found Issue found Issue found Issue found Not found Issue found Not found Issue found Issue found Issue found
Errors are not identified Not found Not found Not found User to check Not found User to check Not found Not found Warning only Not found Not found User to check Not found
Form control that changes context without warning Not found Not found Not found User to check Not found User to check Not found Not found Not found Not found Not found User to check Not found
Inadequately-sized clickable targets found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Alert shows for a short time Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check User to check Not found
Lightbox - close button doesn't receive focus Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Issue found Not found
Focus order in wrong order Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check User to check Not found
Tabindex greater than 0 Issue found Issue found Warning only Not found Issue found Not found Not found Not found Not found Not found User to check Not found Warning only
Keyboard focus is not indicated visually Not found Not found Not found Not found Not found User to check Issue found Not found Not found Not found Issue found User to check Issue found
Keyboard focus assigned to a non focusable element using tabindex=0 Not found Not found User to check Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Concertina items don't get keyboard focus Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Issue found Not found
Keyboard trap Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check Not found
Dropdown navigation - only the top level items receive focus Not found Not found Not found Not found Not found User to check Not found Not found Not found Not found Not found Not found Not found
Lightbox - ESC key doesn't close the lightbox Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Link with a role=button does not work with space bar Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check User to check Issue found
Tooltips don't receive keyboard focus Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check Not found
Accesskey attribute used Not found Issue found Warning only Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Lightbox - focus is not moved immediately to lightbox Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Lightbox - focus is not retained within the lightbox Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Fake button is not keyboard accessible Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Issue found Not found
iframe is missing a title attribute Not found Issue found Not found Issue found Issue found Issue found Issue found Issue found Not found Not found Issue found Issue found Issue found
iframe title attribute does not describe the content or purpose of the iframe Not found Not found Not found User to check Not found User to check Not found Not found Not found Not found Not found Not found Not found
Content is not readable and functional when text is increased Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check Not found
Non-decorative content inserted using CSS Not found Not found Not found Not found Not found Not found Issue found Not found Not found Not found Not found Not found Not found
visibility:hidden used to visually hide content when it should be available to screenreader Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
display:none used to visually hide content when it should be available to screenreader Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Page zoom - boxes that don't expand with the text Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check Not found
Duplicate id Not found Issue found Not found Issue found Issue found Not found Issue found Issue found Issue found Issue found Issue found Not found Issue found
Article element used to mark-up an element that's not an article/blog post etc. Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found User to check Not found Not found
Empty paragraph Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Noticed but not a fail
Deprecated center element Not found Not found Not found Issue found Not found Issue found Issue found Not found Issue found Issue found Issue found Not found Warning only
Invalid ARIA role names Issue found Not found Not found Not found Issue found Not found Issue found Not found Not found Issue found Issue found Issue found Issue found
Object not embedded accessibly - wmode parameter not set to window Not found Issue found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Spacer image found Not found Not found Noticed but not a fail Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Inline style adds colour Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Start and close tags don't match Not found Not found Not found Not found Not found Not found Issue found Not found Issue found Issue found Not found Not found Not found
PRE element without CODE element inside it Not found Issue found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found Not found
Deprecated font element Not found Not found Not found Issue found Not found Issue found Issue found Not found Issue found Issue found Issue found Not found Warning only

Changelog

  1. Re-tested and updated 19 results on WAVE
  2. Changed HTML_CodeSniffer's warnings to manual checks
  3. Re-tested and updated 7 results on Tenon
  4. Added new tool: ASLint
  5. Re-interpreted some results due to removal of less helpful categories
  6. Re-tested and updated 25 results on Asqatasun
  7. Re-tested and updated 26 results on SortSite
  8. Re-tested and updated 3 results on aXe (with experimental features) and improved one test
  9. Added new tool: FAE
  10. Added new tool: Siteimprove
  11. Re-tested and updated 11 results on Nu Html Checker
  12. Re-tested and updated 30 results on HTML_CodeSniffer
  13. Improved 8 tests, re-tested those in all tools and updated results
  14. Fixed broken examples, re-tested and updated 9 results on aXe
  15. Re-tested and updated 2 results on Asqatasun
  16. Re-tested 8 and updated 6 results on WAVE
  17. First set of results

Want more detail?

Have a look at the raw data and analysis.