Pilot Data on Accessibility of Online Tests

Introduction

WebAIM evaluated ten different Web-based testing sites to determine levels of accessibility based on Section 508 standards. When evaluating Web-based tests, it is necessary to distinguish between the content of the test itself and the format in which the test is presented. In summary, none of the ten passed accessibility standards mentioned above. Listed below are references for the ten sites and summaries of their accessibility evaluations.

Section 508 guidelines:

  • A - A text equivalent for every non-text element
  • G - Row and column headers shall be identified for data tables
  • H - Markup shall be used to associate data cells and header cells for data tables
  • I - Frames shall be titled with text that facilitates frame identification and navigation
  • N - When electronic forms are designed to be completed on-line, the form shall allow people using assistive technology to access the information, field elements, and functionality required for completion and submission of the form, including all directions and cues
  • O - A method shall be provided that permits users to skip repetitive navigation links
Pilot data for accessible online testing
Online tests
Failed 508 standards
Accessibility Grade Comments
Brainbench.com
A, N, O
C-F
  • Different tests had different levels of accessibility.
  • The HTML form elements - such as radio buttons, checkboxes, text input fields, and so on - do not have form labels (using the label tag) associated with them. Without form labels, people who use screen readers to access the tests may have difficulty answering test questions.
  • Brainbench's test structure template needs to be improved, but this is not the biggest problem with Brainbench's tests. The biggest problem is that many of the tests are inaccessible to users with disabilities on a conceptual level. For example, in one of Brainbench's sample tests, test takers are asked to identify U.S. cities by looking at photographs of the cities and then picking the city from a list of choices. Sighted users will have no problem with this type of question, but blind users will be completely unable to answer questions of this type. The challenge is to design test questions that do not disadvantage test takers with disabilities.
Hostedtest.com
A, N, O
F
  • The HTML form elements did not have labels.
  • Many of the questions rely on visual abilities. Several of the questions test visual pattern matching. For example, a question might present 5 drawings and ask, "which one of these figures is least like the others?" The only way to answer this question is to be able to see the drawings.
4tests.com
A, N, O
D
  • Form elements that are missing labels and that there is a reliance on visual representations - but there are additional problems on this site.
  • The tests are presented within a navigational framework that is inaccessible. Blind test takers would have to skip past the site navigation structure to reach the test questions. This is especially problematic in light of the fact that every test question is on its own page. Test takers must move past the inaccessible navigational elements for every single test question. This becomes a huge usability issue, because some users will need to spend at least as much time navigating the test Web site as they will actually taking the test.
  • These tests are not usable for individuals that navigate with keyboards due to the repetitive nature of the navigation. This would affect individuals that have limited dexterity or other types of motor control disabilities. This kind of distraction may have a detrimental effect on the users' ability to concentrate on the task of taking the test itself.
Exambuilder.com
A, G, H, N, O
D
  • The interface is almost entirely unusable to screen reader thus excluding individuals that are blind or low vision.
  • No headers for tables.
  • Inaccessible forms, and no alt text for images.
Electrical Contractor Network
A, N
B-
  • The quiz is still usable to screen readers.
  • Lack of labels and alt text makes completion more difficult.
Fire Careers
A, N
C
  • The test will not work if JavaScript is disabled.
  • Images are used to present content that will not be understood by someone that is blind.
W3schools
N, G, H
B
  • The interface is almost entirely unusable to screen reader thus excluding individuals that are blind or low vision.
  • No headers for tables.
  • Inaccessible forms, and no alt text for images.
ProveIt.com
A, I, M
D
  • Most of the information in this test is displayed in frames.
  • A lot of JavaScript dependent and frames dependent entities.
  • No doctype for HTML,
  • No labels for the forms
  • Inaccessible Java applets.
Pyschtests.com
A
C
  • A lot of missing alt text for images.
  • Fill in the blank questions may be hard because the user will need to read the answers in context of the question. (i.e. Jack and ____ went up the hill. a) Fred b) Jill etc.)
Questionmark.com
A
C
  • There are drag and drop questions that are completely inaccessible.
  • All form elements are missing labels.
  • There is a lot of JavaScript in the code that is unclear what it does. It may or may not affect the way that the content is displayed. If it does then there is a potential problem for screen readers.
  • No thought was given to accessibility.

Return to the Assessing assessment article

WebAIM is an initiative of:
Center for Persons with Disabilities (CPD) Utah State University