Prototyping & Usability Testing: Formative Testing

Colum W. Cross

The Tasks

  1. Go to the existing chat with Bob.
  2. Send Bob a message.
  3. Send Bob an emoji.
  4. Go back to main menu.
  5. Search for Bob.
  6. Update your status.
  7. Call Bob.
  8. Put the call on mute.
  9. Put the call on speakerphone.
  10. End the call.

The tasks were given with little to no further instructions. If the subject became to confused on how to complete the task, assistance was provided.

Screens Used

The interface used was a mock version of the itel it5020:

A 3 by 5 inch index card which has a 2.4 inch by 3 inch space left blank for the 'screens.' On the other half, buttons have been drawn on and labeled by a black ballpoint pen. The button scheme mimics that of the itel it5020.

These were the screens shown to the subjects:

A plethora of screens different screens showing the design of the new WhatsApp A plethora of screens different screens showing the design of the new WhatsApp

Subject 1

All tasks were completed relatively quickly, with the exception of Task 6. This was due to an iconographical problem in which subjects did not associate a caret ">" with the use of an arrow in the menu selection area. The icons were changed to the current version.

The subject liked the use of space, and had no gripes with the prototype.

Subject 2

The speed of task completetion was quite low, and confusion of the subject was high. This was due to the subject's lack of knowledge of feature phones.

The subject liked the overall app. Something the subject did not like was the system buttons; specifically the "send" and "end" buttons. The subject did not understand their purpose and said they got in the way. Nothing can be done to fix this, as it is a hardware issue.

Subject 3

All tasks were completed relatively quickly, with the exception of Task 6. This was due to an iconographical problem. The subject did not understand that there were more menus, or what the arrow represented. The subject stated that this could be because of no prior familiarity with WhatsApp.

The subject liked the app in general, saying that it was a good design for the platform. The subject said any problems he had with the prototype were simply due to his lack of knowledge of WhatsApp or feature phones in general.