Project Overview

We were awarded a contract with a non-profit organization to develop a youth engagement application focused on providing and sharing strategies for inclusion for those with and without intellectual disabilities (ID). Before the initial release of the app, our team worked with the client to test the app in usability sessions.

Roles and Responsibilities

For usability testing, I created the test plan and script, moderated the sessions, and analyzed the data that resulted in suggestions for improvement. I received feedback and input from the client and UX team throughout this process.

Goals and Objectives

The goal of the app was to continue and further engage youth, with and without ID, and eventually engage with the general public with their non-profit mission.

This was the first round of usability testing, and testing focused on the following objectives:

• How to integrate the app into the users’ lifestyle for ease of engagement and continued use
• Confirm the ability to use the application as a user-friendly entry point
• Determine the memorability of the application that could potentially help reach audiences for future engagement

Methodology

Since the non-profit organization had a large volunteer base, our client recruited 6 participants from a wide range of ages and a mix with those with and without ID. As the first round of usability testing, this mixed audience group was well-suited for initial testing purposes.

Usability testing took place over zoom using a clickable prototype (note that at this point in the project, this was the MVP). During the 35 minute testing sessions, the participants were asked to complete a few tasks using the prototype, and the sessions were recorded for further analysis.

Along with qualitative observation of the sessions, quantitative metrics were gathered based on task completion, end of session survey responses, and Nielson’s Error Rating Scale. The data was synthesized using affinity diagramming and a rainbow spreadsheet.

Results

A summary of results was provided to the client along with data artifacts and suggestions for improvement. The summary specified how the three testing objectives were met during the usability sessions, and a listing of user confirmations was given.

Users had an overall positive experience using the application as demonstrated through observations and user quotes.

Future Directions

There is much opportunity for continued usability testing in terms of narrower audience groups and new app features. However, the project is a contract, so future testing would be dependent on time and resources.