For the evaluation of our design, we will be making use of usability testing. By making use of this method, we can identify the usability issues that our end users could be faced with. Usually, usability tests need several participants, but since we only have access to one possible end-user and their caretaker we will only perform the usability testing on them. 

We do not have a fully functioning prototype of the physical products of our design, therefore The testing will be split up into two sections. The understanding of and interaction with the design and the testing of the user-interface of the accompanying app. The use of our products will mainly be controlled and directed by the App that comes with the physical products, therefore testing of the app is an important part of the usability testing. By testing the user interface of our product, we could see whether the end-user and his or her caretaker is able to interact with the product naturally as well as if the design is comprehensible.

 

Research question

To what extent is our design user-friendly for our end-user and their caretakers?

 

Subquestions 

To what extent is the interface of the app clear for the caretaker?

To what extent is the notification of the app clear for the end-users?

To what extent is the functionality of the design clear for the end-users?

​

The plan

To start off, we would give our participants a short introduction. In the introduction, we shortly explain the product to them and explain that we will ask them to complete several tasks/questions. We will make it very clear that they are not forced to complete these tasks and that they can leave at any moment. After this short introduction, we will be asking our participants to fill out an informed consent form. After this, we will first take the caretaker to a separate room. In this room, the caretaker will be handed a phone with the application installed on it. We then start with the tasks and questions from the list below.  While our participant is performing the tasks, we will be observing and taking notes. Once the caretaker has completed all tasks we ask him/her if she has any general feedback, thank him/her for their participation, and let them out of the room. We then invite the end-user and go through the same steps with him/her.

 

Analysis

By making use of observations, we could see whether the participant struggles with a task and which task(s).  Yet, the main disadvantage of observations is that it leaves room for interpretation for the observers and notetakers. Therefore we will also monitor how fast each task is completed and whether the participant needs help. If the participant needed help the task is an automatic fail. Each question has a time range in which the participant should be able to complete the task if the participant completes the task outside of the time range it is a mark. For each question that is a failure, the interface or design of that part should be fully reworked. For each question that receives a mark, the interface or design should be further clarified.   

 

Testing the interface  (tested with the caretaker)

1. Setting a new reminder

• Enter “wassen” as the name of the reminder                                  max 30sec

• Set the location as your current location                                          max 30sec

• Set the date of 13th of April                                                               max 45sec

• Set the starting time at 10 AM                                                           max 30sec

• Set the end time at 2 PM                                                                    max 30sec

• Set the reminder to repeat weekly                                                    max 30sec

• Label the reminder to the NFC tag “thuis”                                      max 40sec

• Put the following steps of the task into the reminder.

               a. ”Open Wasmachine”                                                              max 90sec

               b. “Stop kleding in wasmachine”                                              max 90sec

               c. “Zet de wasmachine aan”                                                      max 90sec

• Save the new reminder                                                                       max 20sec

2. Change the notification sound of the reminder “wassen”                 max 60sec

3. Change the snooze timer of the reminder “wassen”                          max 40sec

4. Go to the tasks of Sunday the seventh of December

• How many tasks were completed on that day?

• Was there a task not completed? and if so Which task? 

 

Testing the notification (tested with the end-user)

1. Identify the notification of the app

   1. What is the task that you are supposed to do?                        max 60sec

   2. Where is the task?                                                                       max 60sec

   3. How long will the task take?                                                       max 60sec

2. Scan the tag 

   1. Walk to the correct place                                                            max 90sec

   2. scan the tag correctly                                                                  max 40sec

3. Snooze the incoming notification                                                     max 50sec

 

Testing the design (tested with the end-user)

1. (Show a picture of several designs) which two belong together?

2. What does the text mean?

3. What are you supposed to do with this product?

4. Where are you supposed to scan the phone?