Usability Testing Script
Prototype:
Access steps:
go to https://www.figma.com
Log In
Account Name: SARusertester@gmail.com
Password: provide via speech
Access Wireframe Sketches - Page 1
<Video recording of you passing the scenario> Prototyping tools and prototype versions often change, and a recording can serve a good reference for the team even if the prototype for some reason becomes unavailable.
1. Intro
Greeting:
Hello, <user’s name>!
My name is <your name>, and I am a Human Computer Interaction master’s student at IUPUI. I am part of a graduate school team that is collaborating with the company Gravity drive for our Capstone Project.
Introduce other people on call
Thank you for joining this session! How are you?
<Small talk about the weather, the city where a user is from, or plans for the weekend>
Explaining the goal:
<User’s name>, you were contacted because we believe your feedback can help make a Search and Rescue operations platform better and identify issues with it in the early stages.
The objective of the platform is to enable teams in the SAR space to have one desktop platform where units can run/manage missions, keep better track of their member’s overall education and performance needs.
Today we will be going through the education, performance, and resource side of the platform.
Your feedback on the prototype will help us figure out how convenient, useful, and clear it is.
Planned activities (for the case of testing a prototype):
If this user has not been previously interviewed:
The session will consist of two parts. We’ll have a mini-interview, and then I’ll ask you to perform some actions with the prototype of the application.
If this user has been previously interviewed:
We will start by asking you to perform actions with the prototype of the application. The prototype you will be interacting with is a low fidelity version. This means that the prototype is not fully detailed and not everything works in it. As a result, I’ll provide you with a scenario and then ask you to perform specific tasks.
“Rules of the game”:
<User’s name>, for the sake of the accuracy of this experiment, I won’t be able to prompt you and I only will answer your questions after the session. It might seem like an exam, but it isn’t.
Our goal is to test the application, not you. There are no wrong and right answers today — all feedback is welcome. Please think aloud as you go through the process.
Permission to record:
We would like to make a video recording of this testing session. It will be a backup in case we need to recall something.
It’s just for internal use—your information will remain anonymous and confidential. Do we have your permission to record?
If the interviewee approves: Great! Thank you! Now let’s start the mini-interview.
<aside> ⚠️ At this point, do not forget to press the “Record” button.
</aside>
If the interviewee refuses (it’s unlikely if you warned about recording beforehand—in the invitation): Okay, no worries. Then we’ll just make some handwritten notes.
2. Mini-interview
<aside> 👉 If we are interviewing someone that we have interviewed previously, this can be ignored. </aside>
What is your experience with search and rescue?
How often do you tend to participate in Search and Rescue operations?
How do you keep track of your search and rescue certifications/trainings?
How often do you go to training or get certifications related to SAR?
When was the last time you had SAR training?
Do you recognize or evaluate people’s performance on SAR missions?
If yes, how often do you do that?
Previous experience
Are there any apps/websites that you use for SAR training?
What about teammate evaluations?
What do you find useful in <sites/apps mentioned before>?
What are your main issues with <sites/apps mentioned before>?
Screen sharing
Thank you for your detailed answers and insights. Now we can switch to the prototype.
Please start sharing your screen.
<aside> ⚠️ Make sure a user doesn’t start doing anything with the prototype before you see their screen. Try to give the prototype link after they start sharing.
</aside>
3. Tasks with a prototype
******************OPTIONAL: Before we start with the scenarios, can you go through what you see on the whole page and what you think that item would do?
If the user misses a key icon or piece point it out, but do not clarify what that item would do
Scenario 1
As a volunteer in Search and Rescue (SAR), you have expressed your interest in learning about drone operations to your Incident Commander. After discussing it with them, the decision has been made to include this course in your learning plan. This course will help you develop your skills in emergency response using drones, and you will follow an approved skill path template to upskill your proficiency.
Task
Go to the learning plan page and view your lesson plan.
Add the suggested course to your list.
Review the course details and purchase the course
After purchasing the course, add it to your calendar and set an alert to ensure you don't miss any important sessions.
Scenario 1.2
You recently got very into helicopters and are wondering if any courses that can help you learn more about operating them.
Task:
Go to the course catalog page to browse the available courses.
Find a way to filter your courses to only show helicopter operations courses that are for novices, in-person, and cost up to $100
Bookmark the course to your learning for future reference.
Scenario 1.3
When first opening the application, you remember you will have training on the 5th of April from 6 am to 9 pm.
Task
Setup your training on the calendar.
You are also going on vacation during the week of April 15th – April 21st, as a result, you will not be able to go on any SAR missions. You will want to keep this vacation private.
Setup your vacation on the calendar
Scenario 2
After a mission, volunteers are able to rate the performance of people on their team.
You volunteered on the Bean Blossom mission last week. You would like to complete a performance evaluation for your teammate and also see how your teammate rated your performance.
Kyle Smith’s performance on the Bean Blossom mission was outstanding. He was able to apply a tourniquet correctly to the missing person that was found. Kyle showed excellent skills with first aid.
Task
Complete your teammates evaluation from your completed mission
Endorse their skill in First Aid
Check your evaluation from the completed mission
Scenario 3
A month passes by after the Bean Blossom mission. After watching a random first aid video, you realized that you forgot to endorse your coworker Margaret Wheeler’s First Aid abilities after her exemplary mission performance.
Task
Commend Margaret Wheeler’s First Aid abilities.
What are Margaret’s main roles in Search and Rescue?
What is Margaret’s normal work position?
Scenario 3.1
You just got back home from some much-needed vacation in the Bermuda Triangle. You were able to rest up so well that you forgot whether you have any credentials that are expiring soon
Task
Find the next credential that is expiring for you. What is it?
What course would renew that certificate?
You recently completed a CPR course on April 4th,2023 and have been given a paper certificate. Upload this new certificate.
Scenario 4
You have just watched a great video on rope tying. You want to share this resource with your teammates.
Task
Add the rope tying video to share with your teammates
You also want to watch a video focused on survival specifically for people who are lost.
Task
Search for survival resources
Filter search results to 3.5 stars
Watch the highest matching search result video
Scenario 5
You are now leading your Unit as an Incident Commander. You know that people in the unit can have issues with keeping their credentials up to date, so you want to review where your unit stands as a whole.
Task
Review your unit’s overall status regarding expirations and send reminders to those with expirations coming soon.
If you wanted to compare how good two people are in your unit, where would you expect to see that?
4. Feedback questions
Please rate the following features/pages on a scale of 1-5, with 1 being strongly dissatisfied and 5 being strongly satisfied:
Navigating the platform
Answer:
Thoughts on it?
Course Catalog
Answer:
Any comments?
Were you able to find relevant information to make a decision on enrolling in a Course?
Learning Plan
Answer
Thoughts on it?
Did it help you understand your training goals?
Performance Radar Chart
Answer
Thoughts on it?
What would you want to track regarding an individual's SAR performance?
Calendar
Answer
Thoughts on it?
Resource Library
Answer
Thoughts on it?
Can you think of any other way/idea you’d like to see the additional training materials or learn from the experiences of other Search and rescue leaders?
Directory
Answer:
Thoughts on it?
User Profile Page
Answer:
Thoughts on it?
Any other user information that would be helpful to know
If you were an Incident commander, what other details about your unit would you like to know?
What items would be beneficial to know the expiration date for?
What is your overal value of the product?
Does anyone else on the team have questions?
Is there anything else that you would like to share?
Extra Questions if needed:
How was your experience navigating the platform?
Was the course catalog feature easy to comprehend?
Were you able to find relevant information to make a decision on enrolling in a Course?
Did the Learning plan provide you with a clear understanding of your training goals and career path?
Was the Calendar easy to use and did it provide you with a clear view of your schedule?
Was the Radar chart for skill assessment helpful? Did you find it difficult to read the Radar chart?
Was Resource Library helpful in finding the additional training materials?
What are your thoughts on the information provided in the user profile section?
5. Outro
Words of gratitude
Congratulations! We’ve covered all the tasks.
Thank you for sharing your insights. It was especially valuable to learn about <something concrete> and understand better how you <some finding from the testing>.
Next steps
The team will use the gathered information to improve the application and will take it into account in further developments.
Feel free to reach out to us if you recall something or come up with additional ideas.
Goodbye
Thank you! It was a pleasure talking with you.
Have a good one!