Project Lead: Ashley Solloway
UX Researcher: Timothy Nichols
Research Analyst: Mariah Coolridge
Testing Moderator: Ellis Skillman
January 18, 2022
Table of Contents
Executive Summary
Goals
Methodology
- Outreach & Screening
- Participant Profiles
- Testing Setup, Moderation & Post-Test Questions
Results
- Overall Concept
- Category 1
- Category 2
Bugs & Issues
Recommendations & Action Items
Disclaimer
Appendix
- Documentation
- Media
- Notable Quotes
Executive Summary
Founded in 2015, Traqr Fitness™ is a video-intensive workout program to help achieve fitness goals. It offers a variety of different workouts for every experience levels. Traqr's new workout program "Fitbeez," which targets only women, was tested under two categories by taking different elements into account.
Some important factors that define usability are:
- Ease of use
- Effectiveness
- Being results-oriented
- Ease of implementation into daily routine
Because Fitbeez targets women between the ages of 18-35 years old, the focus group was divided into two categories.
- The majority of participants understood the general premise of Fitbeez
- 20 of the 100 test participants found it difficult to implement Fitbeez' intense program into their daily lives
- The online trainer aspect consistently received positive feedback from users
- 50 of the 100 test participants stated that Fitbeez is what they were expecting from Traqr Fitness
This research report includes the details of how we conducted our research, the results we found, and a brief list of recommended changes in order to improve Fitbeez and to make it more usable.
72%
of participants were able to successfully complete all tasks.
54%
of participants enjoyed this specific experience.
68%
of participants had difficulty using this specific aspect of the product.
28%
of participants were unable to complete all tasks.
33%
of participants complained about this specific experience.
53%
of participants would continue using this product.
Goals
Reveal points of friction and confusing experiences.
Pointing out the confusing experiences is a crucial element for Fitbeez's future development and overall success. If it is not making users' lives easier, it would not be considered a success for Traqr Fitness.
Identify bugs and issues with the product.
Certain Fitbeez issues were identified during testing. Understanding these possible issues in advance will help the product team come up with the best solutions and take necessary actions before it is too late. It also gives Traqr team a better idea how the new service is being perceived by its beta users.
Test product concept with target audience.
Traqr Fitness was highly used by women who are searching for a special fitness program that is focused on them. Testing Fitbeez with this defined target audience gave us a chance to receive immediate feedback and to understand the needs of this audience better.
Methodology
Outreach & Screening
The Fitbeez test group was chosen in coordination with MicFit Fitness Center. Testing was announced in the center with brochures and through social media. Participants who filled out a form and mentioned an interest to attend were then chosen by Traqr Marketing Team depending on their age, education, interest in videos and apps and overall fitness background.
Channels Used:
- Social media (Facebook & Instagram)
- MicFit Fitness Center welcome desk
Screening Criteria:
- Participants who are between the ages of 18-35
- 50 participants with a strong background in fitness (who work out at least twice a week for the past 2 years)
- 50 participants with a weak background in fitness (who work out once in two weeks or less over the past 2 years)
- Women who use apps daily
- College students, graduates or higher education level
Participant Profiles
Age | Gender | Education | Income | |
|---|---|---|---|---|
Heather Scrum | 20 | F | Bachelors (in school) | N/A |
Bailey Days | 34 | F | Masters (in school) | $250,000 |
Joy Planso | 30 | F | Bachelors (graduate) | $100,000 |
Cathleen Lulli | 28 | F | Bachelors (graduate) | $200,000 |
Mercedes Silvia | 19 | F | Bachelors (in school) | N/A |
Ashleen Damio | 25 | F | Bachelors (graduate) | $80,000 |
Patricia Gonzales | 32 | F | Masters (graduate) | $180,000 |
Samantha Hay | 23 | F | Bachelors (graduate) | $70,000 |
Blair James | 27 | F | Bachelors (graduate) | $80,000 |
Sara Decjvicken | 21 | F | Bachelors (in school) | N/A |
Age Distribution
Fitbeez Target Group
20% 18-20
30% 21-25
30% 26-30
20% 31-35
Testing Setup, Moderation & Post-Test Questions
1. Introduction
Participants were told to complete three step workout process. After each step is completed they received an award (points) on their Traqr app and they were able to move on to the next steps.
2. Tasks
Create an account and login.
- Edit your profile.
Go to Fitbeez under Traqr app
- Complete the first video, follow the instructions and move to the next videos
3. Post-Test Questions
How would you describe Fitbeez to someone?
What was your favorite aspect of Fitbeez?
What was the most confusing part of the test?
Would you continue using this product?
Would you recommend this product to a friend or colleague?
Results
Data and feedback were collected and analyzed after tests were completed by the participants. The test was followed by two different categories and the categorization was made depending on the participants' fitness background. Category 1 includes women who have a strong background whereas Category 2 shows the performance of women with weaker fitness achievements. \
- Overall Concept
- Category 1
- Category 2
Overall Concept
83%
of participants understood the core premise and overall concept of this product.54%
of participants successfully completed all tasks related to the overall concept of the product.72%
of participants enjoyed the concept and the overall experience of using the product.24%
of participants experienced difficulty using this product.THE GOOD
Majority of the participants found Fitbeez easy to use and beneficial for their workout process.
"Fitbeez was exactly what I was looking for. It is easy to understand and full of amazing workout routines."
- Heather, 20
THE BAD
24% of the participants didn't find Fitbeez easy to implement into their daily lives.
"It has nice workout programs, but they are very difficult and requires continuous usage. I can't see myself following such a routine."
- Patricia, 32
Category 1
83%
of participants understood the core premise of the first category for this product.
54%
of participants were unable to successfully complete all tasks related to the first category.
72%
of participants enjoyed the overall experience related to the first category using the product.
24%
of participants had difficulty using certain functions related to the first category for this product.
THE GOOD
70% of participants mentioned their interest in using the product.
"I can't wait to use Fitbeez. It will be so much fun to work out with friends. They also have a great taste in music to pump you up."
- Sara, 21
THE BAD
26% of the participants thought that Fitbeez is too difficult to follow. A few participants requested a level-based workout programs.
"It would be of course, great to follow such a method, but I think it is too difficult for beginners like me. I wish there were different levels."
- Bailey, 34
Category 2
83%
of participants understood the core premise of the second category for this product.
54%
of participants were unable to successfully complete all tasks related to the second category.
THE GOOD
76% of participants mentioned they had a really good time using the product.
"Wow, great videos with amazing music. Fitbeez is going to make me fit."
- Mercedes, 19
THE BAD
50% of participants couldn't complete tasks that were required in the second category.
"I was very tired by the end of the first half. I found the programs very difficult and had to stop in the middle."
- Cathleen, 28
72%
of participants enjoyed the overall experience related to the second category using the product.
24%
of participants had difficulty using certain functions related to the second category for this product.
Bugs & Issues
List any bugs or technical issues participants encountered during the usability test. You can also include screen grabs of the issues in this section or in the appendix.
GENERAL
One of the workout videos was not displaying properly.
An error occurred when the user from the Category 1 tried to complete a workout routine.
Background music was not playing at all times.
Collaboration didn't function under team workout videos.
CATEGORY 1
An error occured while playing the beginning video and it sent the user to the beginning of the process without saving the steps accomplished.
The award points due to accomplishments were not matched.
CATEGORY 2
On video 5 (workout daily), background music was not playing and it caused users to be confused about the overall video function.
Steps of accomplishment were not saved automatically.
Team work out function and live collaboration weren't working properly.
Recommendations & Action Items
GENERAL
The overall video quality should be improved according to the user feedback.
Video background music quality should be overseen and multiple performance tests need to be made.
User surveys should be provided after each accomplishment and users should be provided with professional fitness feedback from their personal video-trainers.
CATEGORY 1
When completing the first step, participants skipped some workout moves faster than they should have and they didn't find the first step challenging enough.
Video trainer feature of the product was especially confusing for participants because they weren't able to follow the instructions.
Participants enjoyed the music aspect of the product. It should be considered to add this feature on other videos as well.
CATEGORY 2
Participants couldn't finish all three steps. They found the second video extremely difficult and overwhelming.
There were some inconsistencies between video trainer and instructions to follow on the app.
First step was found very enjoyable and motivating. For the users that have similar background to the people in Category 2, similar video style should be chosen.
Disclaimer
Some important factors that affected the results of the usability test:
The sample size may not be representative of all people that may use the product.
While moderation began with a set agenda, questions and tasks administered varied from participant to participant.
Human error and misinterpretations of qualitative feedback affected the results to slight but varying degrees.
A series of common product bugs and errors occurred (listed in section above).
Appendix
Media
Fitness News Magazine, "New Personal Helper to Slim Down"
Fit Life, "The way you work out is about to change"
MicFit Monthly, "Join the fitness revolution"
Notable Quotes
"I can't wait to use Fitbeez. It will be so much fun to work out with friends. They also have a great taste in music to pump you up."
"Wow, great videos with amazing music. Fitbeez is going to make me fit."
"Fitbeez was exactly what I was looking for. It is easy to understand and full of amazing workout routines."