How often should I run user tests?

Ideally, user testing should be done with prototypes before your product launches. You should always be testing though. No website or app is perfect, but every one of them should constantly be evolving and looking to better itself.

Those tiny tweaks that lead to more conversions compound each other over time. It doesn’t take a lot to make a big shift.

How long should I run my test?

It depends on what you are testing for. Our general guideline is 1-2 minutes per task. If the task is easy or fast to complete use 1 minute. If the task is more difficult 2 minutes. Then add 2 minutes to your final calculation.

Below are examples of video lengths and what kind of user testing videos you would get with each one.

1-3 minute tests
1-2 minute tests are great for gathering information on first impressions or to answer a quick question about your website. Such as, does your value prop headline articulate who you are and what you do clearly? Do people understand what you want them to do on the website? What is the first thing you would click on if you landed on this page and why? Use 3 minutes when you want them to make one simple action in addition to a first impression.

4-10 minutes tests:
We find that most videos fit within the 6-8 minute range. This is enough time to browse a website, find an item to buy, and go through a check out process. If your test has just 3 questions a 4-5 minute test will likely suffice. However, if you want someone to go through your website, look for several items, and then complete a task then a 6-8 minute test is usually best.

12 + minute videos:
This is great for SAAS or app onboarding processes which take longer and have more steps. Some of which can take considerable time to figure out, fill forms, and complete the process.

For example:
You’re able to get customers to sign up, but they cant understand how to do the tasks in the app and thus aren’t converting to paid accounts. Depending on what how complex and how many steps are required to do the process in your app, would depend on the length of the video. If it takes 5-7 minutes or less for a user to complete the process outlined in your tasks a 12 minute test should suffice. If it takes 8 or more minutes complete, choose 15-20 minutes for your test.

How do I know how many users to add to my test?

As soon as you collect intel from a single test user, your insights shoot up and you have already learned almost a third of all there is to know about the usability.

When you test the second user, you will discover that this person does some of the same things.

Each new user adds a bit more insight than the last, but you will keep seeing the same things again and again. Thus, learning less and less new insights each added video.

We recommend 3 users for our budget customers.
Three users is enough to get an idea of the diversity in user behavior and insight into what’s unique and what can be generalized.

We recommend 5 users for most people.
Five is the best return on investment. Testing costs increase with each additional user, yet the number of findings quickly reaches the point of diminishing returns. Have a bigger budget? YAY! Spend it on more tests, not more users in each test.

We recommend 9 users when you are looking for as much feedback as possible.
You would need at least 15 users to catch 100% of the usability errors. This is overkill for most businesses. It’s better to run a larger quantity of smaller tests. 🙂

Do you have pre-written or template tests available?

Yes, we have created a library of templates for you to use.

You can find our library of templates [URL GOES HERE]

What am I allowed to test?

You can ask users to complete tasks on a website or app that is yours or a competitors.

The purpose is to get feedback on what users are thinking, trying to do, or frustrated with.

Do not create a test where the purpose is to get a user to:

  • Click on ads
  • Post to social media
  • Download spyware.

If you have a website with R-rated content, then we must mark the test so that testers are warned of the contents before accepting the test.

A violation of these terms will result in removal from our platform.

What if I think a video is useless?

We want you to be completely satisfied with your user test. We offer a 100% money back guarantee, no questions asked.

To accomplish this, inside the dashboard you can give feedback on your videos rating it 1 to 5 stars:

  • 5 stars – Amazing
  • 4 stars – Great
  • 3 stars – Useful
  • 2 stars – Okay
  • 1 star – Useless

We use these ratings for quality control. If testers fall below a certain rating, they are no longer allowed to test with us.

In the unlikely event you think a video is useless, please send a message to customer support. We will replace your video or credit your account.

My audience is unique. How will user testing help me? Can you replicate my audience?

The general consensus amongst User Experience (UX) practitioners is to avoid getting too specific when finding users. The majority of products should be clear and easy to use by anyone.

However, if you need specific demographics we offer the following selections (Note: Not available for Beta):

Sex:

  • Male
  • Female

Kids:

  • No Kids
  • Infant or Toddler (0-3 years of age)
  • Young Child (4-12 years of age)
  • Teenager (13-18 years of age)
  • Adult (18+)

Age:

  • Ranges from 18 – 60+

Tech Knowledge:

  • Regular User (Surfs the web, purchases online occasionally)
  • Power User (Shops online with ease, maybe participates in online communities, can figure out most consumer web products)
  • Web Expert (Knows the ins and outs of a programming language such as HTML, CSS, etc, knows what JavaScript, PHP, WordPress are or other comparable web/online skill)

Device:

  • Windows PC (desktop or laptop)
  • Apple Computer (desktop or laptop)
  • Android Phone
  • iOS Apple Phone
  • Android Tablet
  • iOS Apple Tablet (iPad)

In addition, we offer a write-in option where you can specify things like, “speaks French” “reads the news” “manager” “plays chess” and “interested in sports.”

Keep in mind if you get really specific it will take longer to complete your test.

Can I pay you to fix the conversion errors (crimes) I discover through user testing?

We do not have a service for small fixes. However, if you’re looking for someone to do user testing and create a detailed report and wireframes to guide your team or a freelancer to fix your conversion crimes – our conversion audits at Zeda Labs are a great fit.

Where are the users from?

Our users are from the United States and Canada. We will be offering users from more countries and languages in the future.

How long does it take to get the videos?

During beta video delivery will vary greatly due to us working on our processes and quality control. Once we get through beta, on average tests are completed within 2-8 hours. If you have selected specific demographics, it may take a little longer, as the available tester pool becomes smaller the more specific you need testers to be.