What’s the difference between our Subscription options and “Pay Per Test” testing?

When you subscribe for Self Serve or Expert insights plans, you get personal assistance by our CRO experts for your tests set up, plus a customized testing plan for the first 3/4 months of your subscription.

Setting up tests is not difficult but requires a bit of a learning curve in order to get really valuable and actionable insights. By subscribing you shortcut all that and can jump straight into learning more about your users. When you subscribe you also get a substantial discount (from 33% to 45%) over the same test “Pay Per Test”.

How can I add this to my service?

As an agency we saw the power of testing with Conversion Crimes first hand for our clients. We were able to spot usability issues fast and cost effectively, and to back them with real human behavior data. It’s always been a laser-focused and eye opening process, and clients loved it.

That’s why we decided to offer it as a white label, done for your service as well. If you’re a digital marketing, branding or SEO agency, this is for you.

How you implement it into your workflow, is up to you. Usability testing is super helpful both before a website redesign to understand where the current site falls short, and after, to validate the changes you’ve made. You can run quick first impression tests to collect qualitative data on what users think about a brand and if they trust it. Or you can user test a specific landing page before it goes live, as a wireframe or mockup. In any case, we’ll guide you towards what’s best for you at every stage of the process.

I want to pay as I go, is there a time limit for claiming the tests I purchase?

You can claim a test you purchase up to 6 months after your order. Once you sign up, you’ll be able to create and launch your test from your dashboard whenever you want within that period.

What do you mean with “Test set-up”?

A Conversion Crimes test is made up of several tasks that you write when creating a test and that users have to go through to help you understand how they use your site. Think of it as the experience your visitors go through divided into step by step actions. These actions or tasks will guide our users (testers) through the test.

Usually, when you start writing tests, it might take longer to get the type of valuable insights that we find for businesses in just a matter of days – that’s why some business owners have one of their team learn how to do it, or have us do it for them.

When you sign up for a monthly subscription or buy the “Test set-up” Add-on, our CRO experts are going to write the tests for you, based on your goals and requirements. This usually saves you time and guarantees that your monthly test gets you the insights you needed. No other usability testing platform offers this.

Why would I use Conversion Crimes instead of A/B testing or something like Hotjar?

Unless you have, at absolute minimum, 10,000 unique visitors per month, A/B testing won’t work for you. This is due to the levels of statistical significance required to know if one page is winning over another. You usually also need about 1,000 conversions per month to get valuable information out of split testing.

Even then, you will have to make drastic changes to see results reflected in A/B tests and you will know what doesn’t work but not the reason why, which is what helps you truly improve your site or product.

With Conversion Crimes you don’t need any traffic because we automatically find users for you to test with.

A platform like Hotjar can be great to get quantitative data and metrics for you to improve your user experience. Heatmaps and user recording videos can provide some useful data on frequent behavior patterns. However these won’t help you understand what’s underneath, the reasons why users act a certain way.

With Conversion Crimes you get real people recording their screens while on your site or app, and talking through their thoughts out loud for you to hear. You’ll get insights like:

  • Why they’re searching for information on a certain page rather than somewhere else
  • What they expect to happen before clicking a button and then if their expectations were met
  • If they trust your platform, why or why not, and what they would need to know/see in order to trust it
  • What influences their decision to click on a certain CTA rather than on another one
  • If they understand what you offer and what they focus on to understand it
  • And more!
Why is this important to my business?

As a business, you want people to love your products or services, so they give their money to you instead of competitors.

To have people love your products or services, you need to know if they understand them and how they use them, starting from your website. That’s where user Conversion Crimes comes in.

We help you understand:

  • Do they use your product/website like you intended it to be used?
  • Do they achieve the goal they set out to do with your product?
  • Do they find the right information on your site before buying?
  • Are they happy or frustrated after using your product or visiting your site?

And more…

By answering these questions, you’ll create a better experience – from website to product – for your customers. This will improve your conversion rate and bottom line.

How often should I run user tests?

Ideally, usability testing should be done on prototypes before your product or site launches or before a redesign of business change. You should always be testing though. No website or app is perfect but it should constantly be adapting to the audience’s needs.

We created our Subscription tiers with 1 test per month. Ideally you could set a 6-month testing plan and completely transform your business with the insights and improvements you get over time.

Those tiny tweaks that lead to more conversions compound over time. It doesn’t take a lot to make a big shift.

How long should I run my test?

It depends on what you are testing for.  If the task is easy or fast to complete use 1-2 minute. If the task is more difficult 3-4 minutes. Then add 2 minutes to your final calculation.

Below are examples of video lengths and what kind of user testing videos you would get with each one.

1-5 minute tests
1-5 minute tests are great for gathering information on first impressions or to answer a quick question about your website. Such as, does your value prop headline articulate who you are and what you do clearly? Do people understand what you want them to do on the website? What is the first thing you would click on if you landed on this page and why? Use 3 minutes when you want them to make one simple action in addition to a first impression.

5-10 minutes tests
This is great to see how users navigate through your website and look for information. This is enough time to browse a website and look for an item or service to buy. 

10-15 minutes tests
This is ideal to understand the whole user experience. From the moment they land on your site to choosing a product or service. It’s great for finding out the main enquiries about a product or service you are offering.

15-20 minutes tests
This is great for SAAS or app onboarding processes which take longer and have more steps. Some of which can take considerable time to figure out, fill forms, and complete the process.


For example:
You’re able to get customers to sign up, but they can’t understand how to do the tasks in the app and thus aren’t converting to paid accounts. Depending on what, how complex and how many steps are required to do the process in your app, would depend on the length of the video. If it takes 5-7 minutes or less for a user to complete the process outlined in your tasks a 12 minute test should suffice. If it takes 8 or more minutes complete, choose 15-20 minutes for your test.

How do I know how many users to run my test with?

As soon as you collect data from a single test user, your insights shoot up and you have already learned almost a third of all there is to know about the usability.

When you test the second user, you will discover that this person does some of the same things.

Each new user adds a bit more insight than the last, but you will keep seeing the same things again and again. Thus, learning less and less new insights each added video.

We recommend 3 users for our budget customers
Three users is enough to get an idea of the diversity in user behavior and insight into what’s unique and what can be generalized.

We recommend 5 users for most people
Five is the best return on investment and usually finds 85% of the issues. Testing costs increase with each additional user, yet the number of findings quickly reaches the point of diminishing returns.

Have a bigger budget? YAY! Spend it on more tests, not more users in each test.

We recommend 9 users when you are looking for as much feedback as possible
You would need at least 15 users to catch 100% of the usability errors. This is overkill for most businesses. It’s better to run a larger quantity of smaller tests. 🙂 However you might want to use anything between 10 to 20 testers whenever you want to find outliers or are running short first impressions tests (usually 1 or 2 minutes).

Do you have pre-written or template tests available?

We’re currently in the process of creating a library of templates for any kind of business (ecommerce, SaaS, Lead gen, Membership, Affiliate & content, , Productized service etc).

In the meantime you can let us write your test if you sign up on a subscription plan: Self-Serve or Expert Insights. You can also buy the “test set-up” add-on in our “Pay Per Test” option.

What am I allowed to test?

You can ask users to complete tasks on a website, app (yours or competitors’), or even wireframe/website mockup. As long as what you need to test has a URL link, you can test it.

The purpose is to get feedback on what users are thinking, trying to do, or get frustrated with.

Do not create a test where the purpose is to get a user to:

  • Click on ads
  • Post to social media
  • Download spyware

If your test contains adult content, make sure you select the related option in the test creation page.

What if I think a video is useless?

We want you to be completely satisfied with your test. If after receiving your test results you are not satisfied, we’ll either provide you with another one or return the credit to your balance.

My audience is unique. How will user testing help me? Can you replicate my audience?

The general consensus amongst UX practitioners is to avoid getting too specific when finding testers. The majority of products should be clear and easy to use by anyone. However, getting someone with domain knowledge will provide better insights. Aim for a broad net, not pinpoint.

Currently we offer the following demographics:

  • Male/Female
  • Age range (18-24, 24-34, 34-44, 45+)
  • Web expertise (Any, Power user, Web expert)

More coming soon…

In addition, we offer a write-in option where you can specify extra requirements like, “speaks French” “reads the news” “manager” “plays chess” and “interested in sports” “uses “Google Chrome” etc.

Keep in mind the more specific you are, the longer your test will take to complete.

Can I pay you to fix the conversion errors (crimes) I discover through user testing?

We do not have a service for small fixes. However, if you’re looking for someone to do user testing and create a detailed report and wireframes to guide your team or a freelancer to fix your conversion crimes – our conversion audits at Zeda Labs are a great fit.

Where are the users from?

Our users are mostly from the USA and Canada but we also have European users. Even if your business sells internationally we’ve got you covered.

How long does it take to get the videos?

On average tests are completed within 24 hours depending on the test length and on the demographic (male, female, age range, web expertise etc.) you pick for it. The more specific you are, the longer your test will take. We’re actively working on expanding our tester base to improve test delivery times.

What is remote user testing?

Remote user testing gives you rapid customer feedback on almost any digital experience you can imagine, including websites, mobile apps, prototypes, and more. Anything online can be tested.

You’ll receive a video screen recording of someone using your website or app, thinking out loud as they try to compete tasks that you give them. The user is in their own environment, on their own device—with all their quirky settings—acting as they normally would, so you get realistic results.

Remote user testing is faster, easier to run, and waaay cheaper than a traditional in-person lab setting—meaning you’re more likely to do it!

Do people actually use this sort of thing? I’ve never heard of it.

Yes, user testing is used by top companies like Walmart, Facebook, Zillow, Constant Contact, CBS, Bose, NBC, Amazon, AirBnB, and Spotify.

For people in the know, it’s a conversion increasing secret weapon.

Didn't find an answer to your question?