Can I edit this template?

Yes. You can edit the scenario and tasks from this template as much as you want. However, your final test can’t have more than the allotted tasks in the template test size.

How many tests should I run?

Your website will improve with every test you run. The more you want to improve, the more you should test.

One way to test with us is to buy a test bundle. You can use these to test at your own pace, which is especially useful when releasing new features or adding new pages to your website.

Can I choose multiple platforms for the same test?

No. We can only run one device type (desktop, mobile, tablet) per test.

However, we can duplicate your test onto a second device for a discount.

What’s the difference between Tests and Tasks?

You can’t have a test without tasks.

Tasks are the individual exercises our testers complete while doing your test — these include navigating to certain parts of your site, taking actions like adding items to their cart, or simple observational tasks.

1. Please spend 5 minutes exploring the store like you normally would.
2. Find a pair of running shoes for less than $40.
3. Do the shoes come in your size? What colors do they offer?
4. You need the shoes tomorrow for a marathon if you buy now – could they arrive by noon tomorrow?

Some tests have three tasks, some have 12. More tasks means more steps in your flow and a longer test.

The number of tasks needs fit within the time period of the test as it’s only fair to the testers to get paid for their time. (ie: Don’t squeeze a task that takes 30-minutes and purchase a 1 task test for $10/result – which is meant to be 5 minutes or less)

How many testers should my test have?

3 — if you’re on a tight budget and don’t mind capturing a bit less data
5 — to capture most of your users’ pain points before the law of diminishing returns kicks in
20 — for deep dives and more statistically significant data

Why do I pay per result on Self-Serve, but per test on Managed?

Self-serve is our most flexible offer. Only have $20 bucks to test this week? Run a $20 test! Self-serve lets you test anything you please, at any scale you please. We won’t be involved in the process, so we only charge you per tester.

Our Managed offer is process-driven and proven-to-work. Tests are limited to five testers (it’s the perfect ratio of bang to buck) and we work with you to create affordable, bespoke tests (plus some extra goodies on top of the test itself). Because of our extra involvement, we charge you per test. The testers are included in the cost.

I’m testing for the first time. Where’s a good place to start?

If you have testing experience and already know what you’re looking for, go for the Self-Serve offer. Or edit one of our templates.

Want some extra help? Managed is for you. We’ve productized testing and we’ll either write the test for you and you watch the videos. Or we’ll do it all and make a report of our findings with suggestions, easily implemented.

Do you have high-stakes sales funnels? Want robust bug testing and bulletproof ad campaigns? Want to test on a schedule? Go big on usability testing with our Enterprise offer.

What countries do you accept testers from?

We accept testers that are Native, Bilingual, or C-1 level or higher English fluency.

We are actively looking for testers in or from the following countries:

  • USA
  • Canada
  • United Kingdom
  • Europe
  • Australia/New Zealand

If you are in or from these countries we encourage you to apply.

Please note that: VPN usage is not permitted and will be cause for rejection from the platform.

What does our application and acceptance process look like?

Our application process for signing up as a tester is more involved than other platforms.

First, we have an identity check and IP verification. They must match or you must provide documents that prove otherwise. (This is being implemented in August 2021 – so want to forewarn you this is coming in case you have an issue with it.)

Second, you must do 2 sample tests of which we look to see if you meet the standards and quality our customers expect from us. You’ll be given feedback before you can take the 2nd sample test. If you are a 5-star tester on another platform, it doesn’t automatically mean you will be accepted as a tester on Conversion Crimes.

Third, once you onboard to our platform, you’ll be able to fill out questionnaires which will place you into audience buckets our customers can then choose from when launching tests. You can also provide job verification (optional) to be placed in premium audiences with higher test payouts.

To learn more about our application process and what we look for go here.

What do we look for in testers?

Before you get started, you should know that we have strict criteria for accepting testers to join our platform. 😬

If you are a 5-star tester on another platform, it doesn’t automatically mean you will be accepted as a tester on Conversion Crimes. 😞

We look for something different because we are different and this is how we stand out in the market.

We are looking for testers that:

💬 Have excellent communication skills and can articulate their thoughts clearly.

😍 LOVE giving feedback and helping companies improve their websites, software, and products.

🧠 Are incredibly good at putting themselves into the mind of the test scenario.

❤️ Care about providing high-quality and accurate results to our customers.

🌳 Always want to be learning, growing, and improving their craft – They love getting feedback!

🙌 Embody our core values as a company.

If you feel you meet these values and have native, bilingual, or C-1 level or higher English fluency, we’d love to see if you are a good fit for us.

What do you do when user/usability testing websites?

💬 User & Usability testing is, at its core, recording your screen while speaking your thoughts out loud.

🖥 You’ll do this while visiting a website (or app) and completing specific tasks such as finding products or signing up for software and trying to figure out how to use it.

☺️ It’s important to note that we are not testing you, we’re testing the website. So if you don’t know how to do something, that’s great feedback.

🥳 Your live experience will show our clients exactly where you struggled or what you would have preferred to see. This gives them real data on how to improve their website or software for other users.

🤑 If you like technology, giving feedback, and helping small businesses, usability testing is a great way for you to earn a side income and have fun at the same time.

What you need to start testing?

Anyone that is a good communicator and can speak out loud about their experiences will be a great tester at Conversion Crimes.

However, there’s a few things you need in order to test with us:

  • Native, Bilingual, or C-1 level or higher English fluency.
  • You must be 18+ years old 
  • High Speed Internet Connection (At least 3mbps Check your speed.)
  • A Mac or PC computer You will have more test opportunities if you can also test on iOS and Android mobile or tablet devices
  • A microphone with good sound quality – even a cheap $2 one from the dollar store will suffice.
  • A quiet place and no distractions
What’s the difference between our Subscription options and “Pay Per Test” testing?

When you subscribe for Self Serve or Expert insights plans, you get personal assistance by our CRO experts for your tests set up, plus a customized testing plan for the first 3/4 months of your subscription.

Setting up tests is not difficult but requires a bit of a learning curve in order to get really valuable and actionable insights. By subscribing you shortcut all that and can jump straight into learning more about your users. When you subscribe you also get a substantial discount (from 33% to 45%) over the same test “Pay Per Test”.

How can I add this to my service?

As an agency we saw the power of testing with Conversion Crimes first hand for our clients. We were able to spot usability issues fast and cost effectively, and to back them with real human behavior data. It’s always been a laser-focused and eye opening process, and clients loved it.

That’s why we decided to offer it as a white label, done for your service as well. If you’re a digital marketing, branding or SEO agency, this is for you.

How you implement it into your workflow, is up to you. Usability testing is super helpful both before a website redesign to understand where the current site falls short, and after, to validate the changes you’ve made. You can run quick first impression tests to collect qualitative data on what users think about a brand and if they trust it. Or you can user test a specific landing page before it goes live, as a wireframe or mockup. In any case, we’ll guide you towards what’s best for you at every stage of the process.

I want to pay as I go, is there a time limit for claiming the tests I purchase?

You can claim a test you purchase up to 6 months after your order. Once you sign up, you’ll be able to create and launch your test from your dashboard whenever you want within that period.

What do you mean with “Test set-up”?

A Conversion Crimes test is made up of several tasks that you write when creating a test and that users have to go through to help you understand how they use your site. Think of it as the experience your visitors go through divided into step by step actions. These actions or tasks will guide our users (testers) through the test.

Usually, when you start writing tests, it might take longer to get the type of valuable insights that we find for businesses in just a matter of days – that’s why some business owners have one of their team learn how to do it, or have us do it for them.

When you sign up for a monthly subscription or buy the “Test set-up” Add-on, our CRO experts are going to write the tests for you, based on your goals and requirements. This usually saves you time and guarantees that your monthly test gets you the insights you needed. No other usability testing platform offers this.

Why would I use Conversion Crimes instead of A/B testing or something like Hotjar?

Unless you have, at absolute minimum, 10,000 unique visitors per month, A/B testing won’t work for you. This is due to the levels of statistical significance required to know if one page is winning over another. You usually also need about 1,000 conversions per month to get valuable information out of split testing.

Even then, you will have to make drastic changes to see results reflected in A/B tests and you will know what doesn’t work but not the reason why, which is what helps you truly improve your site or product.

With Conversion Crimes you don’t need any traffic because we automatically find users for you to test with.

A platform like Hotjar can be great to get quantitative data and metrics for you to improve your user experience. Heatmaps and user recording videos can provide some useful data on frequent behavior patterns. However these won’t help you understand what’s underneath, the reasons why users act a certain way.

With Conversion Crimes you get real people recording their screens while on your site or app, and talking through their thoughts out loud for you to hear. You’ll get insights like:

  • Why they’re searching for information on a certain page rather than somewhere else
  • What they expect to happen before clicking a button and then if their expectations were met
  • If they trust your platform, why or why not, and what they would need to know/see in order to trust it
  • What influences their decision to click on a certain CTA rather than on another one
  • If they understand what you offer and what they focus on to understand it
  • And more!
Why is this important to my business?

As a business, you want people to love your products or services, so they give their money to you instead of competitors.

To have people love your products or services, you need to know if they understand them and how they use them, starting from your website. That’s where user Conversion Crimes comes in.

We help you understand:

  • Do they use your product/website like you intended it to be used?
  • Do they achieve the goal they set out to do with your product?
  • Do they find the right information on your site before buying?
  • Are they happy or frustrated after using your product or visiting your site?

And more…

By answering these questions, you’ll create a better experience – from website to product – for your customers. This will improve your conversion rate and bottom line.

How often should I run user tests?

Ideally, usability testing should be done on prototypes before your product or site launches or before a redesign of business change. You should always be testing though. No website or app is perfect but it should constantly be adapting to the audience’s needs.

We created our Subscription tiers with 1 test per month. Ideally you could set a 6-month testing plan and completely transform your business with the insights and improvements you get over time.

Those tiny tweaks that lead to more conversions compound over time. It doesn’t take a lot to make a big shift.

How long should I run my test?

It depends on what you are testing for.  If the task is easy or fast to complete use 1-2 minute. If the task is more difficult 3-4 minutes. Then add 2 minutes to your final calculation.

Below are examples of video lengths and what kind of user testing videos you would get with each one.

1-5 minute tests
1-5 minute tests are great for gathering information on first impressions or to answer a quick question about your website. Such as, does your value prop headline articulate who you are and what you do clearly? Do people understand what you want them to do on the website? What is the first thing you would click on if you landed on this page and why? Use 3 minutes when you want them to make one simple action in addition to a first impression.

5-10 minutes tests
This is great to see how users navigate through your website and look for information. This is enough time to browse a website and look for an item or service to buy. 

10-15 minutes tests
This is ideal to understand the whole user experience. From the moment they land on your site to choosing a product or service. It’s great for finding out the main enquiries about a product or service you are offering.

15-20 minutes tests
This is great for SAAS or app onboarding processes which take longer and have more steps. Some of which can take considerable time to figure out, fill forms, and complete the process.


For example:
You’re able to get customers to sign up, but they can’t understand how to do the tasks in the app and thus aren’t converting to paid accounts. Depending on what, how complex and how many steps are required to do the process in your app, would depend on the length of the video. If it takes 5-7 minutes or less for a user to complete the process outlined in your tasks a 12 minute test should suffice. If it takes 8 or more minutes complete, choose 15-20 minutes for your test.

Do you have pre-written or template tests available?

We’re currently in the process of creating a library of templates for any kind of business (ecommerce, SaaS, Lead gen, Membership, Affiliate & content, , Productized service etc).

In the meantime you can let us write your test if you sign up on a subscription plan: Self-Serve or Expert Insights. You can also buy the “test set-up” add-on in our “Pay Per Test” option.

What am I allowed to test?

You can ask users to complete tasks on a website, app (yours or competitors’), or even wireframe/website mockup. As long as what you need to test has a URL link, you can test it.

The purpose is to get feedback on what users are thinking, trying to do, or get frustrated with.

Do not create a test where the purpose is to get a user to:

  • Click on ads
  • Post to social media
  • Download spyware

If your test contains adult content, make sure you select the related option in the test creation page.

What if I think a video is useless?

We want you to be completely satisfied with your test. If after receiving your test results you are not satisfied, we’ll either provide you with another one or return the credit to your balance.

My audience is unique. How will user testing help me? Can you replicate my audience?

The general consensus amongst UX practitioners is to avoid getting too specific when finding testers. The majority of products should be clear and easy to use by anyone. However, getting someone with domain knowledge will provide better insights. Aim for a broad net, not pinpoint.

Currently we offer the following demographics:

  • Male/Female
  • Age range (18-24, 24-34, 34-44, 45+)
  • Web expertise (Any, Power user, Web expert)

More coming soon…

In addition, we offer a write-in option where you can specify extra requirements like, “speaks French” “reads the news” “manager” “plays chess” and “interested in sports” “uses “Google Chrome” etc.

Keep in mind the more specific you are, the longer your test will take to complete.

Can I pay you to fix the conversion errors (crimes) I discover through user testing?

We do not have a service for small fixes. However, if you’re looking for someone to do user testing and create a detailed report and wireframes to guide your team or a freelancer to fix your conversion crimes – our conversion audits at Zeda Labs are a great fit.

Where are the users from?

Our users are mostly from the USA and Canada but we also have European users. Even if your business sells internationally we’ve got you covered.

How long does it take to get the videos?

On average tests are completed within 24 hours depending on the test length and on the demographic (male, female, age range, web expertise etc.) you pick for it. The more specific you are, the longer your test will take. We’re actively working on expanding our tester base to improve test delivery times.

What is remote user testing?

Remote user testing gives you rapid customer feedback on almost any digital experience you can imagine, including websites, mobile apps, prototypes, and more. Anything online can be tested.

You’ll receive a video screen recording of someone using your website or app, thinking out loud as they try to compete tasks that you give them. The user is in their own environment, on their own device—with all their quirky settings—acting as they normally would, so you get realistic results.

Remote user testing is faster, easier to run, and waaay cheaper than a traditional in-person lab setting—meaning you’re more likely to do it!

Do people actually use this sort of thing? I’ve never heard of it.

Yes, user testing is used by top companies like Walmart, Facebook, Zillow, Constant Contact, CBS, Bose, NBC, Amazon, AirBnB, and Spotify.

For people in the know, it’s a conversion increasing secret weapon.

Didn't find an answer to your question?