B2B reviewers often require specialized knowledge, industry experience, or specific professional backgrounds to provide valuable insights for business-focused products or services. This expertise and level of understanding typically come at a higher cost and they are harder to recruit. They tend to have busy schedules and require compensation that reflects their time and expertise.
We strive to ensure that the insights they provide align with the price you pay for their valuable expertise.
Certainly! We would be more than happy to assist you with your large testing needs or long-term contract inquiries. Please click here to book a call with our founder, Quinn Zeda.
During the call, you can discuss your requirements, explore available options, and get personalized assistance for your testing needs. We look forward to connecting with you and finding the best solution for your business.
We are committed to providing high-quality insights and ensuring your satisfaction. If you are not happy with a reviewer’s feedback, we offer a free replacement with a new reviewer at no extra cost.
Yes, you have the ability to select specific demographics or professional backgrounds for your reviewers. During the study setup process, you can define the criteria you’re looking for in reviewers, such as age, gender, location, or professional expertise. This helps ensure that the feedback you receive aligns with your target audience and provides valuable insights specific to your product or service.
We select reviewers based on their ability to provide valuable, detailed, and constructive feedback. We look for reviewers who can articulate their thoughts, stay on task, and communicate effectively, ensuring they offer valuable insights for improving the user experience and messaging.
To ensure the authenticity of our reviewers, we have robust verification measures in place. We verify the identity and credentials of our reviewers to ensure they are genuine users with real experiences. This helps maintain the integrity of our feedback and provides you with reliable insights from trustworthy sources.
The turnaround time for receiving feedback from reviewers can vary based on the nature of the audience involved in the study.
For general audiences, you can often expect results same day of launching your study. This allows you to iterate quickly and continuously improve based on real user feedback.
For specialty audiences, the timeline can extend up to two weeks if we don’t have them in our user base. While this may seem longer, it is important to remember that these are reviewers who have specific expertise or characteristics that make them uniquely suited to evaluate your product. Finding, engaging, and collecting quality feedback from these reviewers requires time, but the depth and relevance of the insights they provide can be invaluable to your study.
In essence, while speed is essential, the quality and relevance of feedback are equally, if not more, important for effective user studies. We strive to balance these aspects to provide you with the most valuable feedback in a reasonable timeframe.
A study can focus on either a single webpage or a full website, tailored to your specific needs and goals.
For in-depth analysis of specific elements, a single-page study might be more fitting, especially if the page plays a crucial role in the user journey or is undergoing a redesign. Reviewers can then provide detailed feedback on design, content, and overall user experience on that page.
If you aim to understand the overall user journey, or assess the coherence of different pages, studying the entire flow would be more beneficial. This approach offers a broader perspective, albeit with less focus on individual pages.
The most suitable strategy can be a combination of both, aligning with your objectives. You could run two studies with some reviewers evaluating the overall website while others focus on specific pages.
The ideal number of study reviewers hinges on your specific needs and budget. Research suggests that 5 users usually uncover the majority of friction, pain points, and unmet needs. Additional reviewers beyond this typically offer diminishing returns, as they tend to reiterate the same issues. Beyond five, you’re generally confirming known insights rather than uncovering new ones.
If your product caters to varied target users, study with at least 5 from each group to account for differing behaviors. On a tight budget, aim for a minimum of 3 reviewers.
We advocate for conducting iterative rounds of studies with five reviewers, implementing changes based on their feedback, and then repeating the process with a new set of participants. This approach facilitates progressive issue identification and resolution, reveals deeper problems with successive studies, and is generally more cost- and time-efficient.
Remember, these are guidelines. Tailor the number of reviewers to your needs. It’s good practice to conduct studies in rounds, continuing until reaching saturation – the point at which no new insights emerge.
Study length pertains to the time and effort reviewers invest in providing feedback.
‘Short’ studies involve up to 10 minutes of video feedback and up to 5 tasks or questions. This option suits evaluations of specific elements or a couple of pages in your flow, perfect for obtaining quick insights on value propositions or particular steps like a landing page review or item search.
‘Long’ studies provide up to 20 minutes of video feedback with up to 12 tasks or questions. They’re ideal for comprehensive user journey reviews like complete shopping processes, software trial experiences, or ad-to-landing-page evaluations.
The study length impacts the depth of insights and pricing.
Note: If you have few questions, but they require extensive time (20 minutes) to complete, you should opt for the ‘Long’ study.
We source our reviewers from an array of niche online communities, newsletters, paid ads, and referrals. Every reviewer is meticulously vetted for accuracy and relevance before being categorized in our system. For B2B testers, verification is completed via LinkedIn and other professional resources.
Quality and relevance are key; the better the match, the more useful the feedback. You’ll receive context on each reviewer, aiding in the interpretation of their feedback.
Our reviewer base is always growing because we’re actively recruiting people to join it. You can sign up and be part of it here.
Reviewers are real individuals matched to your target audience who interact with your product or service. They provide unfiltered feedback about their perceptions, frustrations, likes, and dislikes. This invaluable insight reveals first-time user experiences, highlighting potential friction points, unmet needs, and opportunities for improvement.
Non verified profiles (For those who don’t want to share any social media with us):
Once you complete your qualification study and it’s been accepted by our moderation team, you’ll start receiving invitations to your email as soon as a Conversion Crimes clients request feedback from people with your profile. Study requests are client project–dependent and asynchronous.
Verified profiles (For those who shared Facebook or Linkedin accounts with us):
If you’re part of our Consumer or Professional reviewer groups, profile verification is done manually, and we are doing our best to verify your profile as soon as possible. You will receive an email once your profile is verified, and you’ll be ready to take your qualification study.
Every Monday, we send out the payments to your PayPal account. Click here to learn how to add your PayPal address to your profile.
We pay you 15-60 USD depending on the study length chosen by the customer. Usually they take 10-20 minutes to complete.
Click here for more information on our studies lengths and remuneration.
This will depend on your demographics and the requirements for each test. We are project-based, which means we cannot guarantee that you will do a certain amount of testing per month, as this number varies.
What makes this a great test video?
Yes. You can edit the scenario and tasks from this template as much as you want. While we did our best to set up tests in a way that can be used as-is. We encourage you to modify the template to meet your specific requirements. You’ll get more nuanced results this way. If you need help with this, please reach out to support and we’d be happy to help guide you.
Please note, your final test can’t have more questions and/or tasks than what’s allowed in the test size (Short vs Long). This keeps payments fair for our reviewers for the time they spend giving feedback. 🙂
Your website will improve with every test you run. The more you want to improve, the more you should test.
One way to test with us is to buy a test bundle. You can use these to test at your own pace, which is especially useful when releasing new features or adding new pages to your website.
No. We can only run one device type (desktop, mobile, or tablet) per test at the moment. If you’d like to run the same test on multiple devices, please contact support and we can duplicate your tests on the back end for you. Please note, B2B audiences only have desktop options available at this time.
You can’t have a test without tasks.
Tasks are the individual exercises our testers complete while doing your test — these include navigating to certain parts of your site, taking actions like adding items to their cart, or simple observational tasks.
Example:
1. Please spend 5 minutes exploring the store like you normally would.
2. Find a pair of running shoes for less than $40.
3. Do the shoes come in your size? What colors do they offer?
4. You need the shoes tomorrow for a marathon if you buy now – could they arrive by noon tomorrow?
Some tests have three tasks, some have 12. More tasks means more steps in your flow and a longer test.
The number of tasks needs fit within the time period of the test as it’s only fair to the testers to get paid for their time. (ie: Don’t squeeze a task that takes 30-minutes and purchase a 1 task test for $10/result – which is meant to be 5 minutes or less)
3 — if you’re on a tight budget and don’t mind capturing a bit less data
5 — to capture most of your users’ pain points before the law of diminishing returns kicks in
20 — for deep dives and more statistically significant data
Self-serve is our most flexible offer. Only have $20 bucks to test this week? Run a $20 test! Self-serve lets you test anything you please, at any scale you please. We won’t be involved in the process, so we only charge you per tester.
Our Managed offer is process-driven and proven-to-work. Tests are limited to five testers (it’s the perfect ratio of bang to buck) and we work with you to create affordable, bespoke tests (plus some extra goodies on top of the test itself). Because of our extra involvement, we charge you per test. The testers are included in the cost.
If you have testing experience and already know what you’re looking for, go for the Self-Serve offer. Or edit one of our templates.
Want some extra help? Managed is for you. We’ve productized testing and we’ll either write the test for you and you watch the videos. Or we’ll do it all and make a report of our findings with suggestions, easily implemented.
Do you have high-stakes sales funnels? Want robust bug testing and bulletproof ad campaigns? Want to test on a schedule? Go big on usability testing with our Enterprise offer.
We accept testers that are Native, Bilingual, or C-1 level or higher English fluency.
We are actively looking for testers in or from the following countries:
If you are in or from these countries we encourage you to apply.
Please note that: VPN usage is not permitted and will be cause for rejection from the platform.
Our application process for signing up as a tester is more involved than other platforms.
First, we have an identity check and IP verification. They must match or you must provide documents that prove otherwise. (This is being implemented in August 2021 – so want to forewarn you this is coming in case you have an issue with it.)
Second, you must do 2 sample tests of which we look to see if you meet the standards and quality our customers expect from us. You’ll be given feedback before you can take the 2nd sample test. If you are a 5-star tester on another platform, it doesn’t automatically mean you will be accepted as a tester on Conversion Crimes.
Third, once you onboard to our platform, you’ll be able to fill out questionnaires which will place you into audience buckets our customers can then choose from when launching tests. You can also provide job verification (optional) to be placed in premium audiences with higher test payouts.
To learn more about our application process and what we look for go here.
Before you get started, you should know that we have strict criteria for accepting testers to join our platform. 😬
If you are a 5-star tester on another platform, it doesn’t automatically mean you will be accepted as a tester on Conversion Crimes. 😞
We look for something different because we are different and this is how we stand out in the market.
We are looking for testers that:
💬 Have excellent communication skills and can articulate their thoughts clearly.
😍 LOVE giving feedback and helping companies improve their websites, software, and products.
🧠 Are incredibly good at putting themselves into the mind of the test scenario.
❤️ Care about providing high-quality and accurate results to our customers.
🌳 Always want to be learning, growing, and improving their craft – They love getting feedback!
🙌 Embody our core values as a company.
If you feel you meet these values and have native, bilingual, or C-1 level or higher English fluency, we’d love to see if you are a good fit for us.
💬 User & Usability testing is, at its core, recording your screen while speaking your thoughts out loud.
🖥 You’ll do this while visiting a website (or app) and completing specific tasks such as finding products or signing up for software and trying to figure out how to use it.
☺️ It’s important to note that we are not testing you, we’re testing the website. So if you don’t know how to do something, that’s great feedback.
🥳 Your live experience will show our clients exactly where you struggled or what you would have preferred to see. This gives them real data on how to improve their website or software for other users.
🤑 If you like technology, giving feedback, and helping small businesses, usability testing is a great way for you to earn a side income and have fun at the same time.
When you subscribe for Self Serve or Expert insights plans, you get personal assistance by our CRO experts for your tests set up, plus a customized testing plan for the first 3/4 months of your subscription.
Setting up tests is not difficult but requires a bit of a learning curve in order to get really valuable and actionable insights. By subscribing you shortcut all that and can jump straight into learning more about your users. When you subscribe you also get a substantial discount (from 33% to 45%) over the same test “Pay Per Test”.
As an agency we saw the power of testing with Conversion Crimes first hand for our clients. We were able to spot usability issues fast and cost effectively, and to back them with real human behavior data. It’s always been a laser-focused and eye opening process, and clients loved it.
That’s why we decided to offer it as a white label, done for your service as well. If you’re a digital marketing, branding or SEO agency, this is for you.
How you implement it into your workflow, is up to you. Usability testing is super helpful both before a website redesign to understand where the current site falls short, and after, to validate the changes you’ve made. You can run quick first impression tests to collect qualitative data on what users think about a brand and if they trust it. Or you can user test a specific landing page before it goes live, as a wireframe or mockup. In any case, we’ll guide you towards what’s best for you at every stage of the process.
You can claim a test you purchase up to 6 months after your order. Once you sign up, you’ll be able to create and launch your test from your dashboard whenever you want within that period.
A Conversion Crimes test is made up of several tasks that you write when creating a test and that users have to go through to help you understand how they use your site. Think of it as the experience your visitors go through divided into step by step actions. These actions or tasks will guide our users (testers) through the test.
Usually, when you start writing tests, it might take longer to get the type of valuable insights that we find for businesses in just a matter of days – that’s why some business owners have one of their team learn how to do it, or have us do it for them.
When you sign up for a monthly subscription or buy the “Test set-up” Add-on, our CRO experts are going to write the tests for you, based on your goals and requirements. This usually saves you time and guarantees that your monthly test gets you the insights you needed. No other usability testing platform offers this.
Unless you have, at absolute minimum, 10,000 unique visitors per month, A/B testing won’t work for you. This is due to the levels of statistical significance required to know if one page is winning over another. You usually also need about 1,000 conversions per month to get valuable information out of split testing.
Even then, you will have to make drastic changes to see results reflected in A/B tests and you will know what doesn’t work but not the reason why, which is what helps you truly improve your site or product.
With Conversion Crimes you don’t need any traffic because we automatically find users for you to test with.
A platform like Hotjar can be great to get quantitative data and metrics for you to improve your user experience. Heatmaps and user recording videos can provide some useful data on frequent behavior patterns. However these won’t help you understand what’s underneath, the reasons why users act a certain way.
With Conversion Crimes you get real people recording their screens while on your site or app, and talking through their thoughts out loud for you to hear. You’ll get insights like:
As a business, you want people to love your products or services, so they give their money to you instead of competitors.
To have people love your products or services, you need to know if they understand them and how they use them, starting from your website. That’s where user Conversion Crimes comes in.
We help you understand:
And more…
By answering these questions, you’ll create a better experience – from website to product – for your customers. This will improve your conversion rate and bottom line.
Ideally, usability testing should be done on prototypes before your product or site launches or before a redesign of business change. You should always be testing though. No website or app is perfect but it should constantly be adapting to the audience’s needs.
We created our Subscription tiers with 1 test per month. Ideally you could set a 6-month testing plan and completely transform your business with the insights and improvements you get over time.
Those tiny tweaks that lead to more conversions compound over time. It doesn’t take a lot to make a big shift.
It depends on what you are testing for. If the task is easy or fast to complete use 1-2 minute. If the task is more difficult 3-4 minutes. Then add 2 minutes to your final calculation.
Below are examples of video lengths and what kind of user testing videos you would get with each one.
1-5 minute tests
1-5 minute tests are great for gathering information on first impressions or to answer a quick question about your website. Such as, does your value prop headline articulate who you are and what you do clearly? Do people understand what you want them to do on the website? What is the first thing you would click on if you landed on this page and why? Use 3 minutes when you want them to make one simple action in addition to a first impression.
5-10 minutes tests
This is great to see how users navigate through your website and look for information. This is enough time to browse a website and look for an item or service to buy.
10-15 minutes tests
This is ideal to understand the whole user experience. From the moment they land on your site to choosing a product or service. It’s great for finding out the main enquiries about a product or service you are offering.
15-20 minutes tests
This is great for SAAS or app onboarding processes which take longer and have more steps. Some of which can take considerable time to figure out, fill forms, and complete the process.
For example:
You’re able to get customers to sign up, but they can’t understand how to do the tasks in the app and thus aren’t converting to paid accounts. Depending on what, how complex and how many steps are required to do the process in your app, would depend on the length of the video. If it takes 5-7 minutes or less for a user to complete the process outlined in your tasks a 12 minute test should suffice. If it takes 8 or more minutes complete, choose 15-20 minutes for your test.
We’re currently in the process of creating a library of templates for any kind of business (ecommerce, SaaS, Lead gen, Membership, Affiliate & content, , Productized service etc).
In the meantime you can let us write your test if you sign up on a subscription plan: Self-Serve or Expert Insights. You can also buy the “test set-up” add-on in our “Pay Per Test” option.
You can ask users to complete tasks on a website, app (yours or competitors’), or even wireframe/website mockup. As long as what you need to test has a URL link, you can test it.
The purpose is to get feedback on what users are thinking, trying to do, or get frustrated with.
Do not create a test where the purpose is to get a user to:
If your test contains adult content, make sure you select the related option in the test creation page.
We want you to be completely satisfied with your test. If after receiving your test results you are not satisfied, we’ll either provide you with another one or return the credit to your balance.
The general consensus amongst UX practitioners is to avoid getting too specific when finding testers. The majority of products should be clear and easy to use by anyone. However, getting someone with domain knowledge will provide better insights. Aim for a broad net, not pinpoint.
Currently we offer the following demographics:
More coming soon…
In addition, we offer a write-in option where you can specify extra requirements like, “speaks French” “reads the news” “manager” “plays chess” and “interested in sports” “uses “Google Chrome” etc.
Keep in mind the more specific you are, the longer your test will take to complete.
We do not have a service for small fixes. However, if you’re looking for someone to do user testing and create a detailed report and wireframes to guide your team or a freelancer to fix your conversion crimes – our conversion audits at Zeda Labs are a great fit.
Our users are mostly from the USA and Canada but we also have European users. Even if your business sells internationally we’ve got you covered.
On average tests are completed within 24 hours depending on the test length and on the demographic (male, female, age range, web expertise etc.) you pick for it. The more specific you are, the longer your test will take. We’re actively working on expanding our tester base to improve test delivery times.
Remote user testing gives you rapid customer feedback on almost any digital experience you can imagine, including websites, mobile apps, prototypes, and more. Anything online can be tested.
You’ll receive a video screen recording of someone using your website or app, thinking out loud as they try to compete tasks that you give them. The user is in their own environment, on their own device—with all their quirky settings—acting as they normally would, so you get realistic results.
Remote user testing is faster, easier to run, and waaay cheaper than a traditional in-person lab setting—meaning you’re more likely to do it!
Yes, user testing is used by top companies like Walmart, Facebook, Zillow, Constant Contact, CBS, Bose, NBC, Amazon, AirBnB, and Spotify.
For people in the know, it’s a conversion increasing secret weapon.