Measuring Impact

Basics: Measuring Impact

Products sold through Clerk #

One of the great things about Clerk.io’s Dashboard is that you can see exactly which orders were impacted by Clerk.io and how much better these orders are, with precise details.

An order is considered to be impacted by Clerk.io if a customer has added a product to their order through Recommendations or Search.

Clerk.io only measures a sale through Clerk.io if the customer goes through these 3 steps in their session:

  1. They click a product through a Clerk.io recommendation or search result.

  2. They proceed to put the product in their basket.

  3. They place the order with the product in their basket.

Any other products in the order that were bought elsewhere in the webshop, for example through categories, are shown as Organic Sales in the Order Details:

This means that you can always see the exact impact the Clerk.io has had on your orders.

Statistical significance #

We often get the question of whether the Clerk impacted orders, would not have contained the same products even if Clerk was not used on the website.

It’s true that it’s impossible to know whether a customer would or would not have bought the same products by looking at any 1 order.

That’s why we at Clerk believe in transparent, statistical significance, which can always be seen through the Dashboard.

After all, if more than 100 orders have been impacted by Clerk.io, and these orders have an average of 10% increase in basket size and order value, it can no longer be by chance that Clerk makes customers buy more.

This is visualised on the main Dashboard:

Clerks main Dashboard #

Customer Spend

The total number of orders and average extra order value used to make the “Extra Revenue” calculation are filtered to the time frame selected (the default time frame is last 30 days).

Extra Revenue is calculated by:

(# of orders that include products found via Clerk.io) * (Average extra order value generated when products are found via Clerk.io) = Extra Revenue

Revenue #

The Revenue chart shows the ratio of revenue generated from different sources, breaking down revenue coming from Clerk.io Recommendations (shown in green), Clerk.io Search ( yellow), Clerk.io Email ( red), and Organic / non-Clerk.io revenue ( light blue).

To the left of the chart, you’ll find:

  1. The total number of products purchased through any of the Clerk.io Products (Search, Recommendations, Email) enabled in your webshop

  2. Total number of orders including at least one product found through Clerk.io, and

  3. Total revenue generated through products found via Clerk.io.

Green percentages represent the proportion of sold products, orders, and revenue that were generated through Clerk.io. All of these sections are filtered by the time frame selected at the top of the Dashboard page ( default time frame is last 30 days).

Average Order Value #

The line chart breaks down the average order value when an order includes products found using Clerk.io’s Search ( yellow), Email ( red), or Recommendations ( green), as well as the overall average order value ( dashed blue line) and non-Clerk.io average order value ( grey line).

On the left, you’re provided the average increase in order value when customers find and purchase products via Clerk.io Search, Email, and/or Recommendations vs. the store average order value.

In this example, the average order value is 19% higher when customers find and buy products via Clerk.io vs. average order value when all products in an order are found without Clerk.io.

Basket Size Improvements #

The Basket Size chart is read just like Average Order Value, but Basket Size measures the average number of items purchased that were found via Clerk.io.

In this example, the average basket is 29% larger when Clerk.io is used to find products in the order vs. when their order does not include products found via Clerk.io

The green percentage to the left of the line chart indicates the average increase of an order’s basket size when products in the order are found via Clerk.io vs. overall average basket size.

This is calculated as:

(Average Basket Size with products found via Clerk.io - Overall Average Basket Size) / (Overall Average Basket Size)

Conversion Rate Improvements #

The Conversion Rate chart is also broken down like Average Order Value and Basket Size, but Conversion Rate measures the percentage of Clerk.io Search/Recommendation/Email click-throughs that result in purchases vs. the store’s total product click-throughs that result in purchases.

On the left side of the Conversion Rate section, the clerk Conversion Likelihood ( green percentage) is calculated as:

( Clerk.io Purchase Likelihood - Store Average Purchase Likelihood) / (Store Average Purchase Likelihood)

Performance Benchmark for each Clerk.io Product

The Performance Benchmark shows how well your active Clerk.io products (Email, Search, and Recommendations) perform on your store compared to other stores using those same Clerk.io products. The further to the right an Email, Search, or Recommendations marker is, the better that Clerk product is performing on your store vs. other Clerk-enabled stores.

In this example, Search and Recommendations are performing well, but Email is underperforming compared to other stores. Underperforming Clerk products means your usage of the product needs to be modified to increase conversion.

Tracked Orders #

In Tracked Orders, you’re provided the Order ID, time the order was placed, number of items in the basket, total order value, and value added to the order via products found through Clerk.io.

Impact from Clerk.io” is a blue bar visualising the percentage of the order that was found via. Clerk.io vs. non-Clerk.io sources.

Just like the main Dashboard, you can filter these orders by the desired time frame, with the default set to the past 30 days.

Order Details #

Order Details provide more insight into the specifics of an order, including a list of the Products purchased, how many of each Product were purchased, and the value by Product.

When the product is found and added to an order using a “Clerk.io Source”, this is included in Details.

In the above example, “Simply Acrylic Brush Zip Case” was found/added through a non-Clerk.io source, while “System 3 Acrylic Paper Pads” were found and added through Cart Recommendations.

Differences from Google Analytics #

Google Analytics (“GA”) is one of the most popular tools used among website owners.

Many eCommerce owners use this tool to track important metrics, such as pageviews, searches, conversion rates, ROI of paid advertising and so on.

It is then natural to try comparing the data provided by GA with the data calculated by Clerk.io, especially regarding Clerk.io’s product usage

However, the two tools are meant to measure different metrics with different calculation logics.

This article focuses on explaining why the metrics in GA will not match the ones in your Clerk.io’s account.

The video below summarizes the points in this article:

The main differences in the way the 2 tools measure the number of searches are:

  • Clerk.io measures searches related to both the Instant Search and the Search Page.
  • GA measures only searches where the customer loads the Search Page (which means after pressing Enter or clicking on “View more results”), since it is able to measure only based on page changes. All Searches made in the Instant Search are therefore excluded by the calculations. Moreover, also multiple searches on the same keyword during the same session are excluded

Recommendations #

The main differences in the way the 2 tools measure pageview and recommendations usage are:

  • Clerk.io is based on the number of recommendation banners installed on each page. For example if your product page has 1.000 views per month and you have installed 2 of Clerk.io’s recommendation banners, your monthly usage for the product page will be 1.000 x 2 = 2.000 views per month. The usage does count reload of the same page within the same session
  • GA does not consider the number of recommendation banners installed. Moreover, the number of pageviews itself can differ from Clerk.io since GA’s tracking script is often blocked by ad blockers while Clerk.io is not.

More information on how Clerk.io measures the usage can be found in this article

More information on the specific metrics found in Clerk.io and GA can be found below.

Clerk.io #

Search dashboard #

  • Total visitors → the number of total visitor IDs tracked within a given time period. A new visitor ID is assigned dynamically based on how often the visitor comes back – when there is no visitor ID we generate a new one.
  • % of your visitors uses search while shopping → how many visitors have used Clerk.io’s Live Search or Search Page out of the total visitors
  • Total number of Searches → number of total searches made by visitors within a given time period that returns products

Recommendations dashboard #

Views for each recommendation slider: every time the page/the pages containing the slider are loaded. It does count a reload of the same page within the same session.

Usage Dashboard #

Search Usage: may be higher than the Clerk.io’s Total Number of Searches since it includes additional elements returned by Clerk.io (such as categories, blog pages and suggestions) and interactions with Facets.

If you need any further help or have any questions, please reach out to your Customer Success Manager.