Weekly guide to tracking recommendation performance: impressions, clicks, and add‑to‑cart

Conclusion: focus on just these three metrics each week

Once you start digging into recommendation metrics, there is no end to what you can look at. First narrow it down to just the three items below and build a habit of checking them once a week, at the same time every week.

• Impressions: how often recommendations were actually seen
• Click-through rate (CTR): out of those impressions, how often they were clicked
• Add to cart count: after a click, how often an item was added to cart

By checking just these three with “how does this compare to last week?” and “which placement is strongest?” you will quickly see:
- which page’s recommendations you should strengthen
- which placements you should rethink

Before you start: clarify what is tracked where

Before you start weekly improvements, get clear on which metrics you can see on which screens. At minimum, distinguish between the two entry points below so you do not get lost.

• Shopify admin Analytics: use this when you want to see store-wide numbers such as revenue, sessions, add-to-cart, and so on
• Recommendation app reporting: use this when you want to see recommendation-specific numbers such as impressions, clicks, and add-to-cart per placement

In this playbook, the assumed flow is:
1. Use Shopify Analytics to understand the overall trend
2. Use your recommendation app’s reporting to dig into the details

Step 1: use Shopify Analytics to grasp overall changes

First get a rough sense of how the store as a whole performed this week, so you have context before looking at recommendation metrics.

• In the Shopify admin, open Analytics → Dashboard.
  - Set the date range in the top right to “Last week” and turn on comparison with the previous period.
• Check Total sales and Online store sessions.
  - If sales or sessions are swinging up or down sharply, assume factors beyond recommendations are also at play, such as ads or sales campaigns.
• Check Online store conversion rate.
  - If conversion rate is up but sales are down: it likely means traffic itself has decreased.
  - If conversion rate is down: the path to cart (product pages, cart area, etc.) may have issues, so include recommendations in what you review.
• Check a metric close to add-to-cart rate, such as “Products added to cart.”
  - Look at this to get a feel for whether products are being added to cart smoothly overall.

At this stage you do not need to conclude “sales went up or down because of recommendations.” The goal is simply to understand the overall condition of the store.

Step 2: review impressions, clicks, and add-to-cart for each recommendation weekly

Next, open your recommendation app’s reporting screen and review performance per placement. This is where you decide what to improve.

• In the Shopify admin, go to Apps → your recommendation app → Reports or Analytics.
  - Set the date range to “Last week” and, if possible, turn on a view that compares with the previous week.
• Review impressions per recommendation placement (product page, cart page, home page, etc.).
  - Placements with extremely low impressions: the position may not be visible enough, or the page itself may have little traffic.
  - Placements with high impressions: these are your main opportunities where improvement can have the biggest impact.
• Check CTR for each placement.
  - If a placement’s CTR is clearly lower than others: candidates to review include visual design, title, product order, and recommendation logic.
  - Placements with high CTR: they are working well, so avoid making big changes for now and prioritize maintaining them.
• If you have add-to-cart count or add-to-cart rate per placement, review that as well.
  - Placements that get clicks but few add-to-carts: the destination products or price range may not fit customer expectations.
  - Placements with few impressions but high add-to-cart rate: these are “hidden top performers” that deserve more exposure.
• Mark any placements where there was a particularly large change from last week to this week.
  - For impressions, CTR, or add-to-cart, pick two or three placements that moved the most versus last week and jot them down.

Once you get this far, you will know which placements to tweak this week. Next, decide exactly what to change based on the numbers.

Step 3: work backwards from the numbers to decide what to adjust this week

It becomes simpler if you break down improvement points by “which metric is weak.” Use the checklist below to decide what to change this week.

• A. What to do for placements with low impressions
  - In the Shopify admin, open Online Store → Themes → Customize and check where the recommendation section sits in the layout for the target page.
  - If it is too far below the first view, move the recommendation section one or two blocks higher.
  - If the page itself has little traffic, consider whether you can place the same recommendation block on the home page or other high-traffic pages.
• B. What to do for placements with low CTR
  - In your recommendation app, open Settings → Layout / Title settings and check the placement title.
  - Instead of only vague labels such as “Recommended for you” or “You may also like,” change titles so the meaning for the user is clear, such as:
  - “Frequently bought together”
  - “Other sizes of this item”
  - If too many products are shown and they get buried, either reduce the number of products per row or switch to a layout that is easier to scroll through.
• C. What to do for placements with few add-to-carts after click
  - In your recommendation app, open the logic settings screen and check the logic used for that placement.
  - If the price range is all over the place or far higher than the main product, adjust filters such as price range so items with similar prices are shown.
  - Also check for out-of-stock items, and if needed, turn on a setting like “Show in-stock products only.”
• D. Decide which placements to tackle first
  - Prioritize in this order:
  1. Placements with high impressions and low CTR (biggest upside)
  2. Placements with low impressions and high add-to-cart rate (top performers you want to expose more)
  - Limit yourself to at most two placements this week and note down exactly what you changed and where.

The key is not to try to fix everything at once. Narrow it down to two placements and prioritize being able to tell which change actually worked.

Placement and operations tips: make the weekly check a habit

To keep improving recommendations on a weekly cycle, it helps to decide in advance when you will look at the numbers and what rules you will use to review them.

• Check at the same time on the same weekday every week.
  - Example: every Monday morning, spend just 15 minutes looking at Shopify Analytics and your app’s Reports.
• Decide the viewing order and note format in advance.
  - 1) Overall sales and sessions (Shopify)
  - 2) Impressions, CTR, and add-to-cart per recommendation placement (app)
  - 3) Which placements you will adjust this week and what you will change
  Record these every week in the same format in a spreadsheet or notes app.
• Decide basic placement rules.
  - Product page: place the recommendation block right below the product description or just before reviews.
  - Cart page: place related or frequently bought together products below the cart item list.
  - Home page: if you show new arrivals or rankings, place them slightly below the fold instead of directly under the first view.
  If you summarize these “ground rules” on a single sheet, you will not get lost even when you change themes.
• Do not change too many things in a single iteration.
  - If you change placement, title, and logic all at once, you will not know what actually drove the result.
  - Each week, try to limit changes to one or two items, such as “only placement this week” or “only titles this week,” to make analysis easier.

Common pitfalls and a checklist to avoid them

Here is a checklist of common stumbling blocks in recommendation measurement. Skimming this during your weekly review can save you a lot of unnecessary trial and error.

• Pitfall 1: judging recommendation performance only by sales
  - Sales are affected by many factors such as ads, seasonality, and inventory.
  - Checkpoint: always review the trio of impressions, clicks, and add-to-cart together.
• Pitfall 2: using different metrics or date ranges from week to week
  - When ranges do not line up, comparison becomes difficult and you lose the feel for progress.
  - Checkpoint: in both Shopify and your app, always set the date range to Last week before reviewing.
• Pitfall 3: immediately deleting underperforming placements
  - If you remove a block before investigating causes, you may waste valuable traffic.
  - Checkpoint: before deleting, change just one of placement, title, or logic and watch it for one to two weeks.
• Pitfall 4: comparing numbers from sale or campaign periods as-is
  - During special events, user behavior differs greatly from normal.
  - Checkpoint: for sale weeks, leave notes and record them separately as special weeks. Compare only normal weeks against each other.

If you are using RecoBoost, you can start a weekly measurement loop today by following the steps below.

• Open Apps → RecoBoost → Reports, set the date range to Last week, and check Impressions, Clicks, and Add-to-cart for each placement.
• While reviewing the numbers, open RecoBoost → Recommendation settings and, starting from placements with low CTR, adjust titles and logic one by one (for example AI類似商品 or AI一緒によく買われる商品).
• Pick just two placements you want to measure, and once a week record in a spreadsheet the placement name, changes made, date, impressions, clicks, and add-to-cart.
• For placements with a high add-to-cart rate, go to Themes → Customize and move them one block higher to increase impressions and lift overall performance.