Does OnSite Analytics include any data from our Google Analytics?
No, OnSite Analytics uses Insider One data.
Would using the Web SDK affect the accuracy of numbers?
Yes, it might. Without the Web SDK, system rules can stop working due to changes on your website. For example, if you change your cart page design without informing the Insider One team, this can stop us from tracking revenue and cart counts if you are not using the Web SDK.
To keep revenue and cart tracking reliable, integrate the Web SDK for cart and purchase data. If you change your cart, checkout, or product page design while still relying on system rules, tell the Insider One team before the change goes live so the rules can be updated.
Can "incremental conversions" or "incremental revenue" be negative?
No, the incremental values display the increased values.
How can the incremental revenue or conversions of a month be higher than those of 3 months?
This is due to how incremental revenue and conversions work. If you have positive values for 2 months and a negative value for 1 month, the overall 3-month value can be lower than the incremental value of a 1-month period. Let's say you have 300.000 incremental values in April, 450.000 in May, and 0 in June. If you receive a negative incremental metric in June, it displays as 0. If you select three months, you will see a value below 750.000 because June has a negative incremental value.
Why do I sometimes see a summary metric (incremental revenue) match a campaign's incremental revenue?
The summary metric for the incremental revenue is a formula. Since the OnSite campaigns do not have an attribution model, this formula is used instead of the raw data with attributed revenue. That's why Insider provides the campaign with incremental revenue as a summary metric if a summary metric is less than a single campaign's incremental revenue.
What does a 0% significance mean?
It means the conversion rates of the variant and control groups are close.
What does an 85% or above significance mean?
It means that the conversion rates of the variant and control groups are not close to each other. A variant can have a higher or lower value than the control group's conversion rate, but not be equal to or similar to it.
Can the Bayesian probabilities change?
Yes, they can. In low-sample campaigns, the likelihood to win can change.
What happens if a variant has 0% significance, but the Bayesian is almost 100%?
Since the Bayesian is a separate significance calculation, it does not have to correlate with the significance values.
Is there a relation between incremental metrics and Bayesian?
No, there isn't. The Bayesian is not related to the calculation or importance of the incremental revenue. They are mutually exclusive metrics.
Why cannot I see our campaign on the OnSite Analytics page?
First of all, you need to make sure to remove all the applied filters. If you still cannot see your campaign, it might be due to the number of impressions and conversions. Only campaigns with at least 10 impressions and 1 conversion are displayed on the OnSite Campaign Analytics page.
If a CG (A/B) campaign has fewer than 10 impressions or no conversions in the control group, it appears under the 'Without Control Group' tab. When the campaign reaches 10+ impressions and 1+ conversions, it is displayed under the 'With Control Group' tab on the OnSite Campaign Analytics page.
For campaigns under 'With Control Group' analytics, you can use the 'show 0 conversion campaigns' filter to list those with 10+ impressions and 0 conversions.
Campaigns without a control group and 0 conversions are not visible on the Analytics page in either tab.
Why is the incremental revenue of the Purchases From Clicks goal greater than that of the Purchases goal?
In some cases, the incremental revenue of the Purchases From Clicks goal may be higher than that of the Purchases goal. For example, if your control group has no corresponding clickable element, your conversion rate would be 0. According to the incremental revenue formula, if the control group conversion rate is 0, then your variation group revenue equals your incremental revenue. For this reason, incremental revenue seems higher when you select the Purchases From Clicks goal than when you select the Purchases goal.
I created a campaign with a traffic allocation set to 80%-20%. However, I see the campaign listed under the Campaigns Without Control Groups. What could be the reason?
If the control group has fewer than 10 impressions or no conversions, the campaign is listed under Campaigns Without Control Groups. The control group needs at least 10 impressions and at least 1 conversion for the campaign to be listed under Campaigns With Control Groups.
If a customer purchases 2 items at once, is it counted as 1 conversion or 2 conversions?
It counts as 1 conversion, regardless of how many items are purchased.
When can I report Bayesian values?
You can report campaigns along with their probability of win. However, if a campaign has a low sample size, these values may still fluctuate. If the incoming data remains consistent, the probability to win will stabilize at X%.
Before acting on a low-sample result, let the campaign collect more impressions and conversions, and report the probability to win together with the sample size.
Is there a relation between incremental metrics and Bayesian?
No, there isn’t. Bayesian has no relation to the calculation or importance of incremental revenue. They’re mutually exclusive metrics.
Should the sum of incremental revenues for each day in a month equal the total incremental revenue for that month?
It is normal for the summation of daily values not to be equal to the total incremental revenue due to the incremental nature of the metrics. Here are three points to keep in mind:
Negative incremental revenue values are displayed as 0, but they contribute to the monthly calculation, potentially resulting in a lower total compared to the sum of daily values.
The summary metric calculates unique revenues. Incremental revenue considers daily unique revenue, but for a monthly view, it's unique for the entire month. This difference contributes to a discrepancy from the total of daily values.
In the summary incremental revenue formula, Unique Revenue x ΣIncremental(revenue) / ΣVar(revenue), the summation considers campaign-level incremental revenues within the selected date range. This is calculated with the formula Var(Rev) - ((Var(Imp) x CG(CR)) x CG(AOV)).
For instance, if a campaign's CG conversion rate for a single day is 3, this rate can increase to 10-15 within the month, causing the monthly incremental value to decrease. This calculation logic explains why the total of day-by-day incremental revenue may not equal the monthly value.
Campaigns listed on the OnSite analytics page can change daily. A campaign needs at least 10 impressions and 1 conversion to appear. For a monthly calculation, a campaign may reach these thresholds, influencing the overall value calculation.
Why do I see different revenues for Smart Recommender campaigns on the OnSite Analytics page?
The attribution works differently for the data shown on the OnSite Analytics and Smart Recommender Analytics pages:
Smart Recommender analytics attributes revenue to both campaigns and products. For example, if a user views a campaign for product X and makes a purchase within the attribution window, both OnSite and Smart Recommender analytics will display the revenue.
However, if the user views the campaign for product X but purchases product Y, OnSite analytics will show revenue, but Smart Recommender analytics won't.
Where can I find unique revenue and unique conversion metrics for my OnSite campaigns?
You can obtain these values from the exported report summary tab. The generated reports, based on date selection and applied filters, include unique revenue and conversions for the relevant results.
Can I export 1+ year data for my OnSite campaigns?
You can export OnSite campaign data from within the past two years. Each export can cover a date range of up to one year. To export more than one year of data, select and export separate date ranges.
How can I include click data in the file when exporting OnSite analytics?
Before exporting the OnSite analytics with Control Group, make sure to select "Clicks" as your conversion criteria. This way, clicks will be displayed as a conversion criterion, alongside the conversions column, in the exported file.
Can incremental metrics be attributed to specific campaigns based on user interaction rather than when they appear?
Yes, Insider supports click-through attribution by interaction. You can simply select "purchase from click" as your conversion criteria to measure incremental revenue driven by clicks.
Why can campaign impressions be lower than the number of users in a User Profile segment for the same date range?
Campaign impressions are counted when a campaign is triggered and becomes visible to a user on a page. Campaign analytics therefore reflect actual campaign displays, subject to campaign rules such as re-eligibility and frequency behavior.
A User Profile segment count, by contrast, shows the audience returned by the segment query at the time the count is calculated or refreshed. It does not reconstruct the exact eligibility state that existed at each historical page visit.
For this reason, the two numbers may differ. For example, a user may currently match the segment conditions, but may not have been eligible to see the campaign on the relevant visit. Use campaign analytics to validate impressions, and use User Profile segments to analyze audience composition rather than to match past impression totals one-to-one.