Check your test every day. Ship only real winners.Check your test every day. Ship only real winners.
A/B, multivariate and split-URL tests on your store, with a report built to be
read while the test runs. Every variant shows its chance of being the best and
the risk of picking it — and nothing is called a winner until the data has
earned it.
The Mtrix experiment report for lumière.co's test "Lifestyle photo on the PDP", day 16. The All variants table lists,
for Control, Lifestyle photo and Scent notes first: allocation, confidence, visitors, conversion rate, next page
visits, add to cart, checkout start and complete, and revenue. Lifestyle photo has a 98% chance of being the best
and converts 24.5% better than control. Switch to Statistics for the engine's verdict: Variant 2 wins.
Experiments/lumière.coM
Experiments/Lifestyle photo on the PDPIn progressA/B Testing·2 pages·started 31 Aug 2026
SummaryReportLogsUpdated 4 min ago
ReportsAll variantsSortedSelect rangeFilters
All variants3AllocationConfidenceVisitorsConversion rateNext page visitAdd to cartCheckout startCheckout completeAvg. revenueTotal revenueRPU
Pick the page and the part of it to change, add the variants, write down why the change should win, and start it. Once Mtrix is on your store, that’s the whole job.
Experiments/lumière.coM
Experiments/Lifestyle photo on the PDPIn progressA/B Testing·2 pages
SummaryReportLogsUpdated just now
Hypothesis
Show the candle lit, in a room. A lifestyle photo shows the candle in use. We expect more shoppers to buy after seeing it than after the studio shot.
StatusIn progress
LocationsEdit/products/aurora-candle/products/linen-candleAudienceEditTargetingAll VisitorsTraffic share100%No audience is linked, so every visitor on the selected pages is eligible.
Variants 3+ AddPDP heroHide all variantsControlLifestyle photoScent notes first
Four kinds of testA/B, multivariate, split URL — traffic sent to separate pages — and mask URL.
Variants built in the editorMake what each variant shows in the Mtrix editor. No hand-written code.
Assigned on the serverMtrix picks each shopper’s variant on its servers and keeps returning shoppers on the one they saw.
No cap on testsRun as many experiments as your traffic can carry, on any paid plan.
Chart any event, already split by variant.
Right above the table sits a full chart builder scoped to the test. Pick any event your store tracks and it’s
broken down by variant from the start — then segment it further, filter it, or turn it into a funnel.
Experiments/lumière.coM
Experiments/Lifestyle photo on the PDPIn progressA/B Testing·2 pages·started 31 Aug 2026
SummaryReportLogsUpdated 4 min ago
TodayYesterday7 Days30 Days90 DaysCustomHDMLineAdd comparisonAdd to Cart by Variant Name and Device Type
One click from the table, the statistics view says in plain words whether to keep waiting or roll out. It’s
designed to be watched while the test runs — so looking early doesn’t fool you.
Day 3Day 9Day 16
Experiments/lumière.coM
Experiments/Lifestyle photo on the PDPIn progressA/B Testing·2 pages·started 31 Aug 2026
SummaryReportLogsUpdated 4 min ago
ReportsTableStatisticsConversion rateRevenue per userAdd to cart rateAll time
Variant 2 winsRoll out Variant 2We have a winner
Hide help
StatusTells you whether the test is still collecting data, is readable, or has reached a decision. Don't act until it's decided.Chance to be bestHow likely this variant is the single best option. Higher is better — 90%+ is strong.Risk if you pick itThe expected downside (in conversion rate) if you choose this variant and it's actually not the best. Lower is safer.Peeking-proof verdictYou can check this dashboard as often as you like without fooling yourself — these results stay honest even when you look early and often.
Primary metricConversion RateRunning for16 daysTotal visitors62,820Numbers cover31 Aug 2026 – now
Conversion Rate3 arms
Variant 1 (Control)
Control2.2%
Conversion Rate likely between 2.0% and 2.4%
20,840 visitors·458 conversionsBaseline
Variant 2
Winner2.7%+24.5% vs control
Conversion Rate likely between 2.5% and 3.0%
Chance this is the best98%Risk if you pick it0.0%Verdict (peeking-proof)Beating control
VisitorsConversionsRuntimeConsistency
21,020 visitors·576 conversions
Variant 3
2.4%+7.3% vs control
Conversion Rate likely between 2.2% and 2.6%
Chance this is the best2%Risk if you pick it0.4%Verdict (peeking-proof)Not enough to call yet
VisitorsConversionsRuntimeConsistency
20,960 visitors·494 conversions
What a winner has to clearA 95% chance of being best, little risk of being wrong, 100 visitors and 25 conversions per variant, seven days, and a verdict that holds up to peeking.
Change the split mid-testMove traffic between variants while the test runs. The report notes the change and accounts for it.
Filter by another testRunning two tests on the same pages? Filter one report by the variant shoppers saw in the other.
Watch a variant’s sessionsOpen the session recordings of shoppers who saw any variant — the fastest way to see why it won.
Ship the winner. Take it back exactly.
When the call is made, send the winning variant to every shopper in one step. It becomes the page’s new default and goes live with your next publish — and if you change your mind, rolling back restores precisely what was there before.
Experiments/lumière.coM
Experiments/Lifestyle photo on the PDPShippedA/B Testing·2 pages·started 31 Aug 2026
SummaryReportLogsUpdated just now
ShippedShippedjust now
“Lifestyle photo” takes 100% of traffic and is every affected component's default in the CMS. The experiment has stopped collecting results.
Roll backRolling back restores the exact CMS defaults recorded before the ship — not a guess at what control was.
Not live yetPublish to put “Lifestyle photo” live
1 component now defaults to “Lifestyle photo” in the CMS. The live site keeps serving the previous default until the next production publish — defaultVariantId is a literal compiled into the page when you publish, so the database moving is not the site moving.
Even after publishing, a returning visitor whose last page view was under an hour ago keeps the arm they were already assigned — the storefront replays that assignment for an hour.
PDP hero → Lifestyle photo
Open the builder to publish
Variant 2 winsRoll out Variant 2We have a winner
How to read this
Primary metricConversion RateRunning for16 daysTotal visitors62,820Numbers cover31 Aug 2026 – now
Conversion Rate3 arms
Variant 1 (Control)
Control2.2%
Conversion Rate likely between 2.0% and 2.4%
20,840 visitors·458 conversionsBaseline
Variant 2
Winner2.7%+24.5% vs control
Conversion Rate likely between 2.5% and 3.0%
Chance this is the best98%Risk if you pick it0.0%Verdict (peeking-proof)Beating control
VisitorsConversionsRuntimeConsistency
21,020 visitors·576 conversions
Variant 3
2.4%+7.3% vs control
Conversion Rate likely between 2.2% and 2.6%
Chance this is the best2%Risk if you pick it0.4%Verdict (peeking-proof)Not enough to call yet
VisitorsConversionsRuntimeConsistency
20,960 visitors·494 conversions
Run a testing program, not one test at a time.
Every experiment sits on one list with its leader and confidence, sorted by what’s ready to call. The program board lines up the uplift of every running test on one scale, so you can see at a glance which results have settled.
Lifestyle photo on the PDPLifestyle photo · day 1621,02098.0%+24.5%+11.2% to +38.1%Ready to call
Free shipping bar thresholdThreshold $60 · day 1214,88081.0%+6.2%−2.4% to +15.3%Running
Lifestyle photo on the PDPScent notes first · day 1620,9602.0%+7.3%−3.9% to +19.0%Running
Checkout trust badgesBadges · Reviews · day 63,21058.0%+3.1%−9.8% to +17.6%Too early
Collection grid density3-up grid · day 2118,24012.0%−4.0%−9.1% to +1.2%Running
axis −10% → +25%interval still crosses zero
Ready to callPassed every decision gate · the action queue
TestUpliftP(best)
Lifestyle photo on the PDP · Lifestyle photo+24.5%98.0%
Time to significanceFrom start to the first readable state
Test · engineReadableDecided
Lifestyle photo on the PDP · v27 days16 days
Collection grid density · v27 days—
Free shipping bar threshold · v28 days—
Test it. Read it honestly. Ship the winner.
Run A/B, multivariate, split and mask-URL tests on your store, check the report every
day without fooling yourself, and ship the winner as your page's new default — then
start the next one.
The rigor of an experimentation team. Without the team.