Closed-Loop Measurement
Every save is measured against a randomised holdout, attributed by offer arm, and fed back to retrain the model — 31% save rate at $310 per save, 6.6× program return.
Save rate
31%
treatment · vs 22% randomised holdout
Holdout lift
+8.6 pts
causal lift, holdout-adjusted
Cost per save
$310
blended across offer arms
Program ROI
6.6×
$524K MRC retained/mo · $6.29M annualised
Retention Curve · T+90
Cohort retention vs randomised control
Copilot treatment Randomised holdout
Subscribers retained 90 days post-intervention+8.6 pts at T+90
Save Rate vs Holdout
Copilot treatment31%
Randomised holdout22%
+8.6 pts holdout-adjusted lift
Saves this cycle612
MRC retained$524K/mo
Annualised value$6.29M
Offer Arm Performance
Offer arm attribution · lift per $ spent
Loyalty Upgrade Bundle
Saves
214
Lift
+11.2 pts
Cost/save
$385
ROI
7.4×
Term Renewal + Data Boost
Saves
187
Lift
+8.1 pts
Cost/save
$260
ROI
6.9×
Care Escalation + Credit
Saves
96
Lift
+5.4 pts
Cost/save
$210
ROI
4.1×
Device HUP Only
Saves
71
Lift
+6.8 pts
Cost/save
$330
ROI
5.2×
Same-day Retention
Saves
32
Lift
+4.9 pts
Cost/save
$180
ROI
3.6×
Convergence Add-On
Saves
12
Lift
+3.2 pts
Cost/save
$450
ROI
2.4×