Back to browse
Agentic simulator for marketing email A/B testing

Agentic simulator for marketing email A/B testing

by robertnowell·May 18, 2026·2 points·0 comments

AI Analysis

●●●BangerBig BrainSolve My Problem

Simulates A/B tests on 100 LLM agents so you don't burn revenue on real customers.

Strengths
  • Competitive inbox simulation forces agents to prioritize your email against 99 others.
  • Explicit attention and budget constraints prevent hallucinated infinite engagement metrics.
  • Directly addresses the opportunity cost of splitting traffic on losing variants.
Weaknesses
  • LLM persona fidelity is unproven; agents may not mirror actual human purchasing behavior.
  • Risk of becoming a 'vibes check' tool rather than a statistically significant predictor.
Category
Target Audience

E-commerce marketers, Growth teams

Similar To

Obviously AI · Forecastly · Mutiny

Post Description

I built an agentic simulator for marketing email a/b testing using a fleet of "digital twin" customers.

why build this? because email marketing a/b tests come at a big cost -- every a/b test run burns through a company's actual human audience.

what if you could learn which campaigns are more likely to resonate with customers by a/b testing against a fleet of (hundreds, thousands, millions) of customer agents?

each agent is grounded in your target customer persona, sees an identical inbox of e-com promotions (except for your A/B email), and has a limited budget of email opens, clicks, and money to spend.

optimized metrics include open rate, click rate, and conversion rate.

goal is to predict whether email A or email B will perform better with your audience, not predict real revenue numbers.

Similar Projects