Skip to main content

Messages and A/B Testing

Optimize your conversion rates by testing different messages.

Understanding A/B Testing​

A/B testing allows you to compare multiple message versions to identify the one that converts best.

How It Works​

                   Visitor with Ad Blocker
                           │
                           ▼
                  ┌─────────────────┐
                  │  Variant        │
                  │  Attribution    │
                  │  (33% each)     │
                  └─────────────────┘
                           │
          ┌────────────────┼────────────────┐
          ▼                ▼                ▼
    ┌──────────┐    ┌──────────┐    ┌──────────┐
    │ Control  │    │Emotional │    │Alternative│
    │ (33%)    │    │ (33%)    │    │  (33%)   │
    └──────────┘    └──────────┘    └──────────┘
          │                │                │
          └────────────────┼────────────────┘
                           ▼
                  ┌─────────────────┐
                  │  Measure        │
                  │  Conversions    │
                  └─────────────────┘

Stable Attribution​

Each user is assigned to one variant that remains stable throughout their session:

  • Based on session ID hash
  • Uniform distribution (33% each variant)
  • No mixing effect between variants

Default Variants​

Ad Sentinelle includes 3 predefined variants:

Variant 1: Control (Factual)​

🛡️ Support Our Free Content

Your ad blocker prevents our financing.

[I've Disabled My Blocker]

Approach: Direct and factual message Target: Rational users

Variant 2: Emotional (Emotional)​

🛡️ We Need You

Our journalists depend on ads to continue their work.

[I Disable to Support You]

Approach: Empathy appeal Target: Sensitive users

Variant 3: Alternative (Choice)​

🛡️ Explore Other Options

Disable your blocker to continue or discover our ad-free offer.

[Disable My Blocker]

Approach: Offers choice, less pressuring Target: Reluctant users

Customize Messages​

In Wall Builder​

  1. Go to "Content" tab
  2. Edit title and messages
  3. A/B variants auto-generated

Custom Variants​

You can create your own variants:

// Advanced configuration (API)
{
  variants: [
    {
      id: 'control',
      title: 'Your title 1',
      message: 'Your message 1',
      cta: 'Your button 1'
    },
    {
      id: 'test_a',
      title: 'Your title 2',
      message: 'Your message 2',
      cta: 'Your button 2'
    },
    {
      id: 'test_b',
      title: 'Your title 3',
      message: 'Your message 3',
      cta: 'Your button 3'
    }
  ]
}

Best Practices for Messages​

1. Be Transparent​

❌ Bad: "You are blocked" ✅ Good: "Advertising finances our free content"

2. Explain Impact​

❌ Bad: "Disable your blocker" ✅ Good: "Without ads, we can't pay our writers"

3. Offer Solution​

❌ Bad: "Problem detected" ✅ Good: "Disable your blocker or discover our premium offer"

4. Use Emojis Sparingly​

🛡️ Blocker Detected           ← OK, grabs attention
🛡️🚫💔😢 ALERT !!!            ← Too aggressive

5. Adapt Tone to Your Audience​

Site TypeRecommended Tone
Serious NewsProfessional, factual
Tech BlogCasual, technical
Gaming SitePlayful, direct
Premium SiteExclusive, valorizing

Analyze Results​

A/B Testing Dashboard​

┌─────────────────────────────────────────────────────────────┐
│  A/B Testing - Results (Last 7 Days)                       │
├─────────────────────────────────────────────────────────────┤
│                                                             │
│  Variant      │ Impressions │ Conversions │ Rate         │
│  ─────────────────────────────────────────────────────────  │
│  🏆 Emotional │    3,245    │     892     │ 27.5% ▲      │
│  Control      │    3,198    │     786     │ 24.6%        │
│  Alternative  │    3,156    │     691     │ 21.9% ▼      │
│                                                             │
│  Statistical Confidence: 94%                               │
│  Recommendation: Use "Emotional"                           │
│                                                             │
└─────────────────────────────────────────────────────────────┘

Metrics to Follow​

MetricDescriptionGoal
ImpressionsTimes displayedVolume
ConversionsConfirmed disablesSuccess
RateConversions / ImpressionsPerformance
ConfidenceStatistical reliability> 95%

Interpret Results​

  • Confidence < 80%: Not enough data, continue test
  • Confidence 80-95%: Clear trend, but confirm
  • Confidence > 95%: Reliable result, apply winner

Optimize Continuously​

Optimization Cycle​

    ┌──────────────┐
    │   Analyze    │
    │  Data        │
    └──────┬───────┘
           │
    ┌──────▼───────┐
    │   Form       │
    │  Hypotheses  │
    └──────┬───────┘
           │
    ┌──────▼───────┐
    │   Create     │
    │  New         │
    │  Variants    │
    └──────┬───────┘
           │
    ┌──────▼───────┐
    │    Test      │
    │  (A/B test)  │
    └──────┬───────┘
           │
    ┌──────▼───────┐
    │   Apply      │
    │  Winner      │
    └──────┬───────┘
           │
           └──────────► Start Again

Test Ideas​

  1. Tone: Factual vs Emotional
  2. Length: Short and direct vs Explanatory
  3. CTA: "I've Disabled" vs "Continue" vs "Support"
  4. Emoji: With vs Without
  5. Colors: Warm vs Cool

Disable A/B Testing​

If you prefer a single message:

  1. In site settings
  2. "A/B Testing" section
  3. Disable "Test Multiple Variants"
  4. Configure your single message
Tip

Leave A/B testing active for at least 2 weeks to get significant results.