All templates

Automated Optimizely Experiment Handoff

Every morning, WebRun opens Optimizely, checks every running experiment's sample size and statistical significance, messages the experiment's owner on WhatsApp the moment one is ready to call, and schedules a decision meeting on Google Calendar.

Runs on WebRun · Strict Lockdown policy
Every day at 8:00 AM WebRunorchestrates each step
1 Optimizely check experiments for significance
2 WhatsApp message the owner
3 Google Calendar schedule a decision meeting
In short

How do I get notified the moment an Optimizely experiment reaches significance?

WebRun checks every running Optimizely experiment each morning for statistical significance. The moment one is ready to call, it messages the experiment's owner on WhatsApp with the leading variation and result, and schedules a decision meeting on Google Calendar, so a significant test gets a timely call instead of running past its answer.

  • Significant experiments get a same-day decision meeting, not a forgotten result
  • Owners get a direct WhatsApp message instead of checking Optimizely manually
  • Tests stop running past the point where the answer is already clear

Built for product managers · growth teams · conversion rate optimization teams · experimentation teams

Step by step

What does WebRun do on every run?

The exact actions WebRun takes, in order - in plain language, so you can adjust anything.

  1. WebRun signs in and gets to work

    Opens app.optimizely.com in a real browser with your saved login - no setup, no API keys.

  2. 1
    Optimizely - check experiments for significance
    optimizely.com
    WebRun in Optimizely: check experiments for significance
    WebRun opens Optimizely to check experiments for significance.
    • Open Optimizely and list all running experiments
    • Check each experiment's sample size and statistical significance
    • Note which variation is leading and by how much

    Done when Every running experiment has been checked for significance.

  3. 2
    WhatsApp - message the owner
    whatsapp.com
    WebRun in WhatsApp: message the owner
    WebRun sends a WhatsApp message to the owner.
    • Message the experiment's owner the moment it reaches significance
    • Include the leading variation and the result

    Done when The owner has a WhatsApp message for every experiment that's ready to call.

  4. 3
    Google Calendar - schedule a decision meeting
    calendar.google.com
    WebRun in Google Calendar: schedule a decision meeting
    WebRun opens Google Calendar to schedule a decision meeting.
    • Schedule a short decision meeting for the owner to review the result
    • Attach the experiment name so the invite is self-explanatory

    Done when A decision meeting is scheduled for every significant experiment.

Run settings

How is each run configured?

Starting pageWhere Chrome opens at the start of each run
app.optimizely.com
ScheduleRuns automatically on this cadence
Every day at 8:00 AM
DeliveryHow each run's result reaches you
Experiment handoff · WhatsApp
OutputWhat each run produces - A list of experiments that reached significance, with the owner messaged and a decision meeting scheduled.
Text
Setup & safety

Secure by default

Connect once, stays signed in

WebRun signs in once and keeps each session in a persistent environment, so every run picks up right where it left off.

Your credentials stay in your own private environment - WebRun never stores your passwords.
Strict Lockdown

Every action is checked against this policy before it runs.

Domains ALLOWLIST
Typed input ALLOW
Shell command BLOCK
File uploads BLOCK
Runs in a contained environment More on policies
Good to know

Questions, answered

Will it end the experiment or ship the winning variation on its own?

No. WebRun only detects significance and hands it off. Ending the test and shipping the winner is a decision left to the owner.

How does it decide an experiment is ready to call?

It checks the same statistical significance and sample size Optimizely itself reports, so the handoff reflects a real result, not an early trend.

What if an experiment loses significance later?

It checks live results each morning, so an experiment that's no longer significant is skipped until it crosses the bar again.

Put this on autopilot.

Turn it on in minutes - or have our team set it up for you.