All templates

Automated Yellow.ai Weekly Chatbot Scorecard

Every Monday, WebRun opens Yellow.ai, reviews the past week's conversation volume, resolution rate, and escalations across channels, exports the totals into a Google Sheets tracker, and emails the CX lead a summary so the team sees the chatbot's real weekly performance.

Runs on WebRun · Strict Lockdown policy
Every Monday at 8:00 AM WebRunorchestrates each step
1 Yellow.ai review weekly conversation stats
2 Google Sheets log resolved versus escalated totals
3 Gmail email the CX lead a summary
In short

How do I track my Yellow.ai chatbot's weekly resolution rate?

WebRun reviews your Yellow.ai conversations every Monday, checking resolution rate and escalations to a human by channel for the past week. It logs the totals into a Google Sheets tracker and emails the CX lead a summary that calls out any channel with a sharp change, so chatbot performance gets a real weekly look.

  • Resolution rate and escalations get reported every Monday automatically
  • Sharp changes in a channel get flagged instead of missed
  • Your CX lead gets a summary without pulling the dashboard manually

Built for CX teams · customer support leaders · enterprise support teams · operations teams

Step by step

What does WebRun do on every run?

The exact actions WebRun takes, in order - in plain language, so you can adjust anything.

  1. WebRun signs in and gets to work

    Opens yellow.ai in a real browser with your saved login - no setup, no API keys.

  2. 1
    Yellow.ai - review weekly conversation stats
    yellow.ai
    WebRun in Yellow.ai: review weekly conversation stats
    WebRun opens Yellow.ai to review weekly conversation stats.
    • Open Yellow.ai and check the past week's conversation volume
    • Note the resolution rate and total escalations to a human
    • Flag any channel with a sharp change from the week before

    Done when The week's conversation stats have been reviewed across channels.

  3. 2
    Google Sheets - log resolved versus escalated totals
    google.com
    WebRun in Google Sheets: log resolved versus escalated totals
    WebRun opens Google Sheets to log resolved versus escalated totals.
    • Open the chatbot performance tracker
    • Add a row with this week's resolved and escalated totals by channel
    • Keep a running month-to-date total at the top

    Done when The week's totals are logged in Google Sheets.

  4. 3
    Gmail - email the CX lead a summary
    gmail.com
    WebRun in Gmail: email the CX lead a summary
    WebRun opens Gmail to email the CX lead a summary.
    • Email the CX lead a short summary of resolution rate and escalations
    • Call out any channel with a sharp change
    • Link to the full Google Sheets tracker for detail

    Done when The CX lead has this week's summary in their inbox.

Run settings

How is each run configured?

Starting pageWhere Chrome opens at the start of each run
yellow.ai
ScheduleRuns automatically on this cadence
Every Monday at 8:00 AM
DeliveryHow each run's result reaches you
Weekly scorecard · Gmail
OutputWhat each run produces - A weekly summary of Yellow.ai resolution rate and escalations by channel, with a link to the full tracker.
Text
Setup & safety

Secure by default

Connect once, stays signed in

WebRun signs in once and keeps each session in a persistent environment, so every run picks up right where it left off.

Your credentials stay in your own private environment - WebRun never stores your passwords.
Strict Lockdown

Every action is checked against this policy before it runs.

Domains ALLOWLIST
Typed input ALLOW
Shell command BLOCK
File uploads BLOCK
Runs in a contained environment More on policies
Good to know

Questions, answered

Does it change how the chatbot responds or escalates?

No. It only reads the week's stats and reports them. Changing chatbot flows or escalation rules stays a decision for your team.

Who receives the weekly summary?

Only your own CX lead's inbox. It is never sent outside your organization.

How does it flag a change worth noticing?

It compares each channel's resolution rate and escalation count against the week before, so a real shift stands out instead of getting lost in the raw numbers.

Put this on autopilot.

Turn it on in minutes - or have our team set it up for you.