All templates

Automated Sauce Labs Device Coverage Scorecard

Every Friday, WebRun opens Sauce Labs, compiles the week's test run results across every device and browser combination, emails the QA team a summary highlighting the weakest coverage area, and logs the pass rate and run count to Airtable so the trend is visible from one week to the next.

Runs on WebRun · Strict Lockdown policy
Every Friday at 4:00 PM WebRunorchestrates each step
1 Sauce Labs compile the week's test results by device
2 Gmail email the QA team
3 Airtable log the coverage numbers
In short

How do I track my weekly Sauce Labs device coverage automatically?

WebRun compiles your week's Sauce Labs test results every Friday, totaling the pass rate by device and browser. It emails the QA team a summary highlighting the weakest coverage area, and logs the numbers to Airtable so trends build over time, so testing gaps surface before the next release instead of after.

  • Testing gaps surface every Friday instead of at release time
  • Device and browser coverage is tracked automatically week over week
  • QA gets a summary without compiling results by hand

Built for QA teams · test engineers · release managers · engineering teams

Step by step

What does WebRun do on every run?

The exact actions WebRun takes, in order - in plain language, so you can adjust anything.

  1. WebRun signs in and gets to work

    Opens app.saucelabs.com in a real browser with your saved login - no setup, no API keys.

  2. 1
    Sauce Labs - compile the week's test results by device
    • Open Sauce Labs and pull this week's test run history
    • Total the pass and fail counts by device and browser
    • Note which device or browser combination had the most failures

    Done when The week's test runs are totaled by device and browser with pass and fail counts.

  3. 2
    Gmail - email the QA team
    gmail.com
    WebRun in Gmail: email the QA team
    WebRun opens Gmail to email the QA team.
    • Draft a short internal summary email to the QA team
    • Include the pass rate, total runs, and the weakest device or browser coverage
    • Send it to the internal QA distribution list

    Done when The QA team has this week's summary email.

  4. 3
    Airtable - log the coverage numbers
    airtable.com
    WebRun in Airtable: log the coverage numbers
    WebRun opens Airtable to log the coverage numbers.
    • Log this week's totals as a new row in the test coverage tracker
    • Record the pass rate and weakest coverage area
    • Keep prior weeks in place so the trend is visible

    Done when This week's coverage numbers are logged as a new row in Airtable.

Run settings

How is each run configured?

Starting pageWhere Chrome opens at the start of each run
app.saucelabs.com
ScheduleRuns automatically on this cadence
Every Friday at 4:00 PM
DeliveryHow each run's result reaches you
Coverage scorecard · Gmail
OutputWhat each run produces - A weekly device and browser coverage scorecard, emailed to QA and logged to Airtable.
Report
Setup & safety

Secure by default

Connect once, stays signed in

WebRun signs in once and keeps each session in a persistent environment, so every run picks up right where it left off.

Your credentials stay in your own private environment - WebRun never stores your passwords.
Strict Lockdown

Every action is checked against this policy before it runs.

Domains ALLOWLIST
Typed input ALLOW
Shell command BLOCK
File uploads BLOCK
Runs in a contained environment More on policies
Good to know

Questions, answered

Does it run or change any tests?

No. WebRun only reads completed test results from Sauce Labs. Writing or changing tests stays with your QA and engineering teams.

Who receives the summary email?

Your internal QA distribution list. It's an internal report, never sent to a customer or outside your team.

Can I see trends over time, not just this week?

Yes. Every week's numbers are added as a new row in Airtable, so the coverage trend builds up automatically.

Put this on autopilot.

Turn it on in minutes - or have our team set it up for you.