All templates

Automated Scale AI Labeling Progress Alerts

Every few hours, WebRun opens Scale AI, checks the completion rate on every active labeling project against its target pace, flags any project falling behind, posts the details to Telegram, and texts the project lead through Twilio when a project looks likely to miss its deadline.

Runs on WebRun · Strict Lockdown policy
Every 4 hours WebRunorchestrates each step
1 Scale AI check labeling progress against target pace
2 Telegram post the progress flag
3 Twilio text the project lead
In short

How do I know if a Scale AI labeling project is falling behind schedule?

WebRun checks every active Scale AI labeling project every few hours, comparing tasks completed against the pace needed to hit its deadline. It posts any project falling behind to Telegram with the completion percentage, and texts the project lead through Twilio only when a deadline genuinely looks at risk, so slipping projects surface early instead of on delivery day.

  • Slipping projects get flagged days before the deadline, not on it
  • The project lead gets a text only when the risk is real
  • Every active project gets checked, not just the largest one

Built for ML operations teams · AI product managers · data labeling vendors · annotation project leads

Step by step

What does WebRun do on every run?

The exact actions WebRun takes, in order - in plain language, so you can adjust anything.

  1. WebRun signs in and gets to work

    Opens scale.com in a real browser with your saved login - no setup, no API keys.

  2. 1
    Scale AI - check labeling progress against target pace
    scale.com
    WebRun in Scale AI: check labeling progress against target pace
    WebRun checks labeling progress against target pace in Scale AI.
    • Open the dashboard and review every active labeling project
    • Compare tasks completed against the target pace for the deadline
    • Flag any project behind pace

    Done when Every active project has a current pace reading.

  3. 2
    Telegram - post the progress flag
    telegram.org
    WebRun in Telegram: post the progress flag
    WebRun posts the progress flag in Telegram.
    • Post each behind-pace project to the ops channel
    • Include the completion percentage and deadline
    • Group projects by how far behind they are

    Done when The team has every behind-pace project posted to Telegram.

  4. 3
    Twilio - text the project lead
    twilio.com
    WebRun in Twilio: text the project lead
    WebRun texts the project lead through Twilio.
    • Text the project lead directly when a project looks likely to miss its deadline
    • Name the project and the shortfall
    • Stay quiet for projects still on pace

    Done when The project lead is texted only when a deadline is genuinely at risk.

Run settings

How is each run configured?

Starting pageWhere Chrome opens at the start of each run
scale.com
ScheduleRuns automatically on this cadence
Every 4 hours
DeliveryHow each run's result reaches you
Progress alert · Telegram
OutputWhat each run produces - A Telegram post for every project behind pace, with a text to the project lead when a deadline is at risk.
Alert
Setup & safety

Secure by default

Connect once, stays signed in

WebRun signs in once and keeps each session in a persistent environment, so every run picks up right where it left off.

Your credentials stay in your own private environment - WebRun never stores your passwords.
Strict Lockdown

Every action is checked against this policy before it runs.

Domains ALLOWLIST
Typed input ALLOW
Shell command BLOCK
File uploads BLOCK
Runs in a contained environment More on policies
Good to know

Questions, answered

Will it reassign labelers or change a project itself?

No. WebRun only reports pace. Reassigning work or changing a project's settings stays a manual decision.

What counts as behind pace?

The completed task count sits below what's needed to hit the deadline at the project's current completion rate.

Does it text for every project update?

No. Twilio only fires when a project looks likely to actually miss its deadline, not for routine progress checks.

Put this on autopilot.

Turn it on in minutes - or have our team set it up for you.