The undo rate
An email assistant makes decisions you did not watch it make. The only person who can say whether a decision was right is the person whose mail it was, and they say it in exactly one way: they undo it. So the number we publish is the share of the bat’s own decisions that a person reversed by hand. We call it the undo rate.
15 undone out of 334 decisions (127 rule actions and 207 labels) is 4.5%, or about 1 in 22.
It counts every reversal, including the ones where the rule itself was written too wide and the bat did exactly what it was told. A product cannot lower its undo rate by describing itself better, only by being reversed less.
The ledger
Counted 6 September 2026, covering the 90 days to 5 September 2026. A patrol pass is one sync of one inbox, which happens every fifteen minutes or when someone presses Sync now, so it is not a night.
| What | Count | What it counts |
|---|---|---|
| Patrol passes | 2,525 | One inbox, one sync. Cron or Sync now. |
| Emails read | 3,478 | New messages read across those passes. |
| Rule actions | 127 | Archive, star, label, forward, reply, spam or read state, applied to Gmail because a rule matched. |
| Labels applied | 207 | AI labels, each with a written reason. |
| Decisions on its own | 334 | Rule actions plus labels applied. |
| Decisions that stood | 319 | Nobody reversed them. |
| Reversed by a person | 15 | Actions undone, across 8 undo clicks. One click can reverse several. |
| Undo rate | 4.5% | Reversed, divided by decisions. |
| Roundups generated | 67 | Morning briefs assembled. |
| Roundup items | 2,131 | 517 needed a person, 1,440 were handled overnight, 174 were offered for a second look. |
What each number counts
- Emails read is the sum of new messages each patrol pass found in the inbox. A message is read once. Batmail’s own roundup email is skipped, so it is not in this figure and never costs a decision.
- Rule actions are the things a rule did to Gmail: archive, star, label, forward, reply, mark as spam, mark read or unread. A rule that matched and continued to the next rule counts once per action taken.
- Labels applied are echo labels: labels you define with a description, applied by the AI with a written reason. One message can carry more than one.
- Roundup items are the lines in the morning brief. Needs you is the top of the brief. Handled overnight is the report of what the bat did without you. Second look is mail the bat was unsure about: something in spam that might not be, or something archived that might matter.
What counts as an undo
Three places offer an undo, and all three count. The ten-second toast that follows any action that moves mail. The activity log, where every action sits with its reason and an Undo button for as long as Gmail allows the reversal. And the roundup, where a quick action on an item can be taken back.
Dismissing a roundup item does not count: that is reading it and moving on, not reversing a decision.
Two things push the rate down: the rule preview, which dry-runs a draft rule against the mail it names before it is saved, and the suggestions the bat makes from what you already do by hand, which are counted from your own actions rather than guessed.
What is not measured
- Nothing from the mail itself. No subject, sender, snippet, body or label reason is in the event stream. Every event carries counts, ids and short fixed words. Where a length would do, a length is sent, not the text. This is the same rule that governs the product’s error reporting and its Slack alerts, and it has no exception for a marketing page.
- No session replay. A recording of someone’s roundup screen is a recording of their inbox, so replay is off everywhere.
- No open rates. The roundup email carries no tracking pixel and no tracked links, so we do not know whether it was opened, and this page does not claim to.
How to read it
The undo rate rests on 334 decisions and will move as more inboxes arrive, which is why it carries the date it was counted, and why it is a number you can check against your own activity log.
The figures are refreshed monthly. Each refresh replaces the numbers and moves the date beside them, on this page, on the home page, in the sitemap and in the page’s structured data, so nothing here can quietly go stale while still reading as current.
How we count
Batmail records a small set of named product events about itself: a patrol pass finished, a roundup was generated, an undo was clicked. Each carries counts and nothing else. The ledger is two queries over those events for the window: totals of the events, and sums of the count fields they carry (new emails, actions executed, labels applied, roundup items and how they were sorted, actions undone). Percentages are arithmetic on those sums and are shown with the arithmetic where they appear.
The same events feed the activity log inside the product, which is where you can check any of this against your own inbox. What is read, what is stored and what never leaves the system is in the privacy policy.
Questions
How accurate is Batmail?
We do not publish an accuracy figure, because nobody can grade an email assistant's decisions from the outside. We publish the undo rate instead: of the 334 decisions the bat made on its own in the beta window (127 rule actions and 207 labels), 319 stood and a person reversed 15 by hand, which is 4.5 percent, or about 1 in 22. A reversal is the user saying the bat was wrong, so it is the one quality number the product cannot flatter.
What is the undo rate?
Actions the bat took on its own, divided into actions a person undid. Rule actions and labels count as decisions. An undo counts whether it came from the ten-second toast, the activity log or the roundup. Dismissing a roundup item is not an undo, because reading something and moving on is not a reversal.
Why publish the undo rate at all?
Because it is the one number an email assistant cannot flatter. A reversal is the user saying the bat was wrong, so the rate measures trust earned rather than claimed. It carries the date it was counted and is refreshed monthly.
Does Batmail read my mail to produce these numbers?
No. Every figure is a count of events the product records about itself: a patrol pass finished, a label was applied, an undo was clicked. No subject line, sender, snippet or body is in the event stream, and nothing on this page is derived from mail content.
When are the numbers updated?
Monthly. The date the counts were taken is printed beside them on this page and on the home page, and it is the date in the page's structured data and the sitemap, so you can always tell how old a figure is.
Sources
What we read to write this. Facts on this page were last checked on . If something here is out of date, email support@batmail.ai and we will correct it.