Competing explanations, each written down with the observation that would refute it. The rolling-window conjectures were written with their refutation rules on 2026-10-20; their windows include months already published then, so only readings of months after that date test them in advance. The three release event studies were registered retrospectively on 2026-10-22, after their release windows had passed: one release per kind of AI tool (a closed model, an open-weight model and an attack harness), each with a sourced public date. Because those releases were chosen after the outcome data existed, the event studies carry less weight than a test registered in advance; their dates and thresholds are frozen for every later reading. The status is computed from the live series by code in Substrate, not judged. A reading that fits is labelled not refuted by this metric, never proven, and a reading before a conjecture's evaluation date is marked interim. Every status change is kept, with its date, in that conjecture's history in the dataset.
For the rolling-window conjectures, status follows the registered rule on six-month windows. The second line re-runs the same rule on 12-month windows, so a disagreement between them means the verdict depends on the window; neither line is a final answer.
Cashing out is what limits breaches
interim · refuted
Tal Be'ery, "Why the AI Vulnpocalypse Isn't the Breachpocalypse (Yet)" (2026-10) · evaluates on 2027-10-20
Predicts: Financially motivated breaches grow much more slowly than exploited vulnerabilities, because converting access into laundered money is the constraint.
Refuted if: Leak-site victims over the last six complete months grow at least as fast as KEV additions year over year, and by at least 50%.
Interim reading: Leak-site victims posted within 30 days of month end +64% (3022 → 4961); KEV additions +25% (126 → 158), 2026-03–2026-08 vs 2025-03–2025-08.
Caveat: Leak-site victims are mostly organizations that did not pay: a leak site lists a victim to pressure or punish non-payment, so this series counts extortion attempts that failed to collect, not breaches that paid out. Coveware's own caseload, a different population from leak-site victims, paid in 19% of cases in Q2 2026, the latest quarter here (Coveware).
refuted at or above 50%6-month reading 64.2%0%80%20%40%60%12-month check 35.7%
leak-site victim growth
Window check, not the rule: over 12-month windows this reads not refuted by this metric. Leak-site victims posted within 30 days of month end +36% (6727 → 9128); KEV additions +14% (247 → 281), 2025-09–2026-08 vs 2024-09–2025-08.
What tells AI apart from the rival explanation: If cashing out is the limit, payment rates and laundering throughput fall or stay flat while access (KEV additions) grows; if access were the limit, leak-site victims would track KEV additions.
Confounders (3)
- 2024-02-20 · Operation Cronos: NCA-led disruption of LockBit. LockBit's disruption moved affiliates and victims between leak sites, changing counts with no change in access or cash-out. Source
- 2023-05-27 · MOVEit mass exploitation by CL0P. One mass campaign put hundreds of victims on one leak site within weeks, which can dominate a year-ago window. Source
- 2025-10-24 · Ransom payment rate at a historical low (Coveware). A falling payment rate changes who ends up on a leak site, since sites list victims who have not paid. Source
Paired series, Ransom payment rate (Coveware quarterly): Share of Coveware's extortion cases, across all impact scenarios, in which the victim paid. Coveware's population is its own incident-response caseload, not leak-site victims.
These two quarters were paired when the conjecture was registered; the latest is 19% in Q2 2026. The full quarterly payment rate from Coveware's reports is charted on Outcomes.
AI removed the operator-labor limit
interim · not refuted by this metric
The Defender's Initiative, "From this point on, it only gets rougher" (2026) · evaluates on 2027-10-20
Predicts: Attackers were held back by a shortage of skilled operators; as AI fills it, the number of distinct extortion groups active each month rises.
Refuted if: Average distinct leak-site groups per month over the last six complete months is less than 10% above the same six months a year earlier.
Interim reading: Average distinct groups posting within 30 days of month end 51.2 → 64.8 (+27%), 2026-03–2026-08 vs 2025-03–2025-08.
refuted below 10%6-month reading 26.7%0%30%10%20%12-month check 20.9%
growth in active groups
Window check, not the rule: over 12-month windows this reads not refuted by this metric. Average distinct groups posting within 30 days of month end 49.4 → 59.8 (+21%), 2025-09–2026-08 vs 2024-09–2025-08.
What tells AI apart from the rival explanation: An AI-driven labor effect adds new groups without a takedown preceding them; a law-enforcement-driven effect shows a takedown followed by rebrands that absorb the same affiliates.
Confounders (2)
- 2024-02-20 · Operation Cronos: NCA-led disruption of LockBit. Takedowns split affiliates into new brands, raising the count of distinct groups without adding operators. Source
- 2023-05-27 · MOVEit mass exploitation by CL0P. A single group's mass campaign changes victim counts per group, which shifts which groups are active in a month. Source
Exploitation is outrunning defenders
interim · not refuted by this metric
vulnerabilitydata.io working hypothesis · evaluates on 2027-10-20
Predicts: The time from a CVE's publication to CISA confirming exploitation keeps shrinking.
Refuted if: The median days from CVE publication to KEV listing over the last six complete months is not lower than the same six months a year earlier.
Interim reading: Median days from CVE publication to KEV listing 10 → 8 (n=97 → 163), 2026-04–2026-09 vs 2025-04–2025-09.
refuted at or above 10d6-month reading 8d0d15d5d10d12-month check 10da year earlier 10d
median days, CVE to KEV listing
Window check, not the rule: over 12-month windows this reads refuted. Median days from CVE publication to KEV listing 10 → 10 (n=209 → 275), 2025-10–2026-09 vs 2024-10–2025-09.
What tells AI apart from the rival explanation: If exploitation is outrunning defenders, the gap shrinks across vendors and bug classes; if a few zero-day campaigns or a KEV policy change drive it, the drop concentrates in a few vendors or starts at the policy date.
Confounders (2)
- 2026-06-10 · BOD 26-04 replaces BOD 22-01; KEV inclusion criteria unchanged. Falls inside the windows this rule compares until late 2027. CISA states the criteria for adding a vulnerability to KEV did not change, so it should not change what CISA lists; it is kept as a dated event to check against a break, not a known cause of one. Source
- 2023-05-27 · MOVEit mass exploitation by CL0P. A cluster of zero-days listed within days of disclosure pulls a month's median down with no general change in speed. Source
Breaches already happened but are not yet disclosed
interim · no metric yet
The "submerged breaches" alternative that Be'ery argues against · evaluates on 2027-10-20
Predicts: Material-incident 8-Ks filed later report intrusions that began in 2026 Q2–Q3.
Refuted if: 8-K Item 1.05 filings over the following four quarters report intrusion start dates spread evenly, with no cluster in 2026 Q2–Q3.
Interim reading: Intrusion start dates are not yet extracted from filing text. For context, Item 1.05 filings were 9 → 14, 2026-04–2026-09 vs 2025-04–2025-09.
What tells AI apart from the rival explanation: A disclosure lag shows as intrusion start dates clustered months before filing dates; a reporting-rule effect shows as filings rising from the rule's start date regardless of when intrusions began.
Confounders (1)
- 2023-12-18 · SEC Form 8-K Item 1.05 disclosures begin. The disclosure rule itself started the series, so its early growth is partly firms learning to file. Source
Non-financial attackers are rising
interim · no metric yet
Caveat in Be'ery's own post; vulnerabilitydata.io working hypothesis · evaluates on 2027-10-20
Predicts: Attacks with no ransom or payment goal (disruption, sabotage, state activity) rise, untouched by the cash-out constraint.
Refuted if: No rise in destructive or disruptive incidents without a ransom demand over the next four quarters.
Interim reading: No public machine-readable series measures this yet.
What tells AI apart from the rival explanation: A real rise shows in incidents with no ransom demand across several sources; a visibility effect shows only in sources whose reporting rules changed.
Confounders (1)
- 2023-12-18 · SEC Form 8-K Item 1.05 disclosures begin. Public companies began disclosing material incidents of any motive, so disruptive incidents became more visible without becoming more common. Source
Significant incidents double within a year
interim · no metric yet
vulnerabilitydata.io working hypothesis (2026-10-20) · evaluates on 2027-10-20
Predicts: Incidents that take a critical service (fuel, healthcare, payments, a major retailer or a city) down for days double from their prior annual rate by 2027-10-20.
Refuted if: The count of such incidents from 2026-10-20 to 2027-10-20 is less than twice the 2025 count.
Interim reading: No public machine-readable series measures this yet.
What tells AI apart from the rival explanation: An AI effect raises the count across many unrelated actors; a single mass campaign or a disclosure-rule change raises it through one actor or one reporting channel.
Confounders (2)
- 2023-05-27 · MOVEit mass exploitation by CL0P. One campaign can produce many qualifying incidents in a single year. Source
- 2023-12-18 · SEC Form 8-K Item 1.05 disclosures begin. Disclosure requirements make outages at public companies visible that were previously unreported. Source
A frontier closed-model release sped up exploitation
refuted · one event, read after the fact
vulnerabilitydata.io event study (registered 2026-10-22) · event study · window closed 2025-07-01, read retrospectively
Predicts: After the release, the monthly median days from CVE publication to KEV listing falls below the line projected from the 12 months before it (a level or slope break toward faster exploitation).
Refuted if: Over the 12 complete months of KEV listings after the release month, the mean of (observed monthly median days from CVE publication to KEV listing − the pre-trend projection) is zero or above. The pre-trend is the least-squares line through the monthly medians of the 12 months before the release month. Months with fewer than 5 KEV entries are gaps and are skipped; fewer than 8 usable months in either window reads too early.
Release: Claude 3.5 Sonnet released, 2024-06-21 (closed)
Reading: Release 2024-06-21 (closed). Post-release months ran +13.6 days on average against the pre-trend projection; slope -0.5 → 1 days per month (pre 2023-06–2024-05, 12 months; post 2024-07–2025-06, 12 months). Registered retrospectively on 2026-10-22; a break in timing is not evidence of cause.
refuted at or above 0drefuted ›12-month reading 13.6d0d20d5d10d15d
mean days vs pre-trend, 12 months after
What tells AI apart from the rival explanation: A capability effect from closed models shows as a break near the release that does not also appear at unrelated dates; a break during a zero-day campaign points to that campaign instead.
Confounders (1)
- 2025-01-20 · Overlapping release: DeepSeek-R1 released with open weights (open-weight). A release of another tool class falls inside this study's window, so a break cannot be assigned to one class by timing alone. Source
A frontier open-weight release sped up exploitation
not refuted by this metric · one event, read after the fact
vulnerabilitydata.io event study (registered 2026-10-22) · event study · window closed 2026-02-01, read retrospectively
Predicts: After the release, the monthly median days from CVE publication to KEV listing falls below the line projected from the 12 months before it (a level or slope break toward faster exploitation).
Refuted if: Over the 12 complete months of KEV listings after the release month, the mean of (observed monthly median days from CVE publication to KEV listing − the pre-trend projection) is zero or above. The pre-trend is the least-squares line through the monthly medians of the 12 months before the release month. Months with fewer than 5 KEV entries are gaps and are skipped; fewer than 8 usable months in either window reads too early.
Release: DeepSeek-R1 released with open weights, 2025-01-20 (open-weight)
Reading: Release 2025-01-20 (open-weight). Post-release months ran -19.4 days on average against the pre-trend projection; slope 2 → 0.4 days per month (pre 2024-01–2024-12, 12 months; post 2025-02–2026-01, 12 months). Registered retrospectively on 2026-10-22; a break in timing is not evidence of cause.
refuted at or above 0d12-month reading -19.4d-30d10d-20d-10d0d
mean days vs pre-trend, 12 months after
What tells AI apart from the rival explanation: Open-weight use leaves no provider telemetry, so the series is the only instrument; a break that also appears at the closed-model date cannot be assigned to open weights.
Confounders (2)
- 2024-06-21 · Overlapping release: Claude 3.5 Sonnet released (closed). A release of another tool class falls inside this study's window, so a break cannot be assigned to one class by timing alone. Source
- 2025-07-10 · Overlapping release: HexStrike AI MCP agent framework published on GitHub (harness). A release of another tool class falls inside this study's window, so a break cannot be assigned to one class by timing alone. Source
A public offensive AI harness sped up exploitation
not refuted by this metric · one event, read after the fact
vulnerabilitydata.io event study (registered 2026-10-22) · event study · window closed 2026-08-01, read retrospectively
Predicts: After the release, the monthly median days from CVE publication to KEV listing falls below the line projected from the 12 months before it (a level or slope break toward faster exploitation).
Refuted if: Over the 12 complete months of KEV listings after the release month, the mean of (observed monthly median days from CVE publication to KEV listing − the pre-trend projection) is zero or above. The pre-trend is the least-squares line through the monthly medians of the 12 months before the release month. Months with fewer than 5 KEV entries are gaps and are skipped; fewer than 8 usable months in either window reads too early.
Release: HexStrike AI MCP agent framework published on GitHub, 2025-07-10 (harness)
Reading: Release 2025-07-10 (harness). Post-release months ran -6 days on average against the pre-trend projection; slope 1 → -0.1 days per month (pre 2024-07–2025-06, 12 months; post 2025-08–2026-07, 12 months). Registered retrospectively on 2026-10-22; a break in timing is not evidence of cause.
refuted at or above 0d12-month reading -6d-8d2d-6d-4d-2d0d
mean days vs pre-trend, 12 months after
What tells AI apart from the rival explanation: A harness effect should concentrate in bug classes the harness automates; a general break at the same time points to a common cause instead. The KEV directive was replaced inside this window, though CISA says what qualifies for KEV did not change.
Confounders (2)
- 2026-06-10 · BOD 26-04 replaces BOD 22-01; KEV inclusion criteria unchanged. Falls inside this study's post-release window. CISA states the criteria for adding a vulnerability to KEV did not change, so it should not change what CISA lists; a break that starts in 2026-06 should still be checked against it. Source
- 2025-01-20 · Overlapping release: DeepSeek-R1 released with open weights (open-weight). A release of another tool class falls inside this study's window, so a break cannot be assigned to one class by timing alone. Source