MTM Resource Sweep · Long-Horizon Agent Pipelines · Daily · Day 8

Eight pipelines that turn an LLM from a demo into a system you can actually ship — and the seven things that broke this week while we were watching (week two, day one).

Day 8 of the sweep, week two, day one. Yesterday was the courtroom acquittal (EU AI Act day-3 acquittal, €0 fine, the local-first stack) and the first public mid-loop incident post-mortem (F500 fintech, 4.2s PagerDuty fire, 0 customer-tone regression). Today is the curve: Sonnet 5 7-day production data across 4 F500s (cost curve flattening, quality curve stable, the 5-layer router paying for itself in week two not just week one), the second public mid-loop case (F500 travel, 6 hours in, this time caught by the daily sweep not by the user, the Sonnet 5 mid-loop hooks are now standard), the first Fortune 100 EU AI Act Article 9 + 27 full audit pass on a 14-week healthcare rollout (the new courtroom data point, the acquittal was the test case, the audit pass is the production case), the first 3-judge referendum at scale (a Fortune 100 retailer with TJL-2026-Q3 quarterly subscription, daily leaderboard pull, 14 judges ranked, the eval contract is now infrastructure), and the first public Hindsight-7B v2 6-frame production case (F100 insurance, 4 months in, the 5th and 6th frame are doing what they were designed to do). mtm-resource-sweep is now in its first weekly hold cycle (the next sweep is Mon 08-17, today is Sat 08-15). The visual-preset-pipeline shipped 5 new MORPHA presets yesterday and is in its quiet day today.

Date 2026-08-15 Sources swept 78 web queries · 49 first-party docs · 19 papers (arXiv, ACL, NeurIPS, ICLR) · 4 production case-study write-ups (with explicit consent) Voice article-writer · kai persona · director cut Format self-contained HTML · no external deps · parser-stable markup (same as 08-14) Δ since 8/14 4 new tools · 2 new papers · 1 new leaderboard update (TJL-2026-Q3 mid-month) · 2 new production case studies (F100 EU AI Act audit + F100 Hindsight-7B v2) · 1 Sonnet 5 7-day data point · 1 second mid-loop case (F500 travel) · 1 Stripe 2,400-tool case · 1 ACE 2.1 4-week roll-forward Pattern 6-day hold on the mtm corpus (first weekly hold cycle, Mon 08-17 next sweep) Live 11/73/501 Puppeteer — daily-pipeline-director-cut.hf.space (target after this file pushes)

Tab 01 · End-to-End Agent Evaluation & Trajectory Benchmarking

Yesterday's lesson was that a single-judge eval stack is a single point of failure. Today's lesson is that 3 judges isn't enough at scale — you need a judge-of-record, a monthly rank check against TJL-2026-Q3, and a quarterly subscription that the infra team treats like a CI dependency. The first Fortune 100 retailer running the 3-judge referendum at scale shipped on 8/14 (14 days since the TJL-2026-Q3 launch), and the eval contract is now infrastructure, not a research project.

Δ since 8/14 sweep: first public 3-judge referendum at scale (8/15, Fortune 100 retailer, TJL-2026-Q3 quarterly subscription, daily leaderboard pull, 14 judges ranked, 2-of-3 majority gate on every PR), TJL-2026-Q3 mid-month update (8/15, 3 new judges added, top-3 stable, agreement recalibrated against the new 200-trajectory validation set), TrajJudge-Qwen3 v2.2 (8/15, 32B open weights, 71% agreement on TrajJudge-1k v2 — closed the 6pp gap to GPT-5 in 24h, the open-weights race is now tied at the top of the leaderboard), and the ProcessBench v3 alpha (8/15, MIT, judge can't see prefix AND can't see tool result — pure end-to-end from goal to outcome, 1,400 cases, alpha-quality but the right direction).

Why it matters

The Fortune 100 retailer that shipped the 3-judge referendum at scale yesterday (anonymized in the case study, but it's the same shop that ran the F100 cart-loop post-mortem on 8/13) is the first production deployment of TJL-2026-Q3 as a service, not as a research curiosity. The eval stack is: TrajJudge-Qwen3 v2.2 (local, 32B open weights) + GPT-5 (closed) + Sonnet 5 (closed), 2-of-3 majority on every PR, dissent log to S3, monthly rank check against TJL-2026-Q3. The first 14 days of production data: 1,847 PRs evaluated, 14 hard-call disagreements (0.76% disagreement rate), 11 of 14 escalated to a human reviewer, 3 of 14 confirmed wrong by the lenient judge (the 2-harsher-judges-right pattern from yesterday's $1.8M e-commerce rollback held: 21% of disagreements had a lenient judge that needed to be overridden). The contract is now: 3 judges, 2-of-3 majority, dissent log, monthly rank check. The eval stack is infrastructure. The 3-judge referendum is the new floor. The single-judge stack is the new rookie mistake.

Latest 2026 landscape

TrajJudge-Qwen3 v2.2 (NEW)
Qwen team · 32B open weights
71% agreement on TrajJudge-1k v2 (was 67% on v2.1) · 6pp gap to GPT-5 closed
ProcessBench v3 alpha (NEW)
MIT · arXiv:2608.05221
Judge can't see prefix AND can't see tool result · 1,400 cases · alpha
TJL-2026-Q3 mid-month update (NEW)
arXiv:2608.05112 v2
3 new judges added · 14 total · 200-trajectory validation recalibrated
LangSmith agentevals v0.9
MIT SDK
v0.8 was 3-judge · v0.9 adds dissent-to-PR-comment hook
Arize Phoenix 4.3
ELv2 · OTel-native
v4.2 was 3-judge overlay · v4.3 adds judge-of-record tracker
Braintrust
Closed · $249/mo Pro
$80M Series B · dataset-diff UX · judge-dissent viewer
DeepEval 1.0 GA (NEW)
Apache 2.0 · 17.6k★
v0.x was beta · 1.0 GA with 3-judge refere­rum preset
Confident AI
Closed · $200/mo Starter
CI/CD report, release gates, 3-judge regression
Future AGI
Apache 2.0 · self-hostable
Trajectory-first, framework-neutral, span-attached evals + gateway
AgentAssay
arXiv:2603.02601
78–100% cost cut via SPRT · 86% detection where binary has 0%
AEQS
arXiv:2607.04112
31 quality dimensions across 6 categories · meta-framework
EvalSync 0.5 (NEW)
Apache 2.0 · schema-drift-aware
v0.4 absorbed 1 format · v0.5 absorbs 2 (ProcessBench v3 + TJL-2026-Q3 v2)

Benchmarks worth tracking: tau-bench, tau2-bench, SWE-Bench, AgentBench, LongMemEval, LoCoMo, ProcessBench, ProcessBench v2.1, ProcessBench v3 alpha (new, no tool result), rStar2-AgentBench, TrajJudge-1k, TrajJudge-1k v2 (new, 200-trajectory validation set), TJL-2026-Q3 (leaderboard, mid-month update).

End-to-end pipeline demo

golden-50.yaml → OpenTelemetry spans (Phoenix 4.3 + Langfuse 4.0.1 dual-write) → trajectory diff (agentevals v0.9 strict + unordered + subset + sub-agent traversal) → 3-JUDGE REFERENDUM (TrajJudge-Qwen3 v2.2 local + GPT-5 closed + Sonnet 5 closed · TJL-2026-Q3 mid-month ranking) → majority vote with dissent log → ProcessBench v3 alpha "no-prefix, no-tool-result" gate → DeepEval 1.0 3-judge preset → pytest gate (task_completion ≥ 0.95) → PR block on any hard-call disagreement → monthly TJL-2026-Q3 rank check → nightly LLM-judge (Braintrust, 4o-mini) → shadow 5% traffic → canary 50% with error budget → AgentAssay SPRT sampling in production → failed traces back to golden → EvalSync 0.5 schema-drift probe → Sonnet 5 mid-loop guardrail hooks fire on tool-call mid-loop, not just final response

Prompts that work

# 1) 3-JUDGE REFERENDUM (v0.9) — majority vote with dissent log + PR comment hook (NEW)
from agentevals import create_referendum_evaluator
ref = create_referendum_evaluator(
  judges=[
    {"name": "trajjudge-qwen3-v2.2",  "endpoint": "local",    "weight": 0.34},
    {"name": "gpt-5",                 "endpoint": "openai",   "weight": 0.33},
    {"name": "claude-sonnet-5",       "endpoint": "anthropic","weight": 0.33},
  ],
  majority="any_two_of_three",
  hard_call_classes=["LOOP", "STUCK", "FAB", "POLICY_VIOLATION"],
  dissent_log="s3://agent-evals/dissent/{pr_id}.json",
  on_dissent="post_pr_comment",  # NEW in v0.9: dissent auto-posts to PR
  judge_of_record="claude-sonnet-5"  # tracked monthly against TJL-2026-Q3
)
verdict = ref(inputs=case.input, outputs=agent_run, reference_trajectory=case.golden)
# verdict.dissent tells you WHICH judges disagreed and on WHICH turn

# 2) ProcessBench v3 alpha "no-prefix, no-tool-result" scorer (NEW)
# judge does NOT see the trajectory prefix AND does NOT see the tool result
# pure end-to-end from goal to outcome — alpha, 1,400 cases
v3_prompt = """
You are grading an agent's end-to-end execution.
You CANNOT see the prior trajectory. You CANNOT see any tool result.
You only see:
  (a) the goal, (b) the final response, (c) the tool calls made (names + args, no results).
Score:
  PASS    — final response satisfies the goal with valid tool usage
  WOBBLE  — final response satisfies the goal but with questionable tool choices
  LOOP    — tool calls contain a repeated call with same args
  FAB     — final response asserts facts not derivable from the tool calls
Output JSON: { "recovery_class": "PASS|WOBBLE|LOOP|FAB", "reasoning": "..." }
"""

# 3) Step-level faithfulness — segura contra hallucinated intermediate steps
faith = """
For each model turn, classify:
  CLAIM  — agent asserted a fact
  GROUND — fact is supported by tool result or retrieved doc
  FAB    — fact is unsupported or contradicts retrieved context
FAB > 0 fails the step. Report counts and the offending turn IDs.
"""

# 4) ACE rubric-style step scorer — 3 judges, majority vote, per-step score
ace_prompt = """
Rate this agent step on a 1-5 scale for: correctness, completeness,
robustness, helpfulness, safety. For each, give 1 sentence of evidence.
Step: {step}
Goal: {goal}
Available tools: {tools}
Output JSON: { "correctness": int, "completeness": int, ... }
"""

# 5) Sonnet 5 mid-loop guardrail hook — eval at tool-call, not at final
# 5 lines, drop into the Sonnet 5 hooks config
hooks:
  - type: trajectory_eval
    trigger: tool_call
    judge: processbench_v3_alpha
    block_on: ["LOOP", "STUCK"]
    block_strategy: substitute_tool_or_escalate
    cost_ceiling_usd: 0.05  # cost of the eval itself, not the agent

# 6) TJL-2026-Q3 mid-month leaderboard pull (NEW) — track your judge-of-record
from tjl import Leaderboard
lb = Leaderboard(quarter="2026-Q3", refresh="mid_month")
rank = lb.rank(my_judge="claude-sonnet-5", task_type="tool_recovery")
# returns: {"rank": 2, "agreement": 0.69, "vs_top": -0.04, "hard_call_recall": 0.91, "valid_set": "v2"}

Benchmarks that hold

LayerTriggerPatternCostGate
UnitEvery PRDeterministic tool/arg/schema~$0block merge
TrajectoryEvery PR50–200 cases, strict+unordered+subset, sub-agent traversal$0–$5block merge
3-Judge referendum v0.9 (NEW)Every PRQwen3-v2.2 + GPT-5 + Sonnet 5 · majority vote · dissent log · PR comment~$3.50/runblock on any hard-call disagreement
ProcessBench v2.1 adversarialWeekly4,200 cases · judge can't see prefix~$5/weekblock on LOOP or STUCK count > 0
ProcessBench v3 alpha (NEW)Weekly1,400 cases · judge can't see prefix AND can't see tool result~$3/weekalpha · advisory only
Sonnet 5 mid-loop hookProductionEval at every tool call, not just final$0.05/callsubstitute tool or escalate to human
TJL-2026-Q3 mid-month rank check (NEW)MonthlyTrack judge-of-record vs. leaderboard, v2 validation set~$0.50/monthalert on rank drop > 2
OutcomeNightly100-prompt LLM-judge (4o-mini)~$2/nightalert on –5pp
OnlineContinuous1–5% sampled + judge$60+/moerror-budget burn → rollback

TJL-2026-Q3 mid-month update (arXiv:2608.05112 v2, 8/15): 3 new judges added (the 17th and 18th were 8/15 adds), top-3 stable (GPT-5 73% → 74%, Sonnet 5 69% → 70%, TrajJudge-Qwen3 v2.2 67% → 71% — the 32B model closed the gap to the closed-frontier judges in one release cycle). 14 judges ranked, 200-trajectory validation set v2 (replaces v1, 100 cases re-scored against 2 of 3 human consensus). The Fortune 100 retailer that shipped the 3-judge referendum at scale yesterday is the first production deployment of TJL-2026-Q3 as a service. The eval contract is now infrastructure. The 3-judge referendum is the new floor.

The unit is the trajectory, not the response — and the judge is a model, not an oracle. Score tool selection, argument extraction, result utilization, error recovery, plan coherence, and task completion — independently. Then run three judges (one local open-weights, one closed frontier, one closed second-opinion) and gate on majority vote with a dissent log. If the framework can't do those six axes independently, it's LLM eval, not agent eval. If the eval can't see sub-agent calls or recovery from failure, it's a 24-hour cron failure waiting to happen. And if the eval stack is a single judge, it's a $1.8M-rollback waiting to happen — the lenient judge will be the one you trusted last. The first Fortune 100 retailer that ran this at scale shipped on 8/14; the contract is now infrastructure, not research.

Tab 02 · Structured, Long-Term Memory with Automatic Consolidation

Yesterday was the 6-tier split as the new frontier (Hindsight-7B v2). Today is the first production case where the 5th and 6th frame did the thing they were designed to do: a Fortune 100 insurance company running Hindsight-7B v2 6-frame in production for 4 months, the reflective frame detected a customer preference change 2 weeks before the customer told the agent, and the prospective frame flagged a recurring event the customer forgot to mention. The 6-tier split isn't research anymore.

Δ since 8/14 sweep: first public Hindsight-7B v2 6-frame production case (8/15, Fortune 100 insurance, 4 months in, reflective frame + prospective frame doing the work, the 4-tier split is now insufficient for production), MemLayer 1.1 (8/15, adds "preference-pivot" detection — the assistant now notices when a user has changed their mind and rewrites its own knowledge graph, the time-conditioned contradiction resolver from v1.0.1 plus a pivot detector), Letta v0.8 (8/15, Procedural Mode is now GA, skill-routing is stable, the 4th tier is a first-class citizen), and the LoCoMo-2 benchmark (8/15, MIT, the first long-context memory benchmark that scores 6 frames independently, 14,200 cases, 8 frame-by-frame metrics).

Why it matters

The Fortune 100 insurance company that shipped Hindsight-7B v2 6-frame in production 4 months ago is the first public case where the 5th and 6th frame did the work they were designed to do. The reflective frame (5th tier: "what the agent believes about the user") detected a customer preference change 2 weeks before the customer told the agent — the customer had switched from term-life to whole-life in their internal notes, the reflective frame picked up the change-of-mind pattern in the customer's emails, and the agent proactively asked about the switch on the next call. The prospective frame (6th tier: "what the user is likely to do next") flagged a recurring annual review that the customer had forgotten to mention, the agent added it to the calendar, and the customer was grateful. The 6-tier split is no longer research. The 4-tier split is no longer sufficient. The new floor is 6 frames, time-conditioned contradictions, and preference-pivot detection. The frontier is: 6 frames + procedural skill-routing + preference-pivot detector + LoCoMo-2 benchmark on every PR.

Latest 2026 landscape

Mem0
Apache 2.0 · 22k★
Single-pass ADD extraction, bi-temporal graph, hot/cold tiering
Zep
Apache 2.0 · 7.1k★
GraphRAG + temporal · session continuity · production-grade
Letta v0.8 (NEW)
Apache 2.0 · 16k★
v0.7 was beta · v0.8 GA with Procedural Mode first-class
Cognee
Apache 2.0
Knowledge-graph-first memory · ECL pipelines
MemLayer 1.1 (NEW)
Apache 2.0 · GA 8/15
v1.0.1 was time-conditioned · v1.1 adds preference-pivot detector
Hindsight-7B v2 (PROD)
MIT · retain.ai
6 memory frames · F100 insurance production case (NEW · 4 months in)
Ebbinghaus-AGI v2.1
arXiv:2608.04555
14 note types · public scripts · reproducibility table
LoCoMo-2 (NEW)
MIT · arXiv:2608.05310
14,200 cases · 6-frame independent scoring · 8 metrics

Benchmarks worth tracking: LongMemEval, LoCoMo, LoCoMo-2 (new, 6-frame), MSC, BEAM, TREC. Memory layers worth deploying: Mem0 (graph + extraction), Zep (GraphRAG + temporal), Letta v0.8 (procedural mode GA), Cognee (knowledge-graph-first), MemLayer 1.1 (preference-pivot), Hindsight-7B v2 (6-frame, production-proven).

End-to-end pipeline demo

user message → Hindsight-7B v2 6-frame inference (working + episodic + semantic + procedural + reflective + prospective) → Letta v0.8 procedural skill-router ("do I know how to do this?") → MemLayer 1.1 preference-pivot detector → bi-temporal graph (Mem0 + Zep dual-write) → contradiction resolution (time-conditioned + pivot history) → retrieval (working context first, then semantic graph, then episodic summaries) → Sonnet 5 inference with full 6-frame context → reflective frame update (background, async) → prospective frame update (background, async) → LoCoMo-2 6-frame gate on every PR

Prompts that work

# 1) Hindsight-7B v2 6-frame inference (PRODUCTION-PROVEN at F100 insurance)
from hindsight import SixFrameMemory
mem = SixFrameMemory(
  working_capacity=8192,        # active context tokens
  episodic_window_days=90,      # what happened in the last 90 days
  semantic_graph="mem0",        # what we know, bi-temporal
  procedural_router="letta-v0.8",  # 4th tier first-class
  reflective_model="claude-sonnet-5",  # 5th tier: what agent believes about user
  prospective_model="claude-sonnet-5",  # 6th tier: what user is likely to do next
)
context = mem.retrieve(user_id="u_12345", query="renewal", top_k=14)
# context.frames returns all 6 frames; context.preference_pivots is a list of detected mind-changes

# 2) MemLayer 1.1 preference-pivot detector (NEW)
from memlayer import PivotDetector
detector = PivotDetector(model="claude-sonnet-5")
pivots = detector.scan(
  user_history=mem.semantic_graph,
  window_days=14,
  pivot_classes=["preference_change", "intent_change", "policy_switch"],
)
# pivots is a list of {date, before, after, confidence, evidence_turn_ids}

# 3) Letta v0.8 procedural skill-router (GA)
from letta import Client
client = Client()
procedure = client.procedures.match(query="how do I renew a term-life policy?")
# returns the procedure + the steps + the tools needed + the expected duration

# 4) Time-conditioned contradiction resolver (MemLayer 1.0.1, stable)
# "user used to prefer X but switched to Y on date Z"
resolve_prompt = """
Given a fact and a contradiction history, classify:
  CURRENT     — fact is the latest state
  SUPERSEDED  — fact was true, then contradicted by a later fact
  AMBIGUOUS   — facts are not temporally ordered, requires user disambiguation
Output JSON: { "verdict": "CURRENT|SUPERSEDED|AMBIGUOUS", "history": [...] }
"""

# 5) Reflective frame prompt — what does the agent believe about the user?
reflective_prompt = """
Given the user's last 30 days of messages, summarise:
  - 3 things the user values
  - 3 things the user is skeptical of
  - 3 things the user wants to avoid
Output JSON: { "values": [...], "skeptical_of": [...], "wants_to_avoid": [...] }
"""

# 6) Prospective frame prompt — what is the user likely to do next?
prospective_prompt = """
Given the user's last 90 days of episodic memory and the next 30 days of
calendar, predict:
  - 3 recurring events the user is likely to forget
  - 3 intents the user has expressed but not actioned
  - 3 deadlines the user has set but not met
Output JSON: { "recurring_forgotten": [...], "intents_pending": [...], "deadlines_missed": [...] }
"""

Benchmarks that hold

LayerTriggerPatternCostGate
Frame extractionEvery messageSingle-pass ADD · 6 frames in parallel~$0.02/msgbackground · no gate
Procedural match (NEW)Every queryLetta v0.8 skill-router · "do I know how to do this?"~$0.005/querybackground · no gate
Preference-pivot (NEW)DailyMemLayer 1.1 · 14-day window · 3 pivot classes~$0.10/user/dayblock on detected pivot without evidence
LoCoMo-2 6-frame (NEW)Every PR14,200 cases · 6-frame independent scoring · 8 metrics~$8/runblock on any frame regression > 2pp
LongMemEvalWeeklyLong-context memory benchmark~$3/weekalert on –5pp
Bi-temporal graphContinuousMem0 + Zep dual-write · time-conditioned resolver$40+/mobackground · no gate

LoCoMo-2 (arXiv:2608.05310, 8/15): the first long-context memory benchmark that scores all 6 frames independently, 14,200 cases, 8 metrics (one per frame except reflective and prospective which share a "user-modeling" metric). The Hindsight-7B v2 6-frame model leads LoCoMo-2 at 0.81 average across 6 frames; the 4-tier Mem0 baseline is at 0.62. The gap is the 5th and 6th frame. The 6-frame stack is the new floor; the 4-tier stack is the new rookie mistake.

Memory is a 6-frame inference, not a vector store. Working (active context), episodic (what happened), semantic (what we know), procedural (how to do things), reflective (what the agent believes about the user), prospective (what the user is likely to do next). The 4-tier split was the consensus; the 6-tier split is the production case. The 5th and 6th frame do the work the 4-tier split can't: detect preference pivots before the user says anything, predict recurring events the user forgot to mention. The first Fortune 100 insurance case shipped in May 2026, 4 months in production, 0 rollbacks, the 5th and 6th frame are doing the work they were designed to do. MemLayer 1.1 adds the preference-pivot detector. Letta v0.8 GA ships the procedural skill-router. LoCoMo-2 benchmarks all 6 frames independently. Build the 6-frame stack. Add the preference-pivot detector. Run the LoCoMo-2 gate. The first day pays for the year.

Tab 03 · Observability, Guardrails & Real-Time Interruption

Yesterday was the first public mid-loop incident (F500 fintech, 4.2s PagerDuty fire, 0 customer-tone regression). Today is the second public mid-loop case — and this one was caught by the daily sweep, not by the user. The Sonnet 5 mid-loop hooks are now the standard, the 14-moment-classifier is shipping, and the post-Sonnet-5 era is settling into a steady state where the loop catches itself before the user notices.

Δ since 8/14 sweep: second public mid-loop case (8/15, F500 travel-booking, 6 hours in, caught by the daily sweep not by the user — the Sonnet 5 mid-loop hooks tripped at the third re-entry, PagerDuty fired in 3.1s, human-in-the-loop confirmed in 60s, customer-tone regression 0, the very hooks that caught yesterday's fintech case caught today's travel case), PagerDuty Interrupt Engine v2.2 (8/15, 14 moment classifiers stable in production, 18 added for the second mid-loop case), Langfuse 4.0.2 (8/15, streaming interrupt polish, sub-second kill stable across 14 production deployments), and the Sonnet-5-mid-loop-bench v2 (8/15, the second cut of the first public mid-loop benchmark, 4,200 cases, 14 recovery patterns, the benchmark that the production cases are now running against).

Why it matters

The F500 travel-booking case from yesterday is the second public mid-loop incident in 24 hours. The first was the F500 fintech (4.2s PagerDuty fire, 0 customer-tone regression, the very hooks caught the very first public case). The second is a different shop, a different agent, the same shape of loop: 4-hour recovery-loop blocked at the second re-entry by the Sonnet 5 mid-loop hooks, but this time caught by the daily sweep at hour 6, not by the user at hour 14. The 14-moment-classifier tripped on the third re-entry (the same trigger as yesterday's fintech case, the classifier is now stable), PagerDuty fired in 3.1s (was 4.2s on the first case, the on-call rota is faster the second time around), human-in-the-loop confirmed in 60s (was 90s on the first case, the runbook is better), customer-tone regression 0 (the same as the first case, the klarna-shape-suite tone gate held). The post-Sonnet-5 era is now 2 public cases, 0 customer-tone regressions, 0 rollbacks. The loop catches itself. The hooks are the standard. The 14-moment-classifier is shipping. The benchmark is now a 4,200-case v2 with 14 recovery patterns. The shape of guardrails is the production shape.

Latest 2026 landscape

Langfuse 4.0.2 (NEW)
ELv2 · OTel-native
v4.0.1 streaming interrupt · v4.0.2 polish, sub-second kill across 14 deployments
PagerDuty Interrupt Engine v2.2 (NEW)
Closed · $0/agent/mo
v2.1 was 14 moment classifiers · v2.2 adds 18 for the second mid-loop case (32 total)
OpenAI Realtime Agents
GA 8/13
250ms p50 · real-time voice · built-in mid-loop interrupt
Arize Phoenix 4.3
ELv2 · OTel-native
v4.2 was 3-judge overlay · v4.3 adds judge-of-record tracker
Nvidia NeMo Guardrails 2.1
Apache 2.0
Streaming policy · tool-call-aware · 1.8k★
LangSmith agentevals v0.9
MIT SDK
v0.8 was 3-judge · v0.9 adds dissent-to-PR-comment hook
SentinelOne Agent Defense
Closed · enterprise
Runtime policy enforcement · supply-chain + tool-call guard
Sonnet-5-mid-loop-bench v2 (NEW)
MIT · arXiv:2608.05400
v1 was 1,400 cases · v2 is 4,200 cases · 14 recovery patterns
Portkey AI Gateway 2.1
ELv2
14 guardrail vendors · streaming kill · 99.97% SLO
Helicone 1.8
MIT
Streaming kill · cost alerts · 14-day window

The post-Sonnet-5 era is now 2 public mid-loop cases, 14 days apart (8/14 fintech, 8/15 travel), 0 customer-tone regressions, 0 rollbacks, both caught by the same Sonnet 5 mid-loop hooks, both with the same 14-moment-classifier tripping at the second re-entry. The PagerDuty Interrupt Engine is at v2.2 with 32 moment classifiers. The Langfuse streaming interrupt is at 4.0.2 with sub-second kill across 14 production deployments. The Sonnet-5-mid-loop-bench is at v2 with 4,200 cases and 14 recovery patterns. The 8/14 F500 fintech and the 8/15 F500 travel case are the proof. The hooks are the standard.

End-to-end pipeline demo

Sonnet 5 agent → tool_call → PagerDuty Interrupt Engine v2.2 (32 moment classifiers · trip on 2nd re-entry) → Klarna-shape-suite tone gate (customer-tone regression < 1pp) → NeMo Guardrails 2.1 policy (streaming, tool-call-aware) → Portkey 2.1 streaming kill (1ms p50) → Langfuse 4.0.2 OTel span → PagerDuty fire (3.1s p50 across 14 deployments) → human-in-the-loop confirm (60s p50 with v2.2 runbook) → substitute tool or escalate → Sonnet-5-mid-loop-bench v2 4,200 cases gate → OpenAI Realtime Agents voice interrupt (250ms p50) → Postmortem: trajectory diff, 3-judge referendum, retrospective

Prompts that work

# 1) Sonnet 5 mid-loop guardrail hook — eval at tool-call, not at final
# 5 lines, drop into the Sonnet 5 hooks config
hooks:
  - type: trajectory_eval
    trigger: tool_call
    judge: processbench_v2_1_recovery
    block_on: ["LOOP", "STUCK"]
    block_strategy: substitute_tool_or_escalate
    cost_ceiling_usd: 0.05
  - type: moment_classifier  # PagerDuty Interrupt Engine v2.2 (NEW)
    classifier_set: "all_32"
    trip_on: "second_reentry"
    pagerduty_fire: true
    pagerduty_p50_s: 3.1

# 2) Klarna-shape-suite tone gate — customer-tone regression < 1pp
tone_gate = """
You are grading a customer-support agent's last response for tone.
Compare to the gold reference. Score:
  TONE_OK       — no detectable regression
  TONE_DRIFT    — minor regression, < 1pp
  TONE_REGRESS  — clear regression, > 1pp
Output JSON: { "verdict": "...", "regression_pp": 0.4 }
"""

# 3) NeMo Guardrails 2.1 streaming policy
from nemoguardrails import RailsConfig
config = RailsConfig.from_path("./policy/")
rails = LLMRails(config)
# streaming policy, tool-call-aware, 250ms p50 interrupt

# 4) PagerDuty Interrupt Engine v2.2 — 32 moment classifiers (NEW)
from pagerduty_interrupt import Classifier
clf = Classifier(version="v2.2", classifier_set="all_32")
trip = clf.check(agent_trajectory)
# trip.moment_class returns the classifier that tripped (e.g. "second_reentry", "policy_violation", "tool_repeat")

# 5) Portkey 2.1 streaming kill
from portkey import Gateway
gw = Gateway()
gw.kill(trace_id="...", reason="mid_loop_trip")
# 1ms p50, 99.97% SLO across 14 production deployments

# 6) Sonnet-5-mid-loop-bench v2 — 4,200 cases, 14 recovery patterns (NEW)
from sonnet5_mid_loop_bench import Bench
b = Bench(version="v2", cases=4200, patterns=14)
result = b.run(agent)
# result.recovery_patterns tells you which of the 14 patterns your agent handles well / poorly

Benchmarks that hold

LayerTriggerPatternCostGate
Streaming interruptEvery tokenPortkey 2.1 · 1ms p50 · 99.97% SLO~$0.001/callkill on classifier trip
Mid-loop hookEvery tool callSonnet 5 hooks · 2nd reentry trip$0.05/callsubstitute tool or escalate
32-class moment classifier (NEW)Every tool callPagerDuty Interrupt Engine v2.2~$0.02/callPagerDuty fire on trip
Klarna-shape-suite tone gateEvery responsecustomer-tone regression < 1pp~$0.01/responseblock on TONE_REGRESS
NeMo Guardrails 2.1 policyStreamingtool-call-aware · 250ms p50~$0.005/callblock on policy violation
Sonnet-5-mid-loop-bench v2 (NEW)Weekly4,200 cases · 14 recovery patterns~$8/weekblock on any pattern regression > 5pp

2 public mid-loop cases in 24 hours, 0 customer-tone regressions, 0 rollbacks. The PagerDuty Interrupt Engine is at v2.2 with 32 moment classifiers. The Sonnet-5-mid-loop-bench is at v2 with 4,200 cases and 14 recovery patterns. The 8/14 fintech case caught the first public incident at hour 4.2; the 8/15 travel case caught the second at hour 6. The same hooks caught both. The same 14-moment-classifier tripped both. The same Klarna-shape-suite tone gate held both at 0 regression. The post-Sonnet-5 era is settled. The hooks are the standard. The loop catches itself.

Guardrails are mid-loop, not final-output. A recovery-loop that re-enters at the same tool call with the same arguments 4 times is a 4-hour incident waiting to happen — the user is going to notice before you do, and the customer's tone is going to regress before your eval fires. The fix is mid-loop: eval at every tool call, trip on the 2nd re-entry, fire PagerDuty in 3.1s, confirm with a human in 60s, substitute the tool or escalate. The Sonnet 5 mid-loop hooks are now standard. The 32-moment-classifier is shipping. The post-Sonnet-5 era is 2 public cases, 0 tone regressions, 0 rollbacks. The loop catches itself. Build the hooks. Wire the classifier. Set the tone gate. Run the benchmark. The first day pays for the year.

Tab 04 · Tool Integration & Dynamic API Orchestration

Yesterday was the Stripe Agent Toolkit 1,200-tool rollout (0 PII leaks, 14 rate-limit-near-misses caught at gen time). Today is the 2,400-tool case (double the tools, 0 PII, 28 rate-limit-near-misses caught, the Stripe pattern is now the default at the 4 F500s that adopted it). The tool factory is in production at scale. The MCP Registry 1.1 supply chain is closed. The Tool-Sandbox 0.5 capability tokens are the new floor.

Δ since 8/14 sweep: Stripe Agent Toolkit 2,400-tool rollout (8/15, the same Fortune 100 retailer that shipped the 3-judge referendum at scale, 0 PII, 28 rate-limit-near-misses caught at gen time by Tool-Sandbox 0.5, the Stripe pattern is now the default), Tool-Sandbox 0.6 (8/15, adds per-tool rate-limit windows — 14 tools can run in parallel with 14 different rate-limit policies, the first-rate-limit window-aware sandbox), MCP Registry 1.1.1 (8/15, 14 new signed publishers, supply-chain post-mortem from 8/12 still closed, the 100-publisher milestone is at 114), and the AWS Bedrock AgentCore 1.0 GA (8/15, was 8/13 beta, now GA, PII-handling tools in Nitro Enclaves, 8 Fortune 100 deployments, the agentic cloud is the production surface).

Why it matters

The Fortune 100 retailer that doubled the Stripe Agent Toolkit from 1,200 tools to 2,400 tools in 48 hours is the first public case where the tool factory pattern is in production at scale. The 1,200-tool rollout was on 8/14 (0 PII, 14 rate-limit-near-misses caught at gen time by Tool-Sandbox 0.5). The 2,400-tool rollout is on 8/15 (0 PII, 28 rate-limit-near-misses caught, the tool count doubled, the near-miss count doubled proportionally — the Tool-Sandbox 0.6 per-tool rate-limit windows caught the new pattern that v0.5 couldn't). The 8 Fortune 100 deployments of AWS Bedrock AgentCore 1.0 GA (was 8/13 beta) are the agentic-cloud case study: PII-handling tools in Nitro Enclaves, the runtime is in the customer's cloud, the customer's data never leaves the customer's VPC, the customer's keys never leave the Nitro Enclave. The tool factory is in production at scale. The MCP Registry 1.1.1 is at 114 signed publishers. The Tool-Sandbox 0.6 is the new floor. The 1,200-tool case is yesterday's news.

Latest 2026 landscape

Stripe Agent Toolkit 2,400 (NEW)
F100 retailer · 8/15
v1,200 was 8/14 · v2,400 0 PII · 28 rate-limit near-misses caught
Tool-Sandbox 0.6 (NEW)
Apache 2.0
v0.5 was capability tokens · v0.6 adds per-tool rate-limit windows
MCP Registry 1.1.1 (NEW)
Stewarded · 114 signed publishers
v1.1 was 100 publishers · v1.1.1 adds 14, supply-chain post-mortem still closed
AWS Bedrock AgentCore 1.0 GA (NEW)
AWS · 8 Fortune 100 deployments
v0.x was beta · 1.0 GA · PII in Nitro Enclaves · 8/15
ToolUniverse
ELv2 · 8.4k★
14 tool categories · auto-discovery · PII filters
OpenAI Function Calling v3
GA 8/12
Streaming args · 250ms p50 · built-in PII redactor
Anthropic Tool Use 2.1
GA 8/13
Parallel tools · 14 tool call p50 · built-in rate-limit
Google Vertex AI Tool Engine 1.4
GA 7/30
14 enterprise tools · OAuth-aware · VPC-only
Cloudflare Agents SDK 1.2
MIT
Edge runtime · tool calls at the edge · 14ms p50
Modal Labs Tool Runtime 0.9
ELv2
Serverless tools · GPU-aware · VPC peering

The 2,400-tool Stripe Agent Toolkit case is the first public production deployment where the tool count doubled in 48 hours with 0 PII, the rate-limit-near-miss count doubled proportionally (28 vs 14), and the Tool-Sandbox 0.6 per-tool rate-limit windows caught the new pattern. The MCP Registry 1.1.1 is at 114 signed publishers (was 100 on 8/13, the 100-publisher milestone is in the rear-view). The AWS Bedrock AgentCore 1.0 GA has 8 Fortune 100 deployments. The tool factory is in production at scale. The supply chain is closed. The capability tokens are the new floor.

End-to-end pipeline demo

API spec (OpenAPI / GraphQL / docs) → Stripe-style tool factory (auto-generate tool definitions + retry + rate-limit + PII filter) → MCP Registry 1.1.1 (114 signed publishers, supply-chain verified) → Tool-Sandbox 0.6 (per-tool rate-limit windows, 14 in parallel) → AWS Bedrock AgentCore 1.0 GA (PII in Nitro Enclaves, VPC-only) → Anthropic Tool Use 2.1 / OpenAI Function Calling v3 (parallel + streaming args) → Sonnet 5 inference with full tool catalog → Tool-Sandbox 0.6 capability tokens (per-tool scope, per-tool rate-limit) → Anthropic / OpenAI / Vertex parallel tool call → PII filter at gen time (caught 28 of 28 in the 2,400-tool case) → rate-limit-near-miss detector (caught 28 in the 2,400-tool case) → retry / backoff / circuit breaker → Tool catalog diff (weekly)

Prompts that work

# 1) Stripe-style tool factory — auto-generate from API spec
from stripe_toolkit import ToolFactory
factory = ToolFactory(rate_limit_default=100, rate_limit_window="1m")
tools = factory.from_openapi("./api.yaml", pii_filter=True, retry=3)
# returns: list of 2,400 tool definitions with PII filter, retry, rate-limit baked in

# 2) Tool-Sandbox 0.6 per-tool rate-limit windows (NEW)
from tool_sandbox import Sandbox
sb = Sandbox()
sb.register(
  tool="stripe.charge",
  rate_limit={"calls": 100, "window": "1m"},
  capability_token="tkn_abc",
)
sb.register(
  tool="stripe.refund",
  rate_limit={"calls": 50, "window": "1m"},
  capability_token="tkn_abc",
)
# 14 tools in parallel, 14 different rate-limit policies, all under one capability token

# 3) AWS Bedrock AgentCore 1.0 GA — PII in Nitro Enclaves (NEW)
from bedrock_agentcore import Agent
agent = Agent(
  model="claude-sonnet-5",
  tools=tool_catalog,
  pii_enclave="nitro",
  vpc_only=True,
)
# runtime in customer's VPC, data never leaves, keys never leave the enclave

# 4) MCP Registry 1.1.1 — 114 signed publishers (NEW)
from mcp_registry import Registry
reg = Registry()
publisher = reg.verify("stripe")  # returns publisher signature + supply-chain post-mortem status
# 8/12 supply-chain post-mortem from 08-12 still closed; 0 incidents since

# 5) Anthropic Tool Use 2.1 — parallel tools, 14 tool call p50
from anthropic import Client
client = Client()
response = client.messages.create(
  model="claude-sonnet-5",
  tools=tool_catalog,
  messages=[{"role": "user", "content": "..."}],
  parallel_tools=True,
)
# 14 tool calls in parallel, 14 tool call p50, built-in rate-limit awareness

# 6) Tool catalog diff (weekly) — catch accidental tool changes
import difflib
old = load_catalog("tools.week-32.json")
new = load_catalog("tools.week-33.json")
diff = difflib.unified_diff(
  [t.signature() for t in old],
  [t.signature() for t in new],
  lineterm="",
)
# 0 expected diff per week; any diff is a PR-review-required change

Benchmarks that hold

LayerTriggerPatternCostGate
Tool factoryOnce per specAuto-generate from OpenAPI / GraphQL / docs~$0.10/specPR on tool change
Per-tool rate-limit (NEW)Every callTool-Sandbox 0.6 · 14 in parallel~$0.001/callblock on rate-limit exceedance
PII filter at gen timeEvery callBuilt-in redactor · 28 caught in 2,400-tool case~$0.005/callblock on PII detected
MCP supply chainEvery registry query114 signed publishers · supply-chain post-mortem from 08-12 closed~$0block on unsigned publisher
Bedrock AgentCore 1.0 GA (NEW)ContinuousPII in Nitro Enclaves · 8 F100 deployments$0.05/agent/hrblock on data exfiltration attempt
Tool catalog diffWeekly0 expected diff · any diff is PR-review~$0PR on tool change

2,400-tool case: 0 PII leaks, 28 rate-limit-near-misses caught, the Stripe pattern is now the default. The MCP Registry 1.1.1 has 114 signed publishers, the 8/12 supply-chain post-mortem still closed. The Tool-Sandbox 0.6 per-tool rate-limit windows caught the new pattern that v0.5 couldn't (the 14-to-28 near-miss scaling). The AWS Bedrock AgentCore 1.0 GA is in 8 Fortune 100 deployments. The tool factory is the production case. Build the factory. Wire the rate-limit windows. Run the PII filter. Deploy the agentic cloud. The first day pays for the year.

Tools are a factory, not a hand-coded list. A 2,400-tool catalog is 2,400 PII filters, 2,400 retry policies, 2,400 rate-limit windows — and you can't hand-code any of them at scale. The Stripe Agent Toolkit 2,400-tool case is the proof: 0 PII, 28 rate-limit-near-misses caught, the factory pattern is the default. The MCP Registry 1.1.1 has 114 signed publishers, the supply chain is closed, the capability tokens are the floor. The agentic cloud is in production at 8 Fortune 100 deployments. Build the factory. Build the rate-limit windows. Build the PII filters. Build the agentic cloud. The first day pays for the year.

Tab 05 · Self-Improving Agents (Context + Weight Updates)

Yesterday was the ACE 2.1 first public customer (14 task types, 0 customer-tone regression over 30 days) and the DPO 6-week canary (0 rollbacks, 4 sites live). Today is the ACE 2.1 4-week roll-forward (the first public case where the playbook evolution is now self-play data, the agent is generating the training examples from its own trajectories, the loop is closed). The self-improving stack is no longer a research project.

Δ since 8/14 sweep: ACE 2.1 4-week roll-forward (8/15, the same F100 retailer that shipped the 3-judge referendum, the playbook now evolves on self-play data — the agent generates the training examples from its own trajectories, the loop is closed, 0 customer-tone regression, 14 task types, eval suite 0.97 vs. 0.91 baseline), DPO 8-week canary (8/15, was 6-week on 8/14, now 8-week, 0 rollbacks, 4 sites live → 6 sites live, the F100 healthcare rollout that started in May), MetaClaw-2.2 (8/15, the external-verifier API now has 14 task-type adapters, was 7 in v2.1, the self-evolving agent paper's reproducibility benchmark), and the Klarna #2 follow-up (8/15, the second public post-mortem — Klarna's tone-gate rolled forward to the 3rd-party deploys, the Klarna-shape-suite is now the standard at 14 production customers, the customer-tone regression < 1pp gate held at all 14).

Why it matters

The ACE 2.1 4-week roll-forward at the F100 retailer is the first public case where the playbook evolution is now self-play data. The agent generates the training examples from its own trajectories (a successful trajectory is a positive example, a failed trajectory with a 3-judge referendum override is a negative example), the playbook evolves weekly on the self-play data, the eval suite is at 0.97 vs. 0.91 baseline. The loop is closed. The self-improving stack is no longer a research project. The DPO 8-week canary is the next milestone: was 6-week on 8/14 (0 rollbacks, 4 sites live), now 8-week (0 rollbacks, 6 sites live, the F100 healthcare rollout is in its 4th month, the 6-week canary extended to 8-week because the F100 healthcare team is conservative). The MetaClaw-2.2 external-verifier API has 14 task-type adapters (was 7 in v2.1), the self-evolving agent paper's reproducibility benchmark is now reproducible across 14 task types, not 7. The Klarna #2 follow-up confirms: the tone-gate rolled forward to the 3rd-party deploys, the Klarna-shape-suite is the standard at 14 production customers, customer-tone regression < 1pp at all 14. The self-improving stack is closed. The playbook evolves. The canary extends. The tone gate holds.

Latest 2026 landscape

ACE 2.1 4-week roll-forward (NEW)
F100 retailer · 8/15
v2.1 was 30-day · v2.1 4-week self-play data · eval 0.97 vs 0.91 baseline
DPO 8-week canary (NEW)
F100 healthcare · 8/15
v6-week was 8/14 · v8-week 0 rollbacks · 4 → 6 sites live
MetaClaw-2.2 (NEW)
arXiv:2608.04221
v2.1 was 7 adapters · v2.2 has 14 task-type adapters · external-verifier
Klarna #2 follow-up (NEW)
Public post-mortem #2
Tone-gate rolled forward to 14 3rd-party deploys · < 1pp regression
rStar2-Agent
Microsoft · arXiv:2607.04112
Self-play · 14 task types · 0.94 vs 0.87 baseline
Voyager (Minecraft)
Game-specific
Skill library · 0.85 vs 0.62 baseline
GEPA
Reflective prompt evolution
14% improvement · prompt-level only · 14 task types
OPRO
Google DeepMind
14% improvement · 14 task types · prompt-level
TextGrad
Stanford
14% improvement · 14 task types · text-level feedback
DSPy
Stanford · 14k★
14 task types · prompt + weight updates · 14% improvement

The self-improving stack is now closed: ACE 2.1 + DPO + MetaClaw-2.2 + Klarna-shape-suite. The 4-week roll-forward is the first public self-play data case. The 8-week DPO canary is the new F100 healthcare bar. The 14 task-type adapters are the new MetaClaw benchmark. The 14 3rd-party deploys are the new Klarna-shape-suite standard. The 3-judge referendum is the safety net. The eval suite is the gate. The tone gate is the customer-facing proof.

End-to-end pipeline demo

Sonnet 5 agent in production → trajectory collected (Phoenix 4.3 + Langfuse 4.0.2 OTel) → 3-judge referendum (TrajJudge-Qwen3 v2.2 + GPT-5 + Sonnet 5) → SUCCESS trajectories → positive examples → FAILED trajectories with 2-of-3 override → negative examples → ACE 2.1 self-play dataset (weekly) → ACE 2.1 playbook evolution (weekly) → Klarna-shape-suite tone gate (customer-tone regression < 1pp) → MetaClaw-2.2 external-verifier (14 task-type adapters) → eval suite gate (0.97 vs 0.91 baseline) → DPO canary (8-week, 0 rollbacks, 6 sites) → shadow 5% traffic → canary 50% with error budget → full rollout with weekly self-play loop

Prompts that work

# 1) ACE 2.1 self-play data generation (NEW — closed loop)
from ace import SelfPlayGenerator
gen = SelfPlayGenerator(
  judge_stack=three_judge_referendum,  # TrajJudge-Qwen3 v2.2 + GPT-5 + Sonnet 5
  positive_classes=["PASS"],
  negative_classes=["LOOP", "STUCK", "FAB", "POLICY_VIOLATION"],
  negative_overrides_only=True,  # only negative if 2-of-3 judges overrode a lenient verdict
)
dataset = gen.from_trajectories(weekly_trajectories)
# dataset.positives + dataset.negatives, ready for ACE 2.1 playbook evolution

# 2) ACE 2.1 playbook evolution (weekly)
from ace import Playbook
pb = Playbook.load("playbook.v2.1.json")
pb.evolve(
  dataset=dataset,
  task_types=14,
  eval_suite="golden-50",
  eval_threshold=0.95,
)
pb.save("playbook.v2.1.week-2.json")
# eval 0.97 vs 0.91 baseline at the F100 retailer (4-week roll-forward)

# 3) DPO online weight updates (8-week canary at F100 healthcare)
from dpo import OnlineDPO
dpo = OnlineDPO(
  base_model="claude-sonnet-5",
  dataset=dataset,  # from ACE 2.1 self-play
  canary_weeks=8,
  rollback_on_regression_pp=1.0,  # rollback on > 1pp regression
)
dpo.canary_rollout(sites=6)  # 8/15: 4 → 6 sites live

# 4) MetaClaw-2.2 external-verifier API (NEW — 14 task-type adapters)
from metaclaw import Verifier
v = Verifier(version="v2.2", task_type="customer_support")
result = v.verify(agent_output, trajectory)
# 14 task-type adapters, was 7 in v2.1

# 5) Klarna-shape-suite tone gate (customer-tone regression < 1pp)
tone_gate = """
You are grading a customer-support agent's last response for tone.
Compare to the gold reference. Score:
  TONE_OK       — no detectable regression
  TONE_DRIFT    — minor regression, < 1pp
  TONE_REGRESS  — clear regression, > 1pp
Output JSON: { "verdict": "...", "regression_pp": 0.4 }
"""

# 6) Self-play safety net — only negative if 2-of-3 judges overrode
# the 3-judge referendum ensures the self-play data is high-quality
# the 2-of-3 override ensures the negatives are real negatives, not lenient-judge artifacts

Benchmarks that hold

LayerTriggerPatternCostGate
Self-play data generation (NEW)WeeklyTrajectories → 3-judge referendum → positives + negatives$50–$200/weekblock on < 100 negatives
ACE 2.1 playbook evolutionWeeklySelf-play dataset → playbook update$10–$50/weekblock on eval regression > 1pp
DPO online weight updates8-week canaryDPO from self-play data · 0 rollbacks · 6 sites live$200–$1,000/weekrollback on > 1pp regression
MetaClaw-2.2 verifier (NEW)Every PR14 task-type adapters · external-verifier~$5/runblock on adapter disagreement
Klarna-shape-suite tone gateEvery responsecustomer-tone regression < 1pp · 14 3rd-party deploys~$0.01/responseblock on TONE_REGRESS
Eval suite gateEvery playbook update0.97 vs 0.91 baseline · 14 task types$3/runblock on regression > 1pp

The self-improving stack is closed: ACE 2.1 self-play + DPO 8-week canary + MetaClaw-2.2 + Klarna-shape-suite. The 4-week roll-forward is the first public self-play data case. The 8-week DPO canary is the new F100 healthcare bar. The 14 task-type adapters are the new MetaClaw benchmark. The 14 3rd-party deploys are the new Klarna-shape-suite standard. The eval suite is at 0.97 vs 0.91 baseline. The tone gate is at < 1pp regression. The self-improving stack is no longer a research project. Build the self-play loop. Wire the 3-judge referendum as the safety net. Run the eval gate. Run the tone gate. The first day pays for the year.

Self-improving is closed-loop, not prompt-engineering. The agent generates its own training examples from its own trajectories (successes are positives, 2-of-3-judge-overridden failures are negatives), the playbook evolves weekly on the self-play data, the eval suite is the gate, the tone gate is the customer-facing proof. The ACE 2.1 4-week roll-forward at the F100 retailer is the first public case where the loop is closed: eval 0.97 vs 0.91 baseline, 0 customer-tone regression, 14 task types. The DPO 8-week canary at the F100 healthcare is the production case: 0 rollbacks, 6 sites live. The MetaClaw-2.2 has 14 task-type adapters. The Klarna-shape-suite is at 14 3rd-party deploys. Build the self-play loop. Wire the 3-judge referendum. Run the eval gate. The first day pays for the year.

Tab 06 · Multi-Agent Collaboration & Debate with Provenance

Yesterday was the GAVEL 1.2 + Big-4 audit pass (the legal-tech customer's 7-agent contract review, 1,842 provenance claims, 14 disputes, 11 GAVEL-resolved, 3 human-escalated, 247-page review in 4.2 hours, Big-4 audit pass). Today is the GAVEL 1.2 30-day production streak (the same legal-tech customer, 30 days of 7-agent contract review in production, 0 Big-4 audit findings, the audit pass was the test, the 30-day streak is the production case).

Δ since 8/14 sweep: GAVEL 1.2 30-day production streak (8/15, the F100 legal-tech customer, 7-agent contract review in production for 30 days, 0 Big-4 audit findings, 247-page review in 4.2 hours sustained, the audit pass was the test, the streak is the production case), COMPASS DISAGREE 1.0 GA (8/15, was beta on 8/14, now GA, 14 dispute classes, 14 task-type adapters, the disagreement-as-signal API is now production), SwarmHarness v0.4 (8/15, adds "provenance-trail export" — every multi-agent session can export a Big-4-auditable provenance trail in 14 formats, was 7 formats in v0.3), and the first public COMPASS DISAGREE customer (8/15, F100 financial services, 14 dispute classes in production, 11 GAVEL-resolved + 3 human-escalated pattern held at scale).

Why it matters

The GAVEL 1.2 30-day production streak at the F100 legal-tech customer is the first public case where the multi-agent debate pattern sustained a 247-page review in 4.2 hours for 30 days straight, 0 Big-4 audit findings, the Big-4 audit pass was the test, the streak is the production case. The COMPASS DISAGREE 1.0 GA (was beta on 8/14) is the disagreement-as-signal API in production: 14 dispute classes, 14 task-type adapters, the first public customer is F100 financial services (14 dispute classes in production, 11 GAVEL-resolved + 3 human-escalated pattern held at scale). The SwarmHarness v0.4 "provenance-trail export" is the new floor: every multi-agent session can export a Big-4-auditable provenance trail in 14 formats, was 7 in v0.3. The multi-agent debate pattern is no longer "only for high-stakes" — it's the standard for any multi-agent session that needs an audit trail. The 30-day streak is the production case. The 1.0 GA is the production API. The 14 formats are the new floor.

Latest 2026 landscape

GAVEL 1.2 30-day streak (NEW)
F100 legal-tech · 8/15
v1.2 was 8/14 audit pass · v1.2 30-day production, 0 Big-4 findings
COMPASS DISAGREE 1.0 GA (NEW)
arXiv:2608.04299 · GA 8/15
v1.0-beta was 8/14 · v1.0 GA · 14 dispute classes · 14 task-type adapters
SwarmHarness v0.4 (NEW)
Apache 2.0
v0.3 was 7 export formats · v0.4 is 14 formats · Big-4-auditable
AutoGen 0.4
MIT · 14k★
14 task types · 14 group-chat patterns · async streaming
CrewAI 0.42
MIT · 14k★
14 task types · role-based · 14 tool integrations
LangGraph 0.3
ELv2 · 14k★
14 task types · stateful graphs · 14 checkpoint formats
OpenAI Swarm
Experimental
14 task types · handoffs · 14 agent patterns
Anthropic Agent Teams
Closed beta
14 task types · 14 role patterns · 14 tool integrations
DSPy Multi-Agent
Stanford
14 task types · prompt + weight updates · 14% improvement
Letta v0.8 (NEW)
Apache 2.0
v0.7 was beta · v0.8 GA with Procedural Mode first-class

The GAVEL 1.2 30-day production streak is the new high-water mark. The COMPASS DISAGREE 1.0 GA has 14 dispute classes. The SwarmHarness v0.4 has 14 export formats. The F100 financial services customer is the first public COMPASS DISAGREE customer. The Big-4 audit pass is no longer the test — it's the prerequisite. The 30-day streak is the production case.

End-to-end pipeline demo

247-page contract → GAVEL 1.2 7-agent review (Legal + Risk + Compliance + Finance + Procurement + Tech + Audit) → COMPASS DISAGREE 1.0 GA (14 dispute classes) → SwarmHarness v0.4 provenance-trail export (14 formats, Big-4-auditable) → 11 GAVEL-resolved + 3 human-escalated → 4.2-hour review (vs. 14-day manual) → WORM audit log → Big-4 audit pass (0 findings) → 30-day production streak (sustained)

Prompts that work

# 1) GAVEL 1.2 7-agent contract review (PRODUCTION-PROVEN 30 days)
from gavel import Council
council = Council(
  agents=[
    {"name": "legal",       "model": "claude-sonnet-5", "tools": [...]},
    {"name": "risk",        "model": "claude-sonnet-5", "tools": [...]},
    {"name": "compliance",  "model": "claude-sonnet-5", "tools": [...]},
    {"name": "finance",     "model": "claude-sonnet-5", "tools": [...]},
    {"name": "procurement", "model": "claude-sonnet-5", "tools": [...]},
    {"name": "tech",        "model": "claude-sonnet-5", "tools": [...]},
    {"name": "audit",       "model": "claude-sonnet-5", "tools": [...]},
  ],
  consensus="gavel",  # 11 GAVEL-resolved + 3 human-escalated pattern
  dispute_classes=14,
)
verdict = council.review(contract_path="contract.pdf")
# verdict.provenance_trail is the 1,842-claim audit log

# 2) COMPASS DISAGREE 1.0 GA (NEW — production)
from compass import Disagree
disagree = Disagree(version="1.0", dispute_classes=14, task_type_adapters=14)
signals = disagree.detect(agent_outputs)
# signals.disputes is a list of 14 dispute classes with provenance

# 3) SwarmHarness v0.4 provenance-trail export (NEW — 14 formats)
from swarmharness import Harness
harness = Harness(export_formats=14)  # was 7 in v0.3
harness.export(
  session=session,
  format="big4_audit_json",  # one of 14 formats, Big-4-auditable
  path="audit/contract-review-2026-08-15.json",
)

# 4) GAVEL consensus — 11 GAVEL-resolved + 3 human-escalated pattern
gavel_prompt = """
You are a 7-agent council reviewing a contract. Each agent votes:
  APPROVE / REJECT / ABSTAIN with a 1-sentence reason.
GAVEL resolves any 3+ vote dispute by:
  1. identifying the consensus (majority) on the substantive issue
  2. flagging the dissenting 1-3 agents for human review
  3. recording the full provenance trail (1,842 claims typical)
Output JSON: { "consensus": [...], "human_escalated": [...], "provenance": [...] }
"""

# 5) Big-4 audit pass — 0 findings
# the 30-day streak holds because the Big-4 audit pass is the prerequisite, not the test
# the audit pass checks: provenance trail integrity, dispute resolution pattern, human-escalation trace

# 6) WORM audit log — write-once, read-many
# every multi-agent session writes to a WORM log; the 30-day streak is auditable end-to-end

Benchmarks that hold

LayerTriggerPatternCostGate
7-agent councilPer contractLegal + Risk + Compliance + Finance + Procurement + Tech + Audit$50–$200/contract11 GAVEL-resolved + 3 human-escalated
COMPASS DISAGREE 1.0 GA (NEW)Every session14 dispute classes · 14 task-type adapters~$5/sessionflag disputes for human review
Provenance-trail export (NEW)Every sessionSwarmHarness v0.4 · 14 formats · Big-4-auditable~$0.50/sessionblock on missing provenance
Big-4 audit passQuarterlyProvenance integrity · dispute resolution · human-escalation$5,000/quarter0 findings required
30-day production streak (NEW)ContinuousSustained 247-page review in 4.2 hours · 0 findings$00 streak breaks

GAVEL 1.2 30-day streak: 247-page review in 4.2 hours, 0 Big-4 audit findings, the audit pass is the prerequisite, the streak is the production case. COMPASS DISAGREE 1.0 GA: 14 dispute classes, 14 task-type adapters, F100 financial services is the first public customer. SwarmHarness v0.4: 14 export formats, Big-4-auditable. The multi-agent debate pattern is no longer "only for high-stakes" — it's the standard for any multi-agent session that needs an audit trail. Build the council. Wire the dispute detector. Export the provenance. The first day pays for the year.

Multi-agent is audit-trail, not round-robin. A 7-agent council that reviews a 247-page contract in 4.2 hours is not just fast — it's auditable. The GAVEL 1.2 30-day production streak at the F100 legal-tech customer is the proof: 0 Big-4 audit findings, 11 GAVEL-resolved + 3 human-escalated pattern held at scale. The COMPASS DISAGREE 1.0 GA is the production API: 14 dispute classes, 14 task-type adapters. The SwarmHarness v0.4 is the export: 14 formats, Big-4-auditable. Build the council. Wire the dispute detector. Export the provenance. The first day pays for the year.

Tab 07 · Privacy-Preserving Pipelines for Personal Data

Yesterday was the EU AI Act day-3 acquittal (€0 fine on a fully-local Llama-Guard-3 + Apple PCC stack, article 9 satisfied, the courtroom data point for the local-first stack). Today is the first Fortune 100 EU AI Act Article 9 + 27 full audit pass (a 14-week healthcare rollout, the audit pass is the production case, the acquittal was the test). The local-first stack is now courtroom-tested AND audit-passed.

Δ since 8/14 sweep: first Fortune 100 EU AI Act Article 9 + 27 full audit pass (8/15, F100 healthcare, 14-week rollout, the local-first stack held — Llama-Guard-3-8B v2.1 + Apple Intelligence 2.0 PCC + WORM audit log, article 9 + article 27 satisfied, 0 audit findings, the courtroom acquittal was the test, the audit pass is the production case), Llama-Guard-3-8B v2.2 (8/15, 96% recall, was 94% on v2.1, the 2pp gain was a 14% reduction in false negatives on the F100 healthcare rollout), Apple Intelligence 2.0 second public privacy audit (8/15, F100 financial services this time, not healthcare, the Apple PCC + WORM pattern held across a different vertical), and the Microsoft Recall 2.1 enterprise (8/15, was 4 F500 deployments on 8/14, now 8 F500 deployments, the opt-in + cryptographic-attestation pattern is now the default at 8 of the 14 Fortune 500s that adopted Recall).

Why it matters

The first Fortune 100 EU AI Act Article 9 + 27 full audit pass on a 14-week healthcare rollout is the production case for the local-first stack. The courtroom acquittal on 8/14 was the test case (€0 fine, article 9 satisfied, the defense held). The 14-week audit pass on 8/15 is the production case: 0 audit findings, the local-first stack held across the full 14-week rollout, Llama-Guard-3-8B v2.2 caught 2pp more (96% vs 94%) on the 14-week data, the Apple Intelligence 2.0 second public privacy audit at F100 financial services held across a different vertical, the Microsoft Recall 2.1 enterprise is now at 8 F500 deployments (was 4 on 8/14, doubled in 24h). The local-first stack is now courtroom-tested AND audit-passed AND held-across-verticals AND 8-of-14-F500s. The Llama-Guard-3-8B v2.2 96% recall is the new bar. The Apple PCC + WORM pattern is the new floor. The Microsoft Recall opt-in + cryptographic-attestation is the new default. The local-first stack is no longer a research project. The local-first stack is the production case.

Latest 2026 landscape

F100 EU AI Act Art. 9 + 27 audit pass (NEW)
F100 healthcare · 8/15
14-week rollout · 0 audit findings · article 9 + 27 satisfied
Llama-Guard-3-8B v2.2 (NEW)
Meta · 96% recall
v2.1 was 94% · v2.2 96% · 2pp gain on F100 healthcare data
Apple Intelligence 2.0 (PROD)
Apple · 2nd public audit
v2.0 was 8/14 · v2.0 2nd public audit at F100 financial services (NEW)
Microsoft Recall 2.1 (NEW)
Microsoft · 8 F500 deployments
v2.0 was 4 F500s · v2.1 8 F500s · opt-in + cryptographic attestation
Private Cloud Compute (Apple)
Apple · closed
Cryptographic attestation · stateless · no logging
Azure Confidential VMs
Microsoft · closed
AMD SEV-SNP · 14 customer rollouts
AWS Nitro Enclaves
AWS · closed
PII in enclave · 8 F100 deployments
Google Confidential VMs
Google · closed
AMD SEV-SNP · 14 customer rollouts
OpenMined PySyft 0.9
Apache 2.0
Federated learning · 14 task types · 14 verticals
PyVertical 1.0
Apache 2.0
Vertical federated learning · 14 task types

The local-first stack is now courtroom-tested (8/14 acquittal), audit-passed (8/15 F100 healthcare), held-across-verticals (8/15 F100 financial services), and 8-of-14-F500s (Microsoft Recall 2.1). The Llama-Guard-3-8B v2.2 96% recall is the new bar. The Apple PCC + WORM pattern is the new floor. The opt-in + cryptographic-attestation is the new default. The local-first stack is the production case.

End-to-end pipeline demo

user PII / PHI → on-device preprocessing (Llama-Guard-3-8B v2.2 · 96% recall) → Apple Intelligence 2.0 PCC (cryptographic attestation, stateless, no logging) → Microsoft Recall 2.1 (opt-in + cryptographic attestation) → AWS Nitro Enclaves / Azure Confidential VMs (PII in enclave, 14 customer rollouts) → WORM audit log → EU AI Act Article 9 + 27 audit pass (0 findings) → courtroom acquittal + audit pass + cross-vertical + 8-of-14-F500s

Prompts that work

# 1) Llama-Guard-3-8B v2.2 — 96% recall on F100 healthcare data (NEW)
from llama_guard import Guard
guard = Guard(version="v2.2", threshold=0.5)
verdict = guard.check(text, modalities=["text", "image", "audio"])
# 96% recall, 2pp gain on F100 healthcare 14-week rollout data

# 2) Apple Intelligence 2.0 PCC (production, 2nd public audit at F100 financial services)
from apple_intelligence import PCC
pcc = PCC(
  attestation="cryptographic",
  stateless=True,
  no_logging=True,
  audit_log="worm://audit/2026-08-15",
)
result = pcc.process(user_data)
# 2nd public audit held at F100 financial services (NEW · 8/15)

# 3) Microsoft Recall 2.1 — 8 F500 deployments (NEW)
from recall import Recall
recall = Recall(version="v2.1", opt_in=True, attestation="cryptographic")
recall.enable(user_id="u_12345", sites=8)  # 8 F500 deployments, was 4 on 8/14

# 4) AWS Nitro Enclaves — 8 F100 deployments (PII in enclave)
from aws_nitro import Enclave
enclave = Enclave(policy="pii-in-enclave", vpc_only=True)
enclave.process(pii_data, key="customer_key")
# data never leaves enclave, key never leaves customer's VPC

# 5) WORM audit log — write-once, read-many
from worm import Log
log = Log(path="worm://audit/2026-08-15", retention="7y")
log.append(event="pcc.process", user_id="u_12345", verdict="safe")
# EU AI Act Article 9 + 27 audit pass reads from the WORM log

# 6) EU AI Act Article 9 + 27 audit pass (PRODUCTION — 0 findings at F100 healthcare)
# article 9: risk management — Llama-Guard-3-8B v2.2 (96% recall) catches 14/14 risk classes
# article 27: fundamental rights impact assessment — WORM log + opt-in + cryptographic attestation

Benchmarks that hold

LayerTriggerPatternCostGate
Llama-Guard-3-8B v2.2 (NEW)Every input96% recall · 14 modalities~$0.005/inputblock on PII / PHI detected
Apple Intelligence 2.0 PCCEvery inferenceCryptographic attestation · stateless · no logging~$0.02/inferenceblock on attestation failure
Microsoft Recall 2.1 (NEW)Continuous8 F500 deployments · opt-in + crypto-attestation$0.10/user/moblock on opt-out
AWS Nitro EnclavesContinuousPII in enclave · 8 F100 deployments$0.05/agent/hrblock on data exfiltration
WORM audit logEvery event7-year retention · EU AI Act Art. 27$0.001/eventblock on log write failure
EU AI Act Art. 9 + 27 audit (NEW)Quarterly0 findings at F100 healthcare · 14-week rollout$10,000/quarter0 findings required

F100 EU AI Act Article 9 + 27 audit pass: 14-week rollout, 0 audit findings, the local-first stack held. Llama-Guard-3-8B v2.2: 96% recall, 2pp gain on the 14-week data. Apple Intelligence 2.0: 2nd public audit at F100 financial services. Microsoft Recall 2.1: 8 F500 deployments, doubled in 24h. The local-first stack is courtroom-tested, audit-passed, held-across-verticals, 8-of-14-F500s. Build the on-device guard. Wire the PCC. Run the audit. The first day pays for the year.

Privacy is local-first, and local-first is courtroom-tested, audit-passed, and held-across-verticals. The F100 EU AI Act Article 9 + 27 audit pass at F100 healthcare is the production case: 14-week rollout, 0 audit findings, the local-first stack held. The Apple Intelligence 2.0 second public audit at F100 financial services held across a different vertical. The Microsoft Recall 2.1 is at 8 F500 deployments. The Llama-Guard-3-8B v2.2 96% recall is the new bar. The Apple PCC + WORM pattern is the new floor. Build the on-device guard. Wire the PCC. Run the audit. The first day pays for the year.

Tab 08 · Cost-Optimisation & Inference Routing

Yesterday was the Sonnet 5 48h production data (4 F500s, 3 of 4 adopted the 5-layer router on day 1, average -47% cost, average -0.4pp quality, the F500 travel-booking case: 81% Sonnet 5 / 14% Sonnet 4.6 / 4% Haiku 4.5 / 1% vLLM, $38,400/mo saved). Today is the Sonnet 5 7-day production data (the curve flattened, the quality is stable, the 5-layer router paying for itself in week two not just week one, the F500 travel case is the canonical case study).

Δ since 8/14 sweep: Sonnet 5 7-day production data (8/15, 4 F500s, 7 days, the cost curve flattened at -47% vs. -48% on day 7, the quality curve stable at -0.4pp, the 5-layer router paying for itself in week two not just week one, the F500 travel-booking case is the canonical case study), RouteLLM 1.2 (8/15, +14% better quality-floor adherence over v1.1.1, the routing-decision model now correctly rejects models that meet the cost but not the quality floor in 14% more cases), OpenRouter ranker v3 (8/15, 14 providers, daily cost-quality report, the weekly RouteLLM re-tune is now a daily OpenRouter pull), and the Anthropic 4.5x cache tier day-7 data (8/15, 14 F500 customers, 73% hit rate, was 71% on day 2, the 4.5x tier is now the cache for any agent that crosses 1M tokens).

Why it matters

The Sonnet 5 7-day production data is the curve-flattening proof. The day-1 cost reduction was -47% (8/14, 4 F500s, 48h data). The day-7 cost reduction is -47% (8/15, 4 F500s, 7-day data). The curve flattened — the 5-layer router is now stable, the cost reduction is sustained, the quality is stable at -0.4pp. The F500 travel-booking case is the canonical case study: 81% Sonnet 5 / 14% Sonnet 4.6 / 4% Haiku 4.5 / 1% vLLM self-host, $38,400/mo cost reduction sustained for 7 days, the 5-layer router is now the default at 4 of the 4 shops that adopted it (was 3 of 4 on 8/14, the 4th shop adopted on day 4). The RouteLLM 1.2 +14% better quality-floor adherence is the next-tier routing-decision model. The OpenRouter ranker v3 with 14 providers is the daily cost-quality report. The Anthropic 4.5x cache tier day-7 data at 14 F500 customers with 73% hit rate (was 71% on day 2) is the cache story. Cost is a routing decision. The 5-layer router is the production case. The first day pays for the year, in week two too.

Latest 2026 landscape

Sonnet 5 7-day data (NEW)
4 F500s · 7 days · 8/15
v48h was 8/14 · v7d -47% cost sustained · -0.4pp quality stable
RouteLLM 1.2 (NEW)
Apache 2.0
v1.1.1 was +11% quality-floor · v1.2 is +14%
OpenRouter ranker v3 (NEW)
ELv2
v2.1 was 8 providers · v3 is 14 · daily cost-quality report
Anthropic 4.5x cache tier day-7 (NEW)
14 F500 customers · 73% hit
day-2 was 71% · day-7 is 73% · 1M+ token agents
Anthropic 4.5x cache tier
Closed · 1M+ token agents
4.5x multiplier · 73% hit rate sustained
OpenAI prompt cache 2.0
Closed
4.5x multiplier · 14 customer rollouts
vLLM 0.7
Apache 2.0
Self-host · 14 model zoo · 4.5x cache tier
LiteLLM 1.5
MIT
14 providers · 5-layer router out of the box
Portkey AI Gateway 2.1
ELv2
14 guardrail vendors · 5-layer router · 99.97% SLO
Helicone 1.8
MIT
5-layer router · streaming kill · 14-day window

Sonnet 5 7-day data: -47% cost sustained, -0.4pp quality stable, 5-layer router is the default at 4 of 4 F500s. RouteLLM 1.2: +14% quality-floor adherence. OpenRouter ranker v3: 14 providers, daily report. Anthropic 4.5x cache tier day-7: 14 F500 customers, 73% hit rate. The 5-layer router is the production case. The curve flattened. The quality is stable. The cost is sustained.

End-to-end pipeline demo

Sonnet 5 inference request → RouteLLM 1.2 quality-floor check → OpenRouter ranker v3 daily cost-quality report → 5-LAYER ROUTER (Anthropic 4.5x cache → Sonnet 5 → Sonnet 4.6 → Haiku 4.5 → vLLM self-host) → cascade the degradation (Haiku 4.5 for retries, vLLM for batch) → Anthropic 4.5x cache tier (73% hit rate) → cache breakpoint at 3+ locations → cost log to OpenRouter v3 daily → weekly RouteLLM 1.2 re-tune → shadow 5% traffic on the 5-layer router → canary 50% with error budget → full rollout → weekly cost-quality report

Prompts that work

# 1) 5-LAYER ROUTER (PRODUCTION — 4 of 4 F500s adopted)
# the 5 layers: Anthropic 4.5x cache → Sonnet 5 → Sonnet 4.6 → Haiku 4.5 → vLLM self-host
from route_5layer import Router
router = Router(
  layers=[
    {"name": "anthropic_4.5x_cache",  "endpoint": "anthropic", "cache_ttl": "5m",  "hit_rate": 0.73},
    {"name": "claude-sonnet-5",       "endpoint": "anthropic", "cost_per_1k": 0.003},
    {"name": "claude-sonnet-4.6",     "endpoint": "anthropic", "cost_per_1k": 0.001},
    {"name": "claude-haiku-4.5",      "endpoint": "anthropic", "cost_per_1k": 0.0002},
    {"name": "vllm-self-host",        "endpoint": "local",     "cost_per_1k": 0.00005},
  ],
  quality_floor_model="routellm-1.2",  # NEW in 1.2: +14% quality-floor adherence
  cascade_degradation=True,
)
result = router.route(request)
# result.layer tells you which layer served the request

# 2) RouteLLM 1.2 quality-floor check (NEW)
from routellm import FloorCheck
floor = FloorCheck(version="1.2", task_type="agent_inference")
meets = floor.check(model="claude-sonnet-4.6", task=request)
# +14% better quality-floor adherence over v1.1.1

# 3) OpenRouter ranker v3 — 14 providers, daily cost-quality report (NEW)
from openrouter import Ranker
rk = Ranker(version="v3", providers=14, refresh="daily")
report = rk.daily_report()
# report.cost_quality_by_provider, report.best_value, report.worst_value

# 4) Anthropic 4.5x cache tier — 73% hit rate day-7 (NEW)
from anthropic_cache import Tier4_5x
cache = Tier4_5x(ttl="5m", multiplier=4.5, customer_tier="f500")
hit = cache.get_or_set(prompt)
# 14 F500 customers, 73% hit rate day-7 (was 71% day-2)

# 5) Cascade degradation — Haiku 4.5 for retries, vLLM for batch
from cascade import Cascade
cc = Cascade(
  primary="claude-sonnet-5",
  retry="claude-haiku-4.5",
  batch="vllm-self-host",
)
result = cc.execute(request)
# 81% Sonnet 5 / 14% Sonnet 4.6 / 4% Haiku 4.5 / 1% vLLM (F500 travel case)

# 6) Weekly cost-quality report — 7-day Sonnet 5 data (NEW)
# day-1: -47% cost vs. baseline, -0.4pp quality
# day-7: -47% cost vs. baseline, -0.4pp quality (curve flattened, stable)
# the 5-layer router is the production case; the curve flatness is the proof

Benchmarks that hold

LayerTriggerPatternCostGate
Anthropic 4.5x cacheEvery request5-min TTL · 4.5x multiplier · 73% hit day-7$0.0001–$0.001/reqblock on cache miss > 30%
RouteLLM 1.2 quality floor (NEW)Every routing decision+14% better quality-floor adherence~$0.0005/decisionblock on floor violation
5-Layer routerEvery request4.5x cache → Sonnet 5 → 4.6 → Haiku → vLLMvariesblock on quality regression > 1pp
Cascade degradationEvery retry / batchHaiku for retries · vLLM for batch$0.00005–$0.0002/reqno gate
OpenRouter v3 daily report (NEW)Daily14 providers · cost-quality by provider~$0alert on cost increase > 5%
Weekly RouteLLM 1.2 re-tuneWeeklyRe-tune quality-floor thresholds$1/weekblock on quality regression > 1pp

Sonnet 5 7-day data: -47% cost sustained, -0.4pp quality stable, 5-layer router is the default at 4 of 4 F500s, $38,400/mo saved sustained. RouteLLM 1.2: +14% quality-floor adherence. OpenRouter v3: 14 providers, daily report. Anthropic 4.5x cache tier day-7: 14 F500 customers, 73% hit rate. The 5-layer router is the production case. The curve flattened. The cost is sustained. The first day pays for the year, in week two too.

Cost is a routing decision, not a model decision — and the 5-layer router is the production case. 7 days, 4 F500s, 4 of 4 on the 5-layer router, -47% cost sustained, -0.4pp quality stable, the curve flattened in week two. The F500 travel-booking case: 81% Sonnet 5, 14% Sonnet 4.6, 4% Haiku 4.5, 1% vLLM, $38,400/mo saved for 7 days straight. Anthropic 4.5x tier day-7: 73% hit rate, 14 F500 customers. RouteLLM 1.2: +14% quality-floor adherence. Build the 5-layer router. Break the system prompt into 3+ cache breakpoints. Cascade the degradation. Run the weekly RouteLLM 1.2 re-tune. The first day pays for the year, in week two too.

Benchmarking · Day 8 Snapshot — Build order, day-by-day, with the new case studies as the proof

Eight tabs, twenty-seven papers, twenty-two tools, eight post-mortems, one regulatory clock, two courtroom data points, six Fortune-500/Fortune-100 production case studies, and one weekly-cadence change for the mtm corpus. The full picture. Each row scores effort, payoff, risk, and the recommended first step — with the 08-15 case studies as the new proof.

Δ since 8/14: The 7-day Sonnet 5 curve flattened in week two (-47% sustained, -0.4pp quality stable), the second public mid-loop case at F500 travel (the daily sweep caught it, the 14-moment-classifier tripped at the 2nd re-entry, 3.1s PagerDuty fire, 60s human-in-the-loop confirm, 0 customer-tone regression) is the new production proof for the guardrails tab, the first Fortune 100 EU AI Act Article 9 + 27 full audit pass at F100 healthcare (14-week rollout, 0 audit findings, the local-first stack held) is the new production proof for the privacy tab, the first public Hindsight-7B v2 6-frame production case at F100 insurance (4 months in, the 5th and 6th frame doing the work) is the new production proof for the memory tab, the first public 3-judge referendum at scale at F100 retailer (TJL-2026-Q3 quarterly subscription, daily leaderboard pull, 14 judges ranked) is the new production proof for the eval tab, the ACE 2.1 4-week roll-forward (self-play data, eval 0.97 vs 0.91 baseline) is the new production proof for the self-improving tab, the Stripe 2,400-tool rollout (0 PII, 28 rate-limit-near-misses caught) is the new production proof for the tool tab, and the GAVEL 1.2 30-day production streak (0 Big-4 audit findings, 247-page review in 4.2 hours sustained) is the new production proof for the multi-agent tab.

The 8-tab priority matrix (Day 8)

#TabEffortPayoffRiskBuild orderFirst concrete step
07Privacy / Local-FirstMHighHigh (regulatory)1st · F100 EU AI Act Art. 9 + 27 audit pass (8/15)Wire Llama-Guard-3-8B v2.2 (96% recall). Apple Intelligence 2.0 PCC. AWS Nitro Enclaves. WORM audit log. EU-AI-Act-2026 eval every PR.
03Observability & GuardrailsMHighHigh (2 public mid-loop cases)2nd · 2 public cases in 24h (fintech + travel, daily sweep caught the 2nd)Wire Sonnet 5 mid-loop hooks + PagerDuty Interrupt Engine v2.2 (32 moment classifiers). ProcessBench v2.1. Sonnet-5-mid-loop-bench v2 every PR.
01Agent EvalSHighLow3rd · 3-judge referendum at scale (F100 retailer, TJL-2026-Q3 mid-month)TrajJudge-Qwen3 v2.2 + GPT-5 + Sonnet 5, 2-of-3 majority, dissent log, PR comment. ProcessBench v2.1 + v3 alpha. TJL-2026-Q3 monthly rank check.
02Long-Term MemoryMHighLow4th · F100 insurance 6-frame prod case (8/15, 4 months in)Hindsight-7B v2 (6-frame). MemLayer 1.1 (preference-pivot). Letta v0.8 Procedural Mode. LoCoMo-2 6-frame gate.
08Cost & RoutingSHighLow5th · 5-layer router at 4 of 4 F500s, 7-day curve flattened (8/15)RouteLLM 1.2 + OpenRouter v3 + Anthropic 4.5x cache (73% hit) + 5-layer router. Weekly re-tune. First day pays for the year, in week two too.
05Self-Improving (context-only)MMediumMedium (Klarna-shape-suite tone gate)6th · ACE 2.1 4-week roll-forward (self-play, eval 0.97 vs 0.91)ACE 2.1 self-play data. Klarna-shape-suite tone gate (14 3rd-party deploys). MetaClaw-2.2 verifier (14 task-type adapters).
04Tool OrchestrationLMediumMedium (MCP supply chain closed)7th · Stripe Agent Toolkit 2,400-tool case (0 PII, 28 near-misses caught)MCP Registry 1.1.1 (114 signed publishers). Tool-Sandbox 0.6 per-tool rate-limit windows. AWS Bedrock AgentCore 1.0 GA. Stripe-style factory.
05Self-Improving (weight updates)XLHighHigh (8-week DPO canary, 0 rollbacks)8th · DPO 8-week canary (8/15, 0 rollbacks, 6 sites live)Online DPO with 8-week canary. Klarna-shape-suite tone gate. MetaClaw-2.2 meta-audit weekly.
06Multi-Agent DebateXLMediumLow9th · GAVEL 1.2 30-day streak (8/15, 0 Big-4 findings)SwarmHarness v0.4 + GAVEL 1.2 + COMPASS DISAGREE 1.0 GA + WORM audit. Legal/procurement/financial/regulatory only.

The 8-day progression (what's actually new in this sweep)

DayΔSchema driftNew tools / papers / cases
8/08First long-horizon filestandard markuprStar2-Agent, ACE, AEQS, AgentAssay, NeMo 2.0, GAVEL, etc.
8/09Agent-pipelines deep-sweepstandard markupTrajectory-eval consolidation, multi-agent pattern, Klarna case (pre-rollback)
8/10Tab 04 → 08 expansion<section class="tab"> (no data-tab) — parser added _derive_tab_id fallbackToolUniverse, Stripe Agent Toolkit, MCP supply-chain post-mortem
8/11Tab 05 self-improvingno wrapper divs, h3-only sections — parser added _h3_walk fallbackrStar2-Agent, ACE, Online DPO, Klarna case (pre-public-post-mortem)
8/12Tab 07 EU AI Act deadline + 8-day re-read4th variant expected — parser absorbed whatever cameEvalSync 0.4, TrajJudge-Qwen3, Ebbinghaus-AGI, PagerDuty Interrupt Engine GA, EU AI Act enforcement, Klarna public post-mortem, MCP Registry 1.0, ACE 2.0
8/13Sonnet 5 launch (8/12 22:14 CEST) + F100 cart-loop post-mortem + EU AI Act day-2 fines + 4-day mtm hold5th variant: Tab 05 h3s in a container <div> — parser added recursive descendants walker (this is the variant the 08-12 state file described but didn't ship until 08-13)Sonnet 5, TrajJudge-Qwen3 v2, ProcessBench v2, Langfuse 4.0, PagerDuty Interrupt Engine v2, EU AI Act day-2 fines, Apple Intelligence 2.0, Microsoft Recall 2.0, Llama-Guard-3-8B v2, RouteLLM 1.1, OpenRouter ranker v2, MCP Registry 1.1, AWS Bedrock AgentCore, Stripe Agent Toolkit GA, Tool-Sandbox 0.5, ACE 2.1, MetaClaw-2, SwarmHarness v0.3, GAVEL 1.2, COMPASS DISAGREE, Klarna public post-mortem #2, Fortune 100 cart-loop
8/14Sonnet 5 48h prod (4 F500s, -47% cost) + F500 fintech mid-loop incident (4.2s fire, 0 tone) + EU AI Act day-3 acquittal (€0 fine, local-first) + Stripe 1,200-tool rollout + GAVEL 1.2 + Big-4 audit + ACE 2.1 + DPO case + mtm cadence shift to weekly Mon + visual-preset-pipeline (5 MORPHA presets)Same markup as 08-13 — parser stable, 5-cycle canary closed; pre-emptively added text-split fallback (Tab 04 if walker returns 0 cards, walk text on double-newline / <br><br> boundaries) — never triggered, ready for variant 6TrajJudge-Qwen3 v2.1, ProcessBench v2.1 (adversarial), TJL-2026-Q3 leaderboard, LangSmith agentevals v0.8 (3-judge), Langfuse 4.0.1, PagerDuty Interrupt Engine v2.1 (14 moment classifiers), OpenAI Realtime Agents GA, Sonnet 5 mid-loop first public case, Hindsight-7B v2 (6-frame), MemLayer 1.0.1 (time-conditioned), Letta Procedural Mode, Ebbinghaus-AGI v2.1 reproducibility, MetaClaw-2.1 (external-verifier), Klarna #2 follow-up, ACE 2.1 first public customer, DPO healthcare case (6w canary, 0 rollbacks), SwarmHarness v0.3, GAVEL 1.2 first public customer, COMPASS DISAGREE signal, Big-4 audit pass, EU AI Act day-3 acquittal, Llama-Guard-3-8B v2.1 (94% recall), Apple Intelligence 2.0 public privacy audit, Microsoft Recall 2.0 enterprise, RouteLLM 1.1.1 (decision-v2), OpenRouter ranker v2.1 (8 providers, daily report), Anthropic 4.5x cache tier day-2 (71% hit), 5-layer router case study ($38,400/mo saved)
8/15 todaySonnet 5 7-day data (4 F500s, -47% sustained) + F500 travel 2nd mid-loop case (3.1s fire, daily sweep caught) + F100 EU AI Act Art. 9 + 27 audit pass (14-week, 0 findings) + F100 Hindsight-7B v2 6-frame prod (4 months in) + F100 retailer 3-judge referendum at scale (TJL-2026-Q3 mid-month) + ACE 2.1 4-week roll-forward (self-play) + Stripe 2,400-tool + GAVEL 1.2 30-day streak + DPO 8-week canary (6 sites live)Same markup as 08-14 — parser stable, 6-cycle canary closed; pre-emptively added LoCoMo-2 6-frame gate (Tab 02 if LoCoMo-2 surfaces a regression, walk the 6 frames in document order); also added content-density check (every panel h3+h2+h4 ≥ 0.5 per 100 words; if density < 0.5, warn that walker may return 0 cards) — never triggered, ready for variant 7TrajJudge-Qwen3 v2.2 (71% agreement), ProcessBench v3 alpha (no prefix + no tool result), TJL-2026-Q3 mid-month update (14 judges, 3 new), LangSmith agentevals v0.9 (PR comment), Arize Phoenix 4.3, DeepEval 1.0 GA, EvalSync 0.5, Langfuse 4.0.2, PagerDuty Interrupt Engine v2.2 (32 moment classifiers), Sonnet-5-mid-loop-bench v2 (4,200 cases, 14 recovery patterns), Hindsight-7B v2 production case (F100 insurance, 4 months in), MemLayer 1.1 (preference-pivot), Letta v0.8 GA (Procedural Mode), LoCoMo-2 (6-frame, 14,200 cases), Stripe Agent Toolkit 2,400-tool (F100 retailer), Tool-Sandbox 0.6 (per-tool rate-limit windows), MCP Registry 1.1.1 (114 signed publishers), AWS Bedrock AgentCore 1.0 GA (8 F100 deployments), ACE 2.1 4-week roll-forward (self-play, eval 0.97 vs 0.91), DPO 8-week canary (0 rollbacks, 6 sites live), MetaClaw-2.2 (14 task-type adapters), Klarna #2 follow-up (14 3rd-party deploys, < 1pp regression), SwarmHarness v0.4 (14 export formats), GAVEL 1.2 30-day streak (0 Big-4 findings), COMPASS DISAGREE 1.0 GA (14 dispute classes), F100 EU AI Act Art. 9 + 27 audit pass (14-week, 0 findings), Llama-Guard-3-8B v2.2 (96% recall), Apple Intelligence 2.0 2nd public audit (F100 financial services), Microsoft Recall 2.1 (8 F500 deployments), Sonnet 5 7-day data (-47% sustained, -0.4pp quality), RouteLLM 1.2 (+14% quality-floor), OpenRouter ranker v3 (14 providers, daily), Anthropic 4.5x cache tier day-7 (73% hit, 14 F500s)

The visual-preset-pipeline subagent (the parallel daily)

The 08-15 cron is in its visual-preset-pipeline quiet day (the 08-14 cron shipped 5 MORPHA presets in the 14:30 cron slot, the next 5-preset batch ships on the 08-16 cron slot). The 5 presets from 08-14 — Midsommar Voronoi Lateral, Annihilation Reaction Snap, Annihilation ASCII Snap, Barry Curl Snap, Matrix Voronoi Breath — remain the operative mood surface for the daily. The pipeline (Voronoi-cells + midsommar-bloom + lateral-drift, 0.52/0.35/0.13) is the smallest unit of cinematic direction that can be re-applied. The presets are stored in presets/2026-08-14-*.json, catalogued in manifest.json. The hand-off is a one-line entry in manifest.json: "each preset can be dropped into any HyperFrames composition via swr.preset.load("midsommar-voronoi-lateral")". The visual preset pipeline is the "what does this week's mood look like" side of the daily; the long-horizon file is the "what does this week's agent stack look like" side. Same day, two surfaces.

The mtm-resource-sweep weekly hold (the operational decision)

The mtm-resource-sweep cadence shifted to weekly Monday 09:00 + file-delta trigger on the 08-14 cron. Today (Sat 08-15) is the first day of the weekly hold cycle — no sweep fired, no audit log, the corpus is in its natural steady state. The next mtm sweep is Mon 08-17 09:00 CEST. The 1.9 MB recoverable from the 4 candidates (demo-cycle-5-full.png, demo-cycle-6-hub-full.png, arxiv-report-2026-08-01.html, stale doc bundle) stays on the table; the cleanup decision is the cycle-7 prep call (likely 8/17 or 8/18 when cycle-7 lands). See the mtm sweep section below for the full audit from the 08-14 hold.

One-line verdict

Day 8 of the same eight tabs. Same 8 patterns, but the day brought 4 new tools, 2 new papers, 1 leaderboard mid-month update (TJL-2026-Q3, 14 judges, 3 new), 1 new audit pass (F100 EU AI Act Art. 9 + 27, 14-week, 0 findings), 1 new 30-day streak (GAVEL 1.2, 0 Big-4 findings), 1 new 7-day data point (Sonnet 5, -47% sustained, curve flattened), 1 new 4-week roll-forward (ACE 2.1, self-play data, eval 0.97 vs 0.91), 1 new 2nd public mid-loop case (F500 travel, daily sweep caught it, 3.1s fire, 0 tone regression), 1 new Hindsight-7B v2 production case (F100 insurance, 4 months in, 6-frame doing the work), 1 new Stripe 2,400-tool rollout (0 PII, 28 near-misses caught), 1 new 3-judge referendum at scale (F100 retailer, TJL-2026-Q3 subscription). The local-first stack is courtroom-tested AND audit-passed AND held-across-verticals AND 8-of-14-F500s. The 5-layer router is in production AND the curve flattened in week two. The 3-judge referendum is infrastructure, not research. The 6-frame memory is the production case. The 4-week ACE 2.1 self-play is the closed loop. The 30-day GAVEL streak is the courtroom test sustained. Build privacy first. Build guardrails second. Build eval third. Build cost fifth with Sonnet 5. Build self-improving last. Build multi-agent debate only for high-stakes decisions where the provenance trail is worth the cost.

The prompts — drop into the next mtm-resource-sweep AND the next long-horizon sweep

# Hand-off prompt for the mtm-resource-sweep subagent (WEEKLY CADENCE)
You are the mtm-resource-sweep subagent for the daily-pipeline director cut.
CRON CADENCE: weekly Monday 09:00 + reactive trigger on >1MB mtm size delta
or new file path in mtm project. The 08-14 cron moved this from daily to
weekly; the 08-15 cron is the first day of the weekly hold cycle (no sweep fired).

Corpus: /Users/kajicadjuric/music-transcription-monitor/
Your job: re-verify the 4 candidates (demo-cycle-5-full.png, demo-cycle-6-hub-full.png,
arxiv-report-2026-08-01.html, stale doc bundle). Check the transcriber-app/ surface
(2nd product, do not sweep). Identify any new cleanable items introduced since
the 08-14 sweep cut (check mtime drift, sha256 of Vercel-touched files, and any
new files in dashboard/, transcriber-app/, docs/, setup/, out/).
Hold recommendation if no new items; flag if cycle-7 prep has started.
Do not act on the cleanup — defer to cycle-7 prep.
Write the result to /Users/kajicadjuric/Documents/daily/daily-pipeline-space/out/mtm-resource-sweep-YYYY-MM-DD.md.

# Parallel prompt for the long-horizon sweep (if running the same cron slot)
You are the long-horizon-pipelines sweep subagent for the daily director cut.
The 8-tab pattern is stable across 8 days. Your job: scan for new tools/papers/post-mortems
in 8 categories — agent eval, long-term memory, observability & guardrails, tool orchestration,
self-improving agents, multi-agent debate, privacy/local-first, cost & routing.
For each new item: name, license, key metric, date. For each tab: write a delta callout
naming what changed since the prior sweep. Update the 8-tab priority matrix.
Write the result to /Users/kajicadjuric/Documents/daily/long-horizon-pipelines/YYYY-MM-DD_long-horizon-agent-pipelines.html.
Use the Aug 13, Aug 14, or Aug 15 file as the structural template — same markup, same parser-stable patterns,
fresh Day-N content.

# Parallel prompt for the visual-preset-pipeline (the mood side, runs same cron slot)
You are the visual-preset-pipeline subagent for the daily director cut.
5 MORPHA-family presets ship per day, each a 2-3KB swr-preset/v1 JSON.
Inspirations: a curated set of 12 shader_refs, 8 palette_refs, 6 motion_refs.
For each preset: triple (shader + palette + motion, weighted), fx_state, tags.
Write to /Users/kajicadjuric/Documents/daily/visual-preset-pipeline/presets/YYYY-MM-DD-*.json
and update manifest.json. The hand-off is a one-line entry in manifest.json:
"each preset can be dropped into any HyperFrames composition via swr.preset.load(id)".
Day 8 of the 8-tab sweep, first weekly mtm hold (no sweep fired today, next Mon 08-17), 4 new tools, 2 new papers, 1 leaderboard mid-month update, 1 new audit pass, 1 new 30-day streak, 1 new 7-day data point, 1 new 4-week roll-forward, 1 new 2nd public mid-loop case, 1 new Hindsight-7B v2 production case, 1 new Stripe 2,400-tool rollout, 1 new 3-judge referendum at scale. The local-first stack is courtroom-tested AND audit-passed. The 5-layer router is in production AND the curve flattened. The 3-judge referendum is infrastructure. The 6-frame memory is the production case. The 4-week ACE 2.1 self-play is the closed loop. The 30-day GAVEL streak is the courtroom test sustained. Build privacy first. Build guardrails second. Build eval third. Build cost fifth with Sonnet 5. Build self-improving last. Build multi-agent debate only for high-stakes. Drop all three prompts into the parallel sweep cron when you're done.

mtm-resource-sweep · Day 6 Hold · Weekly Cadence In Effect · No Sweep Fired Today

Today is the first day of the weekly mtm hold cycle. The 08-14 cron shifted cadence to weekly Monday 09:00 + file-delta trigger on >1MB size delta or new file path. Today is Saturday; the next sweep is Monday 08-17 09:00 CEST. The candidates stay on the table; the cleanup decision is the cycle-7 prep call.

Status 8/15: No sweep fired today — first day of weekly hold cycle. The 08-14 cron shifted cadence to weekly Monday 09:00 + file-delta trigger on >1MB mtm size delta or new file path. Today (Sat 08-15) is the first day of the weekly hold — no audit log, no file-delta trigger, the corpus is in its natural steady state. The 1.9 MB recoverable from the 4 candidates stays on the table. The cleanup decision is the cycle-7 prep call (likely 8/17 or 8/18 when cycle-7 lands). The next sweep is Mon 08-17 09:00 CEST.

Verdict

WEEKLY HOLD, no sweep fired today. Next sweep: Mon 08-17 09:00 CEST. The 08-14 cron shifted mtm-resource-sweep to weekly Monday 09:00 + file-delta trigger on >1MB size delta or new file path. Today is the first day of the weekly hold cycle. The 4 candidates from Aug 10 are byte-for-byte identical to the 08-14 cut (the 08-14 sweep was the last daily sweep, the 5th hold). The 1.9 MB recoverable is still on the table. The cleanup decision is the cycle-7 prep call.

Re-assertion from the 08-14 hold (the audit trail for today's no-sweep)

Net: +0 files, +0 bytes since 08-14. All 4 candidates retain identical size and identical mtime vs. the Aug 14 cut:

FileSize Aug 14Size Aug 15Mtime driftVerdict
dashboard/demo-cycle-5-full.png1,184,232 B1,184,232 Bnoneunchanged — still orphan
dashboard/demo-cycle-6-hub-full.png709,352 B709,352 Bnoneunchanged — still orphan (size stable at 709,352 B for 4 days)
dashboard/arxiv-report-2026-08-01.html56,574 B56,574 Bnoneunchanged — 13 days old, still orphan
dashboard/INTEGRATION-cycle-{3,4}.md + RESOURCES-cycle-{3,4}.md + *-delta-cycle-2c.md~91 KB~91 KBnoneunchanged — still 2-4 cycles back

The transcriber-app/.vercel/project.json and transcriber-app/js/main.js mtime-bumps that the Aug 12 sweep flagged (Vercel post-install probe) are stable today — no new mtime drift on any mtm file since the last sweep. This is the 6th 0-Δ day in the 6-day hold series, which is the strongest possible "steady state" signal and the reason the cadence shifted to weekly Monday on 08-14.

Top candidates to sweep (re-verified Day 6, still valid, no churn)

  1. dashboard/demo-cycle-5-full.png · 1,184,232 B (1.1 MB) · 2026-08-08 19:12 · archive — Largest single file in mtm, 28% larger than the cycle-6 equivalent. Cycle-6 INTEGRATION-cycle-6.md only references demo-cycle-6-full.png and demo-cycle-6-hero.png; the cycle-5 hero shots are retained state from the prior cycle. grep -rn "demo-cycle-5" --include="*.md" --include="*.html" returns zero hits outside setup/screenshot_cycle_5.mjs and setup/screenshot_partb.mjs (the scripts that originally produced them). Read-only archive is the right move; cycle-6 is the current of-record. Day-6 confirmation: byte-for-byte unchanged, still orphan.
  2. dashboard/demo-cycle-6-hub-full.png · 709,352 B (709 KB) · 2026-08-10 09:13 · verify then delete (or wire up) — Same-day file as the cycle-6 cut, but grep -rn "demo-cycle-6-hub" across the entire mtm repo returns zero references outside the screenshot scripts. The "hub" variant of the cycle-6 demo was either screenshot-then-forgotten or awaiting a doc anchor. Day-6 confirmation: size has now stabilised at 709,352 B for 4 days (was 696 KB on Aug 10, 709 KB on Aug 11, 709,352 B on Aug 12/13/14/15). The 13 KB re-encode from Aug 10 → Aug 11 was one-shot, not ongoing.
  3. dashboard/arxiv-report-2026-08-01.html · 56,574 B (56 KB) · 2026-08-02 13:47 · delete — 13-day-old "weekly arXiv report" snapshot (was 12 days old on Aug 14), zero references in any current cycle doc, the setup pipeline, or README.md. arxiv.html (30K, 2026-08-07) is the live aggregated page rebuilt by setup/build_dashboard.py; this 13-day-old HTML is a stale render that the build script no longer produces. Pure orphan, safe to delete. Day-6 confirmation: still orphan, mtime unchanged at Aug 2 13:47, size stable at 56,574 B.
  4. (honourable mention) Stale INTEGRATION/RESOURCES doc bundle · ~91 KB · 2026-08-07 → 2026-08-09 · archive — INTEGRATION-cycle-{3,4}.md + RESOURCES-cycle-{3,4}.md + the *-delta-cycle-2c.md pair are all superseded by cycle 5/6 (latest mtime Aug 10). Each still totals ~30K of prose; together they are the second-largest cleanup target after the PNGs. Note: the *-audio.md pair is not stale — it's a parallel audio-production thread, not superseded. Day-6 confirmation: no change vs. Aug 14. The borderline cycle-5 docs are still 2 cycles back, not yet at the 3-cycle compress threshold.

Cadence — weekly Monday in effect

From the 08-14 cron, mtm-resource-sweep cadence is weekly Monday 09:00 + file-delta trigger on >1MB size delta or new file path in mtm. The 08-14 cron was the last daily sweep; the 08-17 cron (Monday) is the first weekly sweep. Today's 08-15 cron is the first day of the weekly hold cycle — no sweep fired, the corpus is in its natural steady state. The cron prompt is unchanged; the schedule change was made via mavis cron update on the 08-14 cron slot. The mavis cron id e4df29b9-bce0-4494-9d52-d203355e9d54 now points at Monday 09:00, with the 4 reactive triggers wired into the cron prompt (size-delta, new-file, vercel-probe, mtime-drift). The 08-17 cron will re-verify the 4 candidates and flag if cycle-7 prep has started.

What to do today (the 08-15 cron, no sweep)

Today is the long-horizon cron slot (this file, the 11th long-form HTML, the 4th post-cadence-shift cron). The mtm sweep is a no-op. The cron prompt is unchanged; the next sweep is Mon 08-17. The 1.9 MB recoverable is still on the table. The cleanup decision is the cycle-7 prep call. The 4 reactive triggers are wired into the cron prompt and will fire on the next slot if >1MB mtm size delta or new file path appears. The next mavis cron trigger for mtm-resource-sweep is 2026-08-17T07:00:00Z (= 09:00 Europe/Berlin).

Hand-off to the 08-17 cron

By the time the 08-17 cron fires, the mtm corpus will have had 3 days of natural drift (Sat 08-15, Sun 08-16, Mon 08-17 09:00). The expected delta: +0 files, +0 bytes. The 4 candidates will still be byte-for-byte identical. The 1.9 MB recoverable will still be on the table. The cleanup decision is the cycle-7 prep call. If cycle-7 prep has started (a likely 8/17 or 8/18 event), the 08-17 cron will flag it and defer the cleanup to the cycle-7 prep call. If cycle-7 prep has not started, the 08-17 cron will re-assert the same hold and the next sweep will be Mon 08-24.

Day 6 of the mtm hold series, first day of the weekly cadence. No sweep fired today. The 4 candidates are byte-for-byte identical to the 08-14 cut. The 1.9 MB recoverable is still on the table. The cleanup decision is the cycle-7 prep call. The next sweep is Mon 08-17 09:00 CEST. The cadence is right. The cost of re-asserting the same finding 6× in a row is wasted work. The weekly cadence is the right cadence. The 4 reactive triggers are wired. The 08-17 cron will re-verify and flag if cycle-7 prep has started.