CTIPilot
AI-generated · no human review · verify critical claims against the linked source. how it works →

2026-10-18T1307Z-audit

One pipeline fire, in full · audit run of 2026-10-18 · sub-agent allocation and telemetry, per-iteration verification verdicts and findings, source-list edits, coverage gaps, bridge invocations, and the run's own verification & coverage notes: what was published, what was dropped at the borderline or judged not relevant (and why), single-source carve-outs, and contradictions. Rendered from runs/2026-10-18/2026-10-18T1307Z-audit.md.

Run telemetry

2026-10-18T1307Z-audit audit prompt v4.21 publish ok
32h 34m duration 1 published 15 updates
Claude Opus 5.5 (claude-opus-5-5) main agent
resweep-G1 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
22
Duration
1889m 00s
Tool calls
6 WebFetch39 WebSearch305 bridge
Cited sources
0 of 40 in slice
resweep-G2 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
17
Duration
39m 52s
Tool calls
1 WebFetch36 WebSearch215 bridge
Cited sources
0 of 33 in slice
resweep-G3a Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
21
Duration
26m 04s
Tool calls
0 WebFetch4 WebSearch135 bridge
Cited sources
0 of 29 in slice
resweep-G3b Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
30
Duration
40m 53s
Tool calls
5 WebFetch11 WebSearch190 bridge
Cited sources
0 of 30 in slice
truth-D1 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
35m 58s
Tool calls
not reported
Cited sources
none
truth-D2 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
34m 18s
Tool calls
not reported
Cited sources
none
truth-D3 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
44m 03s
Tool calls
not reported
Cited sources
none
truth-L stalled

Claude Sonnet 5.5

Past the 30-min wall-clock cap; abandoned.

truth-T1 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
30m 26s
Tool calls
not reported
Cited sources
none
truth-T2 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
26m 59s
Tool calls
not reported
Cited sources
none
truth-T3 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
30m 28s
Tool calls
not reported
Cited sources
none
truth-T4 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
23m 06s
Tool calls
not reported
Cited sources
none
truth-T5 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
28m 21s
Tool calls
not reported
Cited sources
none
truth-T6a Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
22m 13s
Tool calls
not reported
Cited sources
none
truth-T6b Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
28m 23s
Tool calls
not reported
Cited sources
none
truth-T7 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
23m 19s
Tool calls
not reported
Cited sources
none
truth-T8a Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
25m 58s
Tool calls
not reported
Cited sources
none
truth-T8b Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
25m 16s
Tool calls
not reported
Cited sources
none
truth-T9 Claude Sonnet 5.5 (claude-sonnet-5-5)
Items returned
0
Duration
31m 54s
Tool calls
not reported
Cited sources
none

Verification

#? NEEDS_FIXES · Sonnet 5.5 · t=4 e=0 a=8

Deep dive

·

Entries this run published (1) and updated (15)

Sources changed (this run)

Edits this run made to sources/sources.json · promotions, demotions, new candidates, and fetch-method / category / reliability / url corrections (the run record's sources_changed[]). Paginated; 10 per page.

No source-list edits recorded for this run.

Coverage gaps (this run)

Sources this run's brief needed that returned no usable content via any documented recipe. Bridge-recovered or quiet-day sources do NOT appear here. (Distinct from the independent source-accessibility probe at the foot of this section, which probes all active sources regardless of what any run needed.)

No coverage gaps in this run · every source the brief needed returned usable content via its documented recipe.

Verification findings · all iterations

Per-iteration finding detail. Each table is one verifier pass · what was flagged, how the main agent remediated it, and the outcome. Walking the tables top-to-bottom shows the verifier's debugging trail across iterations.

Iteration #? NEEDS_FIXES cap-breach · 12 findings (truth=4, editorial=0, advisory=8) · Claude Sonnet 5.5 · 18m 06s

F-codeSectionItem · URL/quoteVerifier summaryRemediation · outcome
F4
hallucinated-fact
·
The correction said the crash-log script does not run periodically; watchTowr says it can take up to 24 hours to run.Applied: the negation is gone from the section and this fire's record; the section names the two Pitboss strings and watchTowr's up-to-24-hours wait.
F4
hallucinated-fact
·
The report and entities_added named one registry record; the fire added three (sync_products created product:google-calendar and product:microsoft-exchange-online), and the new entry linked neither.Applied: report and entities_added list all three, and the new entry's entities[] links both product keys.
F3
claim-not-supported
·
'Claroty documents seventeen of them' sat under a CISA citation.Applied: Claroty is cited after that clause.
F3
claim-not-supported
·
The 4.0.2 clause cited a 2026-10-08 label for a changelog block dated 13 October.Applied: the changelog's sources[] date and every inline label now read 2026-10-13, the date of the revision cited; this fire's record names sources.
F11
editorial-advisory
·
(advisory) entities[] omitted the two product keys registered for its affected_products.Applied with the second F4.
F11
editorial-advisory
·
(advisory) The correction narrated fetch behaviour.Applied: the sentence now says only that the quote cites BleepingComputer.
F11
editorial-advisory
·
(advisory) Em dashes and a self-reference in rewritten text; the record named sector, sourcing and type changes the section did not.Applied: em dashes removed from the rewritten text and the three new affected strings, the self-reference reworded, and the section now states the sector change and the two-source basis.
F11
editorial-advisory
·
(advisory, pre-existing) CISA maps CVE-2026-21718 to CWE-327, which the sourcing note could record without asserting the binding.Applied: the sourcing note records it as fitting the mechanism without binding the id.
F11
editorial-advisory
·
(advisory) The record named the Derby name removal; the section did not.Applied: the section states it.
F11
editorial-advisory
·
(advisory) The replacement evidence quote duplicated an existing one; (pre-existing) the 2026-10-16 section cites the release post for banner text it no longer carries.Duplicate removed and the record reworded. The pre-existing citation is carried forward to the next audit's truth pass.
F11
editorial-advisory
·
(advisory, pre-existing) The summary, Exposure line and sourcing note frame 25.1.3.0 as Rapid7 against CERT-FR without Ivanti's own CVE record.Carried forward to the next audit's truth pass.
F11
editorial-advisory
·
(advisory) The notes said four reader-facing corrections and named five.Applied.

Verification & coverage notes

The run record's narrative body, verbatim. This is where the run accounts for its own judgement calls: every borderline drop and judged-not-relevant item with its reason, dedup decisions, single-source items and their carve-outs, contradictions, and per-source coverage gaps, so nothing the run considered disappears silently.

Verification & coverage notesrun record body

2026-10-18T1307Z-audit · audit · Opus 5.5 · window 168 h · 1 entry published

Verification & coverage notes

Scheduled quality audit over the trailing week, 2026-10-11T13:07Z to 2026-10-18T13:07Z, anchored on the 2026-10-11 audit. The fire started under v4.19 with a window back to 2026-09-30 and the legacy queue, stopped on the API rate limit, and on resumption was re-based on main under v4.21 (base 74695f56, claim pushed first) and cut to the week, as the operator directed. Report: docs/audits/2026-10-18-quality-audit.md.

Soundness. The week's 30 entries (21 filed by the fires, 9 older entries they updated) were truth-passed in T1, T2, T3, T6b and T9, minus NeedyMantis, which the 2026-10-11 audit's loop verified. 16 of 29 clean, 9 with imprecisions only, 4 with factual errors (Bricksforge's fixed versions, PaperCut's Release 3 regressions, SonicWall's Previdian count, MikroTik's 7.23.8 changelog line); a cited-page check added the Exchange entry's stale banner quotes. Every defect is fixed through a changelog record: one update (Bricksforge), five reader-facing corrections (Copeland, PaperCut, Citrix, SonicWall, MikroTik), one reader-facing improvement (Rank Math's CVE-2026-111862), and internal records for metadata (Ivanti, BeyondTrust, PeerStitch, AhsayCBS, Publica, Danfoss, Exchange, Drupal's priority). 115 entries whose only in-week activity is the 2026-10-11 audit's own records are out of scope.

Coverage. Four re-sweeps (G1 to G3b) listed every in-week item; each carries a covered entry or a borderline-drop line in a week's run record, except Netcraft's calendar-invite phishing post of 2026-10-16, recovered as entries/2026-10-19/ics-calendar-invite-phishing-auto-added-outlook-gmail.md with tool:eviltokens registered and two product records for its affected products. All nine KEV additions of the week are covered.

Calibration. high passed 8 of 21 new entries (38%). Drupal SA-CORE-2026-014 fails the high bar and moves to notable; the rest hold, GitLab CVE-2026-97229 as a borderline. The monthly calibration section is in the 2026-10-11 report.

Warnings. One acknowledgment added: the 2026-10-11 audit's 198.2 h duration spans its eight-day pause on an API session limit. This record's own duration_seconds spans this fire's pause on the rate limit (2026-10-18T14:12Z to 2026-10-19T16:15Z) and is left visible for the next audit.

Budget (v4.21). 22 spawns before v4.21 landed (19 first spawns and three continuations after the rate limit, about 11.5 M sub-agent tokens; work/2026-10-18T1307Z-audit/budget.tsv), two above the new bound. The closing loop therefore ran the hard-invariant minimum, one verifier pass (the 23rd spawn, about 0.5 M tokens), recorded in verification.budget_cut. Seven of the 22 (D1 to D3, L and its continuation, T4, T5) were secondary work v4.21 reserves for operator-directed partial audits; their 188 out-of-week verdicts (77 factual errors) are carried forward unapplied.

Model baseline (Sonnet 5 → 5.5): verifier iterations 7.3 → 5.2, confirmed CLEAN 3/9 → 6/18, iteration-1 truth findings per entry 0.77 → 1.53, research median 9 → 22 min with 2.4 → 6.1 items. Recommendation: keep xhigh on research and verifier, try high on the main agent.

Verification: one cold pass of cti-verification walked all 89 claims of its scope (the new entry whole, this fire's changed claims on the 15 updated entries, the run record and the report) and returned NEEDS_FIXES with four truth findings: an unsupported "does not run periodically" in the Citrix correction, an undercounted registry change (three records, not one), a Copeland clause cited to CISA that only Claroty states, and a Bricksforge citation date. All four and seven of the eight advisory findings were fixed after the pass; two pre-existing advisories (Exchange's 2026-10-16 citation, Ivanti's contradiction wording) are carried forward. The spent budget ended the loop there (verification.budget_cut), so the fixes are not re-verified and the residual is 4.

← Operations dashboard · day page 2026-10-18 · run-record contract: docs/pipeline.md