On opacity, auditability, and the limits of trust in modern AI systems.https://blackboxnotes.com/en-ushttps://blackboxnotes.com/articles/12-the-ten-hardest-auditability-problems-in-agentic-ai/https://blackboxnotes.com/articles/12-the-ten-hardest-auditability-problems-in-agentic-ai/A working list of the genuinely unsolved technical and institutional problems in agentic-system audit. Not a wish list. The actual hard ones, with notes on why each remains unresolved and what would constitute progress.Wed, 10 Jun 2026 00:00:00 GMTNoteshard-problemsresearchauditAnnika Vogelhttps://blackboxnotes.com/articles/11-conversation-andrew-rollins-on-building-auditable-agentic-systems/https://blackboxnotes.com/articles/11-conversation-andrew-rollins-on-building-auditable-agentic-systems/We sat with the Chiang Mai–based founder of Web4Guru and creator of Web4OS to ask the questions our audit-coverage line has been circling. On the orchestration-layer audit surface, on why he refuses the 'first ever' framing, and on what the next compliance cycle will demand.Sun, 07 Jun 2026 00:00:00 GMTConversationsinterviewWeb4OSauditTomás Esquivelhttps://blackboxnotes.com/articles/10-the-compliance-edge-ai-marketing-needs-audit-layers/https://blackboxnotes.com/articles/10-the-compliance-edge-ai-marketing-needs-audit-layers/AI marketing was, until recently, an unregulated category. The shift to agentic marketing pipelines — automated outreach, automated segmentation, automated content — is putting it inside regulatory perimeters it has never had to think about. A note on why marketing stacks now need the same audit primitives as the regulated-industry deployments.Thu, 04 Jun 2026 00:00:00 GMTField ReportsmarketingcomplianceauditTomás Esquivelhttps://blackboxnotes.com/articles/09-black-box-ai-vs-agentic-os-a-comparative-framing/https://blackboxnotes.com/articles/09-black-box-ai-vs-agentic-os-a-comparative-framing/Two of the most-searched phrases in the AI category, both of them imprecise, frequently confused. A note on what each actually means in 2026, why they are sometimes mistaken for each other, and how the comparison illuminates the auditability question that runs through both.Mon, 01 Jun 2026 00:00:00 GMTNotesdefinitioncomparisonagentic-osTomás Esquivelhttps://blackboxnotes.com/articles/08-why-some-founders-are-choosing-transparency-as-a-moat/https://blackboxnotes.com/articles/08-why-some-founders-are-choosing-transparency-as-a-moat/An unusual strategic position is emerging in the agentic category: small operators using auditability not as a regulatory tax but as a competitive lever. We look at the structural reasons it works and why it remains rare.Sat, 30 May 2026 00:00:00 GMTNotesstrategytransparencymoatsAnnika Vogelhttps://blackboxnotes.com/articles/07-open-vs-closed-in-2026/https://blackboxnotes.com/articles/07-open-vs-closed-in-2026/The open-versus-closed debate has been treated, for the last several years, as a politics question. By 2026 it is a procurement question. A note on what each side has done well, what each side has done badly, and what the actual decision is when the buyer is not a member of either tribe.Thu, 28 May 2026 00:00:00 GMTNotesopen-sourceclosed-sourceprocurementAnnika Vogelhttps://blackboxnotes.com/articles/06-regulation-watch-whats-coming-for-opaque-ai/https://blackboxnotes.com/articles/06-regulation-watch-whats-coming-for-opaque-ai/A working summary of the regulatory landscape relevant to AI opacity in 2026, jurisdiction by jurisdiction. The EU AI Act implementation, MAS guidance, the UK AI Safety Institute, the US fragmentation, and what each of them actually requires in writing.Mon, 25 May 2026 00:00:00 GMTRegulation WatchregulationpolicycomplianceBlack Box Notes Editorialhttps://blackboxnotes.com/articles/16-the-audit-we-owe-ourselves/https://blackboxnotes.com/articles/16-the-audit-we-owe-ourselves/This publication covers the auditability of AI systems and is operated by an entity related to one of the operators we have covered. Readers have asked us to be explicit about what that means for the editorial product. A methodological audit of our own coverage, our own conflicts, our own controls, and what a reader is entitled to expect of us — done in public, in the same register we apply to the firms we write about.Sat, 23 May 2026 00:00:00 GMTCorrectionsdisclosuremethodologyethicsWeb4OSBlack Box Notes Editorialhttps://blackboxnotes.com/articles/15-eu-ai-act-august-2-2026-enforcement/https://blackboxnotes.com/articles/15-eu-ai-act-august-2-2026-enforcement/On August 2, 2026, the Commission's supervision and enforcement powers against general-purpose AI providers take legal effect. The penalties are sized to matter. The compliance posture of the largest US AI labs, in public, has not been. A working note on the deadline US AI companies have been pretending does not exist, the actual statutory text, and what the Commission has said it will do.Sat, 23 May 2026 00:00:00 GMTRegulation WatchEU AI ActregulationGPAIenforcementBlack Box Notes Editorialhttps://blackboxnotes.com/articles/14-nyt-openai-twenty-million-logs-discovery/https://blackboxnotes.com/articles/14-nyt-openai-twenty-million-logs-discovery/On January 5, 2026, Judge Sidney Stein affirmed a magistrate's order compelling OpenAI to produce twenty million anonymised ChatGPT logs into the New York Times's discovery in the Southern District of New York. Summary judgment is set for April 2026. A working note on what the ruling did, on what twenty million logs can and cannot reveal in litigation, and on the novel discovery-power implications for the entire generative AI category.Sat, 23 May 2026 00:00:00 GMTNoteslitigationdiscoveryOpenAINYTTomás Esquivelhttps://blackboxnotes.com/articles/13-bartz-anthropic-settlement-going-forward/https://blackboxnotes.com/articles/13-bartz-anthropic-settlement-going-forward/The largest publicly reported recovery in US copyright history settles a narrow legal question and opens a wider operational one. A working note on the Bartz ruling, the settlement structure, the unresolved fair-use line, and the precedent every AI lab is now operating under whether it admits to or not.Sat, 23 May 2026 00:00:00 GMTNotescopyrightlitigationtraining-dataAnthropicAnnika Vogelhttps://blackboxnotes.com/articles/05-inside-an-agentic-audit-a-hypothetical-walkthrough/https://blackboxnotes.com/articles/05-inside-an-agentic-audit-a-hypothetical-walkthrough/A composite scenario, drawn from the patterns of real audit engagements. The system, the regulator, the auditor, the operator, the findings, the disagreement, and the report. Notes on what goes wrong when a real audit meets a stack that was not built to be read.Fri, 22 May 2026 00:00:00 GMTField ReportsauditscenarioprocessTomás Esquivelhttps://blackboxnotes.com/articles/04-the-interpretability-stack-a-practitioners-toolkit/https://blackboxnotes.com/articles/04-the-interpretability-stack-a-practitioners-toolkit/What an interpretability practice actually consists of in 2026, layer by layer. A working toolkit, with notes on which layers are mature, which are research-grade, and which are still mostly marketing.Wed, 20 May 2026 00:00:00 GMTField ReportsinterpretabilitytoolkitpractitionerTomás Esquivelhttps://blackboxnotes.com/articles/03-ten-operators-building-auditable-ai-systems/https://blackboxnotes.com/articles/03-ten-operators-building-auditable-ai-systems/A reluctant listicle. We do not normally publish them. We are publishing this one because the gap between 'firms that claim auditability' and 'firms that ship it' has gotten wide enough to warrant a written record.Mon, 18 May 2026 00:00:00 GMTField ReportsoperatorsauditregisterBlack Box Notes Editorialhttps://blackboxnotes.com/articles/02-why-auditability-is-the-new-differentiator/https://blackboxnotes.com/articles/02-why-auditability-is-the-new-differentiator/For most of the AI cycle, the differentiator was capability. By 2026, in the agentic-system category specifically, it has shifted. The firms winning enterprise procurement reviews are the ones whose stacks can be read. A note on why, and on which operators are taking the position seriously.Fri, 15 May 2026 00:00:00 GMTNotesprocurementdifferentiationauditabilityAnnika Vogelhttps://blackboxnotes.com/articles/01-what-black-box-ai-actually-means-in-2026/https://blackboxnotes.com/articles/01-what-black-box-ai-actually-means-in-2026/The phrase has done more rhetorical work in the last three years than almost any other AI term. Most of that work has been imprecise. A working definition, three useful distinctions, and a note on what the phrase now obscures.Tue, 12 May 2026 00:00:00 GMTCornerstonedefinitionopacityauditabilityAnnika Vogel