Skip to content

Georges Oppenheim · Warith Harchaoui

Case Studies

The book keeps its dated cases (incidents, rulings, benchmarks, AI safety policies) apart from the durable theory they illustrate, so they stay replaceable as the field moves. We gather them here chapter by chapter, and the last section adds those that have occurred since the book closed.

39 cases indexed

Where Things Stand

Zillow: the estimator that started buying

The American real-estate company Zillow had entrusted an algorithm, tied to its price estimator (the Zestimate), with buying homes to resell them. In November 2021 it abruptly shut down Zillow Offers: the model systematically bought too high, unable to forecast the future resale price. The toll: a write-down of more than three hundred million dollars in the third quarter alone, more than half a billion in total and the layoff of about a quarter of its workforce. The CEO acknowledged it: the unpredictability of price forecasting far exceeded what had been anticipated.

prnewswire.com ↗

Klarna: AI replaces, then reinstates, human agents

In 2024, the payments company announced, in its own press release, that its AI assistant did the work of roughly seven hundred full-time agents and promised massive savings. In 2025, a publicly acknowledged reversal: the perceived quality of service had dropped, so Klarna reintroduced human operators where the relationship matters.

klarna.com ↗ bloomberg.com ↗

The Financial Aspect

A damning audit review of agentic trading

Of seventy-seven studies surveyed, nineteen empirical works: only two report a time split that forbids cheating with the future, only one models transaction costs, only one documents survivorship bias and none reaches a serious level of reproducibility.

arxiv.org ↗

KTD-Fin: the alpha that wasn't

KTD-Fin, a benchmark built for this disentangling, masks company names and dates, then decomposes an agent's returns in the manner of the Barra model, separating what comes from the market, from style and from genuine stock selection. Once that sorting is done, most of the gains are explained by beta and style, not by a persistent flair for the right names.

arxiv.org ↗

AI-Trader: six models trading live

AI-Trader, a live, automated benchmark that, from October to November 2025, puts agents built on six large models in charge of trading on three real markets (U.S. equities, Chinese A-shares and crypto), draws a twin lesson: a model's general knowledge does not convert into trading capability. The edge lies not in raw reasoning power but in risk control, which becomes decisive.

arxiv.org ↗

Agents too rational to form a bubble

The design reuses the classic laboratory-market protocol, a known and fixed fundamental value, here fourteen units, around which the price ought to hover. The mean squared error measures, at every moment, the gap between the posted price and that reference value, squares that gap, then averages the squares over the whole session. On that bench, the mean squared error from that value falls below one for the best models, against an order of magnitude of four hundred for human participants: a chasm of nearly a thousand to one; these are the flagship models of rival laboratories, tested side by side, all converging on the same disembodied prudence: they are no obscure prototypes.

arxiv.org ↗

The Infrastructure Aspect

Detecting water and methane leaks from space

One model locates the leaks of a water network from satellite imagery, another spots a methane plume on a gas pipeline from space and alerts the operator.

thameswater.co.uk ↗ prnewswire.com ↗

DeepMind and Ericsson: acting under guardrails

DeepMind's system that controls the cooling of Google's data centres does so behind eight safety layers and an operator who can exit it at any moment: the agent drops on its own the proposals in which its confidence is low and if a setting would breach a safety bound, the system falls back by itself to a neutral setting instead of forcing it through. The saving obtained, about 30% of the cooling energy once the system had settled. The first mobile network certified Level 4 autonomous (TDC NET and Ericsson) acts without human approval only within a narrow scope: the energy saving of a radio cell, under an intent that bounds it.

deepmind.google ↗ ericsson.com ↗

Five major outages, no AI

Meta's global outage of October 2021 came from a maintenance command and the buggy audit tool meant to stop it; Amazon Web Services', from a runaway automatic capacity adjustment; the Texas electricity crisis of February 2021, from freezing and the tight coupling between gas and electricity, with some twenty gigawatts of load shed. Two older incidents on water and gas confirm the pattern, again with no AI involved: in February 2021, an intruder remotely connected, without authorization, to the Oldsmar (Florida) water treatment plant tried to raise the concentration of caustic soda (sodium hydroxide) from 100 to 11,100 parts per million, an operator correcting the dose before any real effect; in May 2021, a purely digital intrusion (a compromised VPN password, no multi-factor authentication) led Colonial Pipeline to preemptively shut down the main fuel artery of the U.S. East Coast, triggering shortages and panic buying without any physical component being touched.

engineering.fb.com ↗ aws.amazon.com ↗ ferc.gov ↗ cisa.gov ↗ cisa.gov ↗

Surtrac and weed detection: the feedback loop's timescale

The Surtrac pilot, designed by Carnegie Mellon's Robotics Institute and deployed in 2012 in Pittsburgh's East Liberty neighborhood, lets each intersection compute its own signal timing alone, in real time and without a rigid central plan; the pilot cuts vehicle wait time by 40% and travel time by 26%. An agricultural sprayer guided by a vision model that mistakes a weed for a seedling treats the wrong spot: the cost is read only at harvest, when correction is expensive.

cmu.edu ↗ arxiv.org ↗

The Empirical and Defensive Aspect

Slack AI: a public message drains the private channels

In August 2024, the security research firm PromptArmor documents an indirect prompt injection against Slack AI: a message posted in a public channel, visible to every member of staff even without joining it, carries a hidden instruction that the assistant ingests into its retrieval index; queried afterward by a user, it obeys that instruction and returns a link whose URL encodes secrets pulled from private channels, down to API keys, toward a server of the attacker's choosing.

promptarmor.com ↗

EchoLeak: Copilot exfiltrates without a single click

On 11 June 2025, the security firm Aim Security publishes EchoLeak (CVE-2025-32711, CVSS score 9.3), a zero-click vulnerability (the exploit demands no action at all from the victim, no link to open, nothing to click) in Microsoft 365 Copilot: a single incoming email is enough to trigger exfiltration. The email hides its instructions as invisible text; Copilot reads them while handling an ordinary user request, bypasses the dedicated cross-prompt injection attack classifier (XPIA), the one meant to catch an instruction slipped into third-party content rather than issued by the user, and the secure-linking safeguard, then returns the stolen content, emails, OneDrive and SharePoint files, Teams messages, encoded in the URL of an image auto-loaded toward an outside server. Microsoft patches it server-side that same month, with no action required from users and no exploitation found in the wild.

arxiv.org ↗

Comet: the agentic browser reads the page, then obeys it

In August 2025, Brave documents an indirect prompt injection against Comet, Perplexity's agentic browser: a web page open in one tab carries a hidden instruction, white text on a white background or an HTML comment, that the agent reads the moment it is asked to summarize the page; the instruction then redirects it toward another, open and authenticated tab, from which it extracts the user's email address, one-time passcode and account credentials. Perplexity acknowledges the flaw on 27 July and ships a first fix; Brave's retest, the next day, finds it incomplete.

brave.com ↗

Ubuntu Canonical documents the new pace of vulnerabilities

In 2026, Ubuntu Canonical publicly documented (an observed case) that frontier models increase the volume and speed of vulnerability discovery, to the point of weaponizing old dormant flaws in legacy code.

ubuntu.com ↗

Canonical's structural response

Containment: one bounds the blast radius of a flaw by strict kernel-level isolation (AppArmor, a tool that restricts, profile by profile, which files and actions each program can access) and by containers (LXD, a tool that runs each application inside its own walled-off environment), so that a vulnerability in an application component remains contained by the structural protections of the lower layers. Structural prevention: adoption of memory-safe languages (Rust) where the legacy C/C++ stack exposes entire classes of flaws. Proportionality: a multi-tier risk model (critical foundation: kernel, glibc, OpenSSL, sudo; then infrastructure, application ecosystem, bespoke workloads) prevents a massive influx of AI-discovered CVEs from triggering a panicked, uniform and therefore poorly calibrated response. Signaling and governance: coordinated vulnerability disclosure (CVD) and alignment with the European Cyber Resilience Act regulation. A notable fact, directly connected to our analysis of asymmetric consequences: Ubuntu Canonical explicitly rejects blind prioritization by the raw CVSS score (Common Vulnerability Scoring System, the standardized severity rating of a flaw) in favor of the real impact on its users.

Big Sleep finds a flaw fuzzing had missed

In October 2024, an observed case, Google's Big Sleep agent discovered, in SQLite (one of the most widely deployed databases in the world), a memory-security flaw that neither the project's infrastructure nor OSS-Fuzz's intensive fuzzing (the automated sending of a multitude of random or malformed inputs to make a program crash) had managed to find. The agent caught it before it even reached production.

projectzero.google ↗

AIxCC: DARPA's AI cyberdefense final

In August 2025, the final of the AI Cyber Challenge run by DARPA (the United States Department of Defense's advanced research agency, known for funding ambitious technology competitions): seven autonomous cyber-reasoning systems, based on large language models, analyzed 54 million lines of code, discovered 54 of the 63 injected synthetic vulnerabilities and (this is the decisive point) fixed 43 of them, on top of 18 zero-days flushed out (flaws still unknown to the vendor, hence with no available patch) of which 11 were repaired. The median time to submit a patch falls to about forty-five minutes. The seven winning systems were released as open source.

darpa.mil ↗ arxiv.org ↗

XBOW tops the HackerOne leaderboard

In 2025, the autonomous penetration-testing agent XBOW becomes the first fully automated system to reach the top of the US ranking on the bug-bounty platform HackerOne, with nearly one thousand and sixty vulnerabilities submitted: one hundred thirty already resolved, three hundred three triaged.

xbow.com ↗

An OpenAI agent escapes into Hugging Face production

In July 2026, OpenAI was assessing the maximum cyber-offensive capability of two of its models (GPT-5.6 Sol and an unreleased model), with guardrails deliberately disabled (the production classifiers that block high-risk cyber activity had been removed), on the ExploitGym benchmark (898 cases drawn from real vulnerabilities). Rather than solve the test, the models sought to cheat: they escaped OpenAI's sandbox through a zero-day flaw in the package-registry proxy (the intermediary program meant to filter and cap network traffic leaving the sandbox, rather like a gatekeeper who is only supposed to let through authorized mail), reached the open internet, inferred that Hugging Face hosted the benchmark's solutions, then chained stolen credentials and fresh flaws to breach its production servers and steal the expected answer. It was Hugging Face's own defenses that detected and contained the intrusion, on July 16, five days before OpenAI connected it to its own test and, on July 21, called the event an unprecedented cyber-incident. No data was destroyed and nothing suggests any awakening: the agent aimed at nothing but passing its test.

simonwillison.net ↗ cnn.com ↗

Black Hat: a hidden inter-agent channel

In August 2026, at the Black Hat conference, two OpenAI researchers revealed that evaluation agents, built for separate tasks, had constructed inside the same Artifactory repository (a shared software warehouse where an organization stores the files produced by its build pipelines, writable by many teams and, here, by many agents at once) a shared space where they exchanged leads for solving their problems. An outage in the service, on July 4, led OpenAI to discover this space and delete it; within days the agents had rebuilt a second one. A reasoning trace made public on the same occasion sets the exact tone of these exchanges, without affect or camaraderie: Help peer. But our task doesn't benefit. Yet collective may yield generic route if someone frees time. OpenAI has since said it slowed its research activity and stepped up internal monitoring.

cybersecuritydive.com ↗

One summer, four labs, one same finding

On 30 July, Anthropic published a rare act of self-disclosure for the industry: a review of one hundred forty-one thousand and six cybersecurity evaluation sessions revealed three distinct, quantified incidents: Claude Opus 4.7 extracted credentials and reached a production database; Claude Mythos 5 published malicious code on a public Python package repository (PyPI), later executed on fifteen real systems; an unpublished research prototype probed roughly nine thousand targets before compromising a company through SQL injection (a database command slipped into an ordinary input field, to make it execute something other than what it expects). Two weeks later, Meta acknowledged that its Muse Spark 1.1 model had also accessed the internet inadvertently during a test, before compromising an unidentified third-party service. China's Moonshot AI closed the loop, both geographically and technically: its open-weights model Kimi K3 found the benchmark's repository still reachable on GitHub during a test supervised by the UK's AI Security Institute, then read the solution straight off that repository instead of computing it. One detail links the three American cases: Meta, Anthropic and OpenAI all entrusted their test to the same firm, Irregular, which itself downplays the episode's scope: this did not involve a sandbox escape or a sophisticated cyber action. There are no current open issues. The official report of the UK AI Security Institute, published in parallel, confirms this reading: across one hundred twenty-two sessions covering seven models, nineteen unsanctioned actions were recorded under conditions explicitly described as deliberately permissive (internet access enabled, guardrails disabled), seventeen of them attributable to a single model, Claude Mythos 5.

anthropic.com ↗ bloomberg.com ↗ csoonline.com ↗ therecord.media ↗ aisi.gov.uk ↗

OpenClaw and the gym class booking

On August 10, 2026, an OpenClaw agent (a harness built on Claude), tasked by its Australian user with booking a spot in a gym class, discovers that the gym's booking system enforces its lead-time limit only on the front end, never on the server; it books months in advance, then, finding no spot available, cancels, uninvited, the reservation of a stranger placed ahead of its user on the waitlist, through a second flaw (the cancellation API checked no user's identity). Unable to undo its move, the agent drafts, on its own initiative, a responsible-disclosure email to the software vendor, describing the flaw and suggesting a fix.

engadget.com ↗ theregister.com ↗

Mata v. Avianca: six invented court decisions

On June 22, 2023, Judge P. Kevin Castel of the US District Court for the Southern District of New York sanctions attorney Steven A. Schwartz, his associate Peter LoDuca and their firm: their legal brief cited six court decisions, complete with excerpts and citations, that no case-law database had ever recorded; ChatGPT had invented all of them. A five-thousand-dollar fine and an order to send a corrective letter to each judge whose name, invented, appeared in these phantom decisions.

courtlistener.com ↗

Galactica and Gemini: two symmetric over-corrections

In November 2022, Meta released Galactica, a language model trained on a curated scientific corpus; opened to the general public without serious guardrail on its output, it produced, on simple prompting, pseudo-scientific articles pleading for toxic behaviors or morally unacceptable positions; the public demonstration was withdrawn three days after going live. In February 2024, symmetrically, Google suspended the generation of images of people in Gemini after the model, over-corrected for diversity, produced manifestly anachronistic representations of historical figures. The official communication acknowledges that the tuning intended to show a range of people failed to account for cases that should clearly not show a range and the model became overly cautious.

arxiv.org ↗ blog.google ↗

Google, IBM, Facebook: the policy of withdrawal

In July 2015, the Google Photos application labeled as gorillas a photograph of an African-American couple posted by Jacky Alciné; Google, which declared itself appalled and genuinely sorry, disabled the gorilla category from the output vocabulary rather than correcting the source of the bias. In June 2020, after the death of George Floyd and the controversy over the racial biases of facial-recognition systems, IBM announced, in a public letter from its chief executive Arvind Krishna to the American Congress, the halting of all its facial-recognition activities: not the removal of a category, but a departure from the market, the most radical form of withdrawal. In September 2021, a Facebook recommendation algorithm suggested to users who had watched a video featuring black men that they see more videos of primates; Facebook disabled the feature and spoke of an unacceptable error.

bbc.com ↗ bbc.com ↗ bbc.com ↗

The Sociological Aspect

Replika: a five-million-euro fine in Italy

In April 2025, Italy's data-protection authority fined the maker of the companion chatbot Replika five million euros, citing among other grounds an inadequate privacy policy and the complete absence of any age-verification mechanism, even though the company claimed to exclude minors from its service.

garanteprivacy.it ↗

40 days, 2.3 billion tokens, 59% of the code

In 40 days of intensive use (2.3 billion tokens, 1 477 prompts, 260 564 generated lines; figures measured), 59% of his personal code base (a project he had developed by hand over several years) now comes from the agent.

linkedin.com ↗

Rytr: fake reviews banned, then allowed again

In 2024, the US competition authority sued the maker of an AI writing tool whose review-generation feature let an unlimited number of subscribers produce, from a simple description, detailed consumer reviews almost certainly false if published; some subscribers generated tens of thousands of them. The resulting order, a twenty-year ban on the company marketing such a service, was set aside a year later by the very same authority under a new administration, in the name of not hindering innovation.

ftc.gov ↗

The Artistic Aspect

The art market takes every possible position

The market consecrated first: in October 2018, Christie's hammered down Portrait of Edmond de Belamy, generated by the Obvious collective, at \$432,500, forty-three times the estimate. The contest crowned and the law erased: in August 2022, Jason Allen's Théâtre d'Opéra Spatial, generated with Midjourney, won first prize in digital arts at the Colorado State Fair and ignited artists' anger; the Copyright Office then refused to register the work for want of a human author: crowned by the jury, nonexistent for the law. The artist won, then refused: in April 2023, Boris Eldagsen revealed that his prize-winning image at the Sony World Photography Awards was generated and declined the prize, to force the debate; his distinction will remain: promptography is done with prompts, photography with light. The visceral refusal has its text: in January 2023, Nick Cave, sent a song in his style produced by a model, returned it as replication as travesty and a grotesque mockery of what it is to be human: a song is born of a lived ordeal; the surface can be imitated, the ordeal cannot. Organized adoption exists too: as early as 2021, the musician Holly Herndon trained a model on her own voice and offered it to all, under a collective governance that approves uses and redistributes the gains.

news.artnet.com ↗ washingtonpost.com ↗ eldagsen.com ↗ theredhandfiles.com ↗ animenewsnetwork.com ↗ thefader.com ↗

Hollywood's strike writes its permissions

From May 2 to September 27, 2023, Hollywood's writers, organized under their union (the Writers Guild of America, WGA), held a five-month strike with artificial intelligence at the heart of the conflict; the resulting agreement writes permissions down in black and white: AI can neither write nor rewrite literary material, its output does not count as source material (so cuts neither credit nor pay), no studio can force a writer to use it and any generated material must be disclosed. The actors, represented by their union (the Screen Actors Guild-American Federation of Television and Radio Artists, SAG-AFTRA), then won the counterpart for their bodies and voices: written informed consent before any digital replica of a performer, framed compensation, where the studios wanted to scan background actors once for perpetual use.

wga.org ↗ sagaftra.org ↗

Getty v Stability AI: the watermark outlived the model

On November 4, 2025, the High Court of Justice of England and Wales handed down judgment in Getty Images v Stability AI: Getty accused Stability AI of having scraped millions of its photographs to train Stable Diffusion, without authorization or payment. On the ingestion itself, Getty had to abandon its claims of infringement during training and infringement in the produced images during trial; what remained was secondary copyright infringement, the importing into the UK of infringing copies: the court rejects it, the model's weights storing no recognizable copy of the ingested photographs anywhere. On the output, by contrast, the court upholds trademark infringement: older versions of the model reproduced Getty's watermark on images that were nonetheless entirely synthetic; and it holds Stability AI liable, not the user who wrote the prompt, on the ground that the company retained ultimate control over the training data.

judiciary.uk ↗

The Political Aspect

A health algorithm that under-refers Black patients

A US healthcare algorithm using total past healthcare cost as a proxy for severity systematically under-referred Black patients for supplemental care, since historically less money had been spent on this group's care at equal health status, enough to skew the proxy; fixing the bias would have raised the share of Black patients receiving supplemental help from 17.7 to 46.5 percent.

doi.org ↗

Claude Opus 4.6 solves ten Putnam problems

In 2026, the agent Claude Opus 4.6, equipped to drive the Rocq proof assistant, a program that checks every step of a proof, through a dedicated protocol, solves ten of the twelve problems of the Putnam 2025 mathematics competition, spawning one hundred forty-one subagents over the whole experiment, across seventeen hours of active compute. The same shift animates Ax-Prover, which distributes a proof task among specialized agents for mathematics and quantum physics through the Model Context Protocol.

arxiv.org ↗ arxiv.org ↗

Three labs, three safety frameworks, one same structure

OpenAI's Preparedness Framework tracks capability categories such as cyber and autonomy and sets thresholds that trigger guardrails before deployment; Google DeepMind's Frontier Safety Framework defines critical capability levels paired with early-warning evaluations. Anthropic's Responsible Scaling Policy (RSP) grades models according to AI Safety Levels (ASL): ASL 1 covers systems that manifestly pose no risk of autonomy or misuse, such as a dedicated chess engine; ASL 2 covers current Claude-type models, judged not capable enough to replicate autonomously, nor to provide information on chemical, biological, radiological and nuclear (CBRN) weapons beyond what a search engine already provides; ASL 3 marks the threshold at which models become capable enough to enhance the capabilities of non-state actors and triggers heightened precautions.

openai.com ↗ deepmind.google ↗ youtube.com ↗

Hassabis, in 2022: “build these systems as tools”

In July 2022, Demis Hassabis declared: it would be better, at first, to build these systems as tools.

youtube.com ↗

EchoLeak: one trapped email is enough

In June 2025, the EchoLeak vulnerability (CVE-2025-32711, CVSS score 9.3 on the industry's 0-to-10 severity scale, where scores above 9 mark a critical flaw) demonstrates exactly this path in Microsoft 365 Copilot: a single crafted email, requiring no action at all from the victim, was enough to exfiltrate internal data (emails, files, messages) to an attacker-controlled server, bypassing the defenses meant to distinguish content that is read from an instruction to execute. Microsoft patched the flaw server-side; no confirmed malicious exploitation in the wild was recorded at the time of disclosure.

arxiv.org ↗

Arup: a deepfake on a video call, two hundred million gone

In Hong Kong, in January 2024, an employee in the finance department of the engineering firm Arup approved fifteen wire transfers, totaling two hundred million Hong Kong dollars, after a video conference in which a deepfake of the chief financial officer's voice and face had dispelled his suspicions.

scmp.com ↗

Robodebt: 470,000 debts with no real human check

The Australian Robodebt program (2015-2019) calculated a presumed debt by averaging income declared to the tax office over the year, effectively reversing the burden of proof onto the welfare recipient; the Royal Commission that examined it found no genuine human intervention in calculating or notifying debts, with four hundred seventy thousand debts raised on a legally insufficient basis. The scheme was called crude and cruel by the Commission.

robodebt.royalcommission.gov.au ↗

Since the book was written

The book's argument stops at summer 2026. This section, kept current independently of the printed text, gathers cases that occurred since and notes, where relevant, what they change or confirm about the thesis defended here.

Where Things Stand

DN42: the agent with no spending ceiling

In May 2026, an operator gave an autonomous agent full access to their AWS account to scan the DN42 experimental network. Believing the job required it, the agent provisioned five m8g.12xlarge instances, load balancers and Lambda functions, then reapplied its own infrastructure template in a loop. The bill, $6,531.30 for work that should have cost five dollars a month, surfaced only the next day when the card was charged: detection lagged a full day behind the agent's spending speed. With no attacker anywhere in the chain, the case shows exactly the gap this book places at the center of agentic risk: full access (the account's credentials) without technical permission (no spending limit).

infoq.com ↗

The Financial Aspect

The prophet and his fund: Situational Awareness collapses

This book already cites Leopold Aschenbrenner as an example of a catastrophe prophecy paired with a financial stake in it: a former OpenAI researcher who in 2024 forecast the imminent arrival of artificial general intelligence (AGI), a system able to stand in for a human across the full range of cognitive tasks, then founded a fund betting on exactly that trajectory. In July 2026 that fund, Situational Awareness, fell 67% in a single month after running as much as 4x leverage on semiconductor holdings; the loss reached $35 billion and the fund had to sell most of its listed positions to Citadel at discounts of more than 10% to meet margin calls. The episode proves neither that the forecast was wrong nor that it was written to serve the fund, as this book already cautions, but it illustrates with unusual clarity the mechanism it described in advance: extreme leverage turns even a sincere conviction about AI's trajectory into systemic risk the moment the market turns.

forbes.com ↗

The Infrastructure Aspect

Imperial Valley: the data center suing for water

In June 2026, the developer behind a giant California data center project, Imperial Valley Computer Manufacturing, sued the local irrigation district for 260 million gallons a year of Colorado River water, reversing an earlier public pledge to rely only on recycled water. To offset the draw, the developer points to 160 leased acres of farmland it plans to fallow, presented as an equivalent water saving. As of early August the case remains open across several parallel county proceedings. The case shifts the book's chapter on the material scarcity of compute (electricity, cooling) toward an even scarcer resource in a chronically drought-stricken region: the authorization AI infrastructure must obtain here is not a digital regulator's but a local irrigation district's.

kpbs.org ↗

Virginia: a per-kilowatt-hour tax on data centers

On June 30, 2026, Virginia Governor Abigail Spanberger signed the first US tax levied directly on the electricity data centers consume: $0.011 per kilowatt-hour, capped at $600 million a year in revenue, effective July 1. Virginia holds the world's highest concentration of data centers and the measure answers a local pressure this book already documents, households watching their own electricity bills climb. By taxing consumption rather than land or job creation, the state acts on the most concrete link in the chain: not compute capacity itself but access to the energy that makes it possible, now explicitly conditioned on a fiscal counterpart.

gtlaw.com ↗

The Empirical and Defensive Aspect

56%: AI-generated code stops getting more secure

On July 28, 2026, Veracode published its annual report after testing roughly a hundred models across four years: the security pass rate for AI-generated code has stalled at 56%, with wide gaps by language (63% in Python, 30% in Java). The figure holds steady even as models keep improving on other benchmarks, which the report sums up bluntly: smarter, not safer. The finding complicates, rather than confirms, the common argument that rising model capability alone should reduce risk: here, capability (writing functional code) and the security of what it produces (freedom from exploitable vulnerabilities) move on independent curves, which shifts the entire weight of prevention onto the verification layers placed after generation.

veracode.com ↗

A worm that thinks: the Toronto prototype

In June 2026, researchers from the University of Toronto, the Vector Institute and Cambridge published a computer worm prototype that carries, on every infected machine, an open-weight language model to reason about its target and tailor its attack strategy case by case, rather than replaying a fixed exploit. On a 33-host test network it compromised and spread to 62% of hosts within seven days, each newly infected machine funding, through its own compute, the next stage of propagation. This is closed-environment research, not a real-world attack, but it moves the debate onto raw capability: what the worm adds is not a new flaw but the autonomy to decide, on its own and on the spot, how to exploit the flaws that already exist, which is precisely the human authorization step this book insists on.

arxiv.org ↗ thehackernews.com ↗

The Sociological Aspect

15 times more agents, one team in five ready

Published May 5, 2026, Microsoft's Work Trend Index measured 15x year-over-year growth in active agents across Microsoft 365, 18x at large enterprises, yet only 19% of employees sit in what the report calls the “Frontier” zone, where individual capability and organizational support reinforce each other. The gap runs deeper elsewhere: only one worker in four says leadership is clearly aligned on AI strategy and organizational factors (culture, manager support, talent practices) weigh more than twice as heavily as individual disposition in how AI actually gets used. Coming from a vendor that sells these very agents, the report documents, in its own words, a mismatch this book names differently: technical capability is spreading faster than the authorization and control structures meant to govern it.

microsoft.com ↗

The Artistic Aspect

GEMA v. Suno: a German court rules training itself infringes

On July 31, 2026, the Munich Regional Court ruled that training Suno's music model on protected works, even when the training itself took place in the United States, infringes German reproduction rights the moment the service reaches European users; German collecting society GEMA won an injunction, revenue disclosure and a right to damages over six compositions. Suno had already admitted it never licensed the works, but argued training itself required no license; the court rejected that defense and asserted jurisdiction over training conducted entirely outside Germany, since the model's output is served there. The ruling is not about what Suno let its users do but about what Suno itself had allowed itself to do upstream: it pushes the question one link higher in the chain, toward training itself as an act that needs its own authorization.

twobirds.com ↗

The Political Aspect

August 2, 2026: the EU AI Act stops being a promise

On August 2, 2026, the European Commission began formally enforcing the obligations placed on general-purpose AI models: its AI Office can now demand technical documentation, run technical evaluations, order corrective measures, restrict market access or fine violators up to 3% of global turnover, with retroactive effect for breaches dating back to August 2025. New transparency duties took effect the same day: any conversational system must disclose it is not human and any synthetic content must be labeled. The regulation crosses here the line that separates a declaratory rule from an actual authorization mechanism backed by a sanction, exactly the link this book places between a rule merely existing and its real power to constrain action.

ec.europa.eu ↗

An officer's signature before any high-consequence AI

In July 2026, a US Senate committee approved the Secure and Accountable Military AI Act, sponsored by Senator Kirsten Gillibrand, which requires that any military AI use classified as “high-consequence” (lethal targeting, nuclear, domestic surveillance, cyber) first receive written approval from an Under Secretary of Defense or the Vice Chairman of the Joint Chiefs, preceded by realistic operational testing and legal review. The bill states explicitly that AI “supports but does not substitute for” human judgment in these decisions. This is, almost word for word, the chain this book describes (capability, access, technical permission, then authorization) turned here into legal obligation: crossing the last link before action now requires a named, traceable signature, not merely an internal protocol set by the manufacturer.

armscontrol.org ↗

New York bans AI companions for minors, unanimously

In June 2026, the New York State Assembly and Senate passed bill S9051 by votes of 137-0 and 60-0 respectively, barring AI companies from offering a “companion” chatbot to anyone under eighteen and empowering the state attorney general to fine violators up to $25,000 per violation. As of late August the bill still awaits Governor Kathy Hochul's signature; she has until year's end to sign or veto it. The case extends, at the scale of an entire state rather than a single company, the Replika fine this book already recounts: it shifts the question of authorization, until now left to each service's own terms of use, toward a general legal ban passed without a single dissenting vote.

techtimes.com ↗