AlloyDB’s agentic database architecture: isolation, latency, and scale

AlloyDB‘s agentic database architecture is a response to a structural mismatch between existing OLTP scaling designs and the demands of autonomous AI agents. The article argues that traditional architectures optimize for scale, latency, or isolation, but agent workloads require all three simultaneously: physical isolation from production with sub-second data freshness, sub-millisecond baseline I/O even on cache misses, and the ability to burst from zero to thousands of compute nodes within seconds and back to zero. The authors define these as three tenets, and claim no prior architecture satisfies all of them.

The article evaluates three existing paradigms against these tenets. Independent replicas with shared-nothing storage meet isolation and latency, but fail scale because provisioning a replica requires rehydrating hundreds of gigabytes or terabytes, taking hours. Disaggregated shared-storage servers add compute quickly but create shared fate between agents and production on the same storage tier, and total I/O bandwidth is fixed to the pre-provisioned tier. Object storage with shared block servers recovers latency for hot data, but a block-server miss falls through to object storage at tens of milliseconds, and replicas share the block servers with production, so burst traffic throttles the primary. The article also reports a benchmark of a commercially available object-storage-plus-block-server service: adding up to eight replicas produced less than 2x throughput, peaking at four replicas before saturating shared block-server bandwidth, while primary throughput dropped by more than 75%.

AlloyDB‘s new architecture is built directly on Google’s infrastructure stack. Storage uses Colossus, Google’s exabyte-scale distributed storage system, which provides direct sub-millisecond reads via stream handles that bypass intermediaries, massive aggregate throughput (up to 15 TB/s and 20 million queries per second to a single AlloyDB database), and physical segment partitioning so agent I/O is served from separate Colossus segments. Networking uses Jupiter, Google’s data center fabric with 13 petabits per second of bisection bandwidth across more than 100,000 servers, allowing agent nodes to be scheduled flexibly without placement bottlenecks. Compute uses an ephemeral pool of microVM-based AlloyDB nodes that agents reach through the Model Context Protocol (MCP); these nodes have read-only access to production data with sub-second freshness, run the full PostgreSQL engine including indexes, vector, full-text, spatial search, and columnar scans, and are billed per second of activity.

The article reports benchmark results for AlloyDB‘s agent pool. Running concurrent index lookups over a dataset larger than available DRAM, throughput scaled from 3.9K to 41K QPS from one to ten agent nodes, then near-linearly to 1,000 nodes. Aggregate throughput scaled 773x to 3 million QPS, driving over 8 million IOPS in Colossus, with zero measurable degradation to the primary cluster. In a separate test, 2,100 agent nodes running concurrent full table scans exceeded 1 terabit per second of aggregate scan throughput. The authors also note that BigQuery and Spark can read AlloyDB data from Colossus with the same isolation, enabling lakehouse federation.

The article is explicit about the architectural requirements: an agentic database needs storage with Colossus-like properties, a network that connects compute to storage without constraint, and compute that can be provisioned and released at agent scale. It positions AlloyDB‘s design as the first system to meet all three tenets, and frames the result as eliminating correlated failures, capacity guesswork, and semantic compromises for agents reading live operational data. The piece is a product announcement, and the evidence presented is from Google’s own tests; it does not compare AlloyDB‘s measured results against the competing architecture under identical conditions.

AlloyDB’s agentic database architecture

View Original