Bulkhead Isolation

Partition resource pools: thread pools, connection pools, memory, or queue capacity: so that exhaustion or failure within one partition cannot consume resources needed by unrelated operations.

In a system with shared resource pools (thread pools, connection pools), a latency spike or failure on one workload path exhausts shared resources and degrades all other workloads, including those unrelated to the failing dependency.

Named after the watertight compartments in ship hulls, the bulkhead pattern prevents a failure in one workload from consuming shared resources and dragging down unrelated workloads. Without bulkheads, a single slow dependency can exhaust a shared thread pool: 100 threads waiting for a slow database query leave no threads available to serve fast in-memory requests.

The primary implementation form is thread-pool isolation: each downstream dependency (database, payment API, search service) gets a dedicated, fixed- size thread pool. A slow payment API drains its own pool of 10 threads but cannot touch the 50 threads reserved for database operations or the 20 threads reserved for cache operations. The overall system degrades only where the slow dependency is involved; unrelated operations continue normally.

A second form is connection-pool isolation: dedicated connection pools per database or per query class. A bulk export query class gets its own pool of 5 connections; the OLTP query class gets 50. A runaway export job cannot exhaust the OLTP pool.

A third form is queue-depth isolation: separate queues per workload class, with independent consumer capacity. A spike in background job volume cannot displace real-time event processing if they occupy separate queues.

Bulkheads are inherently a capacity planning exercise: the sum of all isolated partitions must fit within total available resources. Isolation reduces overall efficiency (idle capacity in one partition cannot be used by a saturated neighbour) in exchange for failure containment. The tradeoff is worthwhile when workloads have different criticality levels.