Compare Scenarios

Migration Step 1

Both scenarios define a migration step at this stage. Social Feed Platform: triggered by 'PostgreSQL timeline read query p99 > 500ms; query plan for "'. Developer Tools Platform: triggered by 'First noisy neighbor incident where one tenant's CI burst de'.

Migration Step 2

Both scenarios define a migration step at this stage. Social Feed Platform: triggered by 'Fan-out worker queue lag during celebrity post events > 5 mi'. Developer Tools Platform: triggered by 'Kafka publish failures rolling back pipeline completion tran'.

Migration Step 3

Both scenarios define a migration step at this stage. Social Feed Platform: triggered by 'Redis memory utilization approaching 80% of a single node; R'. Developer Tools Platform: triggered by 'Log search returning results from other tenants' pipelines d'.

Kafka consumer group lag for fan-out worker group growing steadily; feed propagation latency (time from post write to follower feed update) exceeding 30s p95; Redis write rate on feed keys elevated but not saturated; post activity rate normal

Tier 1: Fan-Out Worker Queue Backlog: Fan-out worker pool undersized for burst post activity or a celebrity post creating a sustained high-fan-out event. Recommended evolution: Add fan-out worker replicas; implement fan-out cost routing: route high-follower-count fan-out events to a dedicated high-cost worker pool with separate Kafka consumer group and Redis write quota; use follower count threshold (e.g., >50k followers) as the routing decision. Monitor fan-out cost per post as a first-class metric. .

Redis memory utilization > 75%; eviction rate rising; cache miss rate on feed reads increasing; cold feed read fallback queries appearing in PostgreSQL slow query log; feed read p99 > 100ms despite Redis being online

Tier 2: Redis Feed Memory Ceiling: Redis feed list storage approaching memory limit; feed items being evicted before TTL; or feed list cap set too high for available memory. Recommended evolution: Reduce feed list cap from current value toward 100–150 items; increase Redis cluster capacity or shard feed keys by user_id range across multiple Redis primaries; implement tiered feed storage: hot recent items in Redis, older items fetched from PostgreSQL on demand with explicit product UX affordance .

Redis job queue depth > 1000 correlated with a single tenant identifier; other tenants reporting p99 job start time > 60 seconds; tenant-level queue metrics showing one tenant holding > 50% of in-flight worker slots

Tier 1: Job Queue Tenant Noisy Neighbor: Shared Redis queue with shared worker pool allowing one tenant to monopolize available capacity. Recommended evolution: Implement per-tenant queue lanes in Redis (separate key namespaces per tenant, e.g., jobs:{tenant_id}:{priority}); implement a weighted fair scheduler at the worker dispatch layer that reads from tenant queues in round-robin order with priority weighting; cap the number of concurrently executing jobs per tenant to the tenant's quota, not to the total available worker count .

DDL migration duration > 10s on pipeline_runs, jobs, or artifacts tables; migration deployment causing timeout errors for active CI pipeline API calls during the deployment window; pg_locks showing AccessExclusiveLock held by ALTER TABLE statement

Tier 2: PostgreSQL Schema Migration Lock: High-volume tables requiring locking DDL changes during deployments with concurrent tenant activity. Recommended evolution: Adopt zero-downtime migration patterns exclusively: add columns with nullable defaults first (no table lock in PostgreSQL 11+), then backfill, then add constraints via NOT VALID followed by VALIDATE CONSTRAINT in a separate transaction; use pg_repack for table rewrites; never run concurrent index creation without CONCURRENTLY on any table with > 1M rows .