Technology Profiles
25 technologiesOperational characteristics of specific backend technologies: consistency models, scaling limits, managed cloud options, and known failure modes.
25 items
Wide-column distributed database with linear write scalability, tunable consistency, and no single point of failure, designed for multi-datacenter deployments requiring always-on availability under network partition.
Stateful stream processing engine written in Java/Scala providing event-time processing with watermarks, checkpointed stateful operators, and exactly-once end-to-end semantics with compatible sources and sinks. Handles unbounded (streaming) and bounded (batch) datasets through the same API surface.
Distributed event streaming platform designed for high-throughput, fault-tolerant, ordered, and durable log-based messaging between producers and consumers.
Column-oriented OLAP database engineered for sub-second analytical queries on billions of rows, with vectorized execution, aggressive compression, and materialized view support.
Distributed SQL database wire-compatible with PostgreSQL that replicates each key range (512 MiB by default) across multiple nodes via Raft consensus. Serializable isolation is the default. Geographic data partitioning allows row-level data residency control. Designed for global deployments requiring strong consistency without a single-region primary.
Fully managed serverless key-value and document database from AWS with single-digit millisecond latency at any scale, automatic horizontal scaling, and multi-region active-active replication via Global Tables.
Distributed full-text search and analytics engine built on Apache Lucene, designed for near-real-time indexing, complex search queries, and log analytics.
Distributed key-value store implementing Raft consensus for linearizable reads and writes. Designed for configuration data, distributed coordination, leader election, and service discovery. Kubernetes uses etcd as its sole backing store for all cluster state. Not suitable for high-throughput general-purpose storage or large datasets.
In-memory key-value cache with multi-threaded architecture and client-side sharding. No persistence, no replication, no pub/sub, no data structures beyond binary blobs. Designed for maximum single-operation throughput on commodity hardware, with horizontal scaling handled entirely by the client's consistent hashing across nodes.
S3-compatible object storage designed for private cloud and on-premise deployments. Uses erasure coding for data durability across drives and nodes, bitrot protection via per-object checksums, and a distributed architecture where all nodes participate in a storage pool. Intended as a self-hosted replacement for S3 when data residency, cost, or air-gap requirements prevent use of cloud object storage.
Document-oriented database storing JSON-like BSON documents, with flexible schemas, multi-document ACID transactions, horizontal sharding, and a rich aggregation pipeline.
ACID-compliant relational database using the InnoDB storage engine with clustered primary key indexes, GTID-based replication, and a mature ecosystem of tooling for connection routing and horizontal sharding.
High-performance cloud-native messaging system supporting at-most-once pub/sub, request-reply, and durable JetStream (at-least-once and exactly-once) streams : designed for low latency and operational simplicity with sub-millisecond delivery at high throughput.
Native graph database using a property graph model with index-free adjacency. Relationship traversal is O(1) per hop regardless of graph size, making it architecturally differentiated for k-hop neighborhood queries and path-finding at a scale where relational self-joins become prohibitively expensive.
Lightweight PostgreSQL connection pooler that multiplexes many client connections onto a smaller pool of server connections, reducing PostgreSQL's connection overhead and enabling workloads with thousands of concurrent application connections to share a pool of 20–100 server connections.
ACID-compliant relational database with strong consistency, JSONB support, full-text search, and mature replication.
Purpose-built vector database written in Rust, providing HNSW-based approximate nearest neighbor search with payload filtering, named vector support, and both in-memory and on-disk HNSW index modes.
AMQP-based message broker with flexible routing (exchanges, queues, bindings), acknowledgment-based delivery, and per-message TTL and dead-letter queue support.
In-memory key-value store with optional persistence, supporting strings, hashes, lists, sets, sorted sets, and pub/sub.
C++ reimplementation of Apache Cassandra using the Seastar asynchronous framework. Wire-compatible with Cassandra's CQL protocol. Eliminates JVM GC pauses through a shard-per-core architecture where each CPU core runs its own event loop and owns a dedicated subset of data partitions. Designed for sub-millisecond p99 latency under sustained write bursts.
Cloud-native data warehouse with separate compute and storage scaling, multi-cluster virtual warehouses, zero-copy data sharing, and near-zero maintenance overhead for large-scale analytical workloads.
Durable workflow execution platform that persists workflow state and activity history, enabling long-running stateful processes (minutes to years) that survive failures, retries, and restarts without application-level checkpointing: workflows are expressed as ordinary code.
PostgreSQL extension that adds time-series-specific capabilities: automatic time-based partitioning (hypertables), columnar compression on cold chunks, continuous aggregates, and time-series SQL functions. Fully ACID, supports JOINs with relational tables, and inherits PostgreSQL's operational toolchain.
Distributed SQL query engine that federates queries across multiple data sources (S3/Parquet, PostgreSQL, MySQL, Hive, Kafka, MongoDB, Iceberg, Delta Lake) in a single SQL query: enabling ad-hoc analytics on data lake storage without moving data to a centralized warehouse.
MySQL sharding middleware that proxies MySQL connections, routes queries to the correct shard based on a configured vindex (sharding key), and merges results for cross-shard queries. Originally built at YouTube in 2011 to scale MySQL beyond single-instance capacity. Now a CNCF graduated project used by Slack, HubSpot, and PlanetScale.