15 docs tagged with "latency"

Overview of latency, throughput, concurrency, reliability, time, idempotency, and CAP/PACELC trade‑offs in distributed systems.

Trade-offs between high-latency accurate batch and low-latency approximate streaming

Too much communication between objects, causing latency and tight coupling.

Practical distinctions, decision flows, and patterns to combine concurrency, parallelism, and synchronization safely.

Understand the eight false assumptions that undermine distributed systems and learn to design systems that don't depend on them.

TL;DR

Google's four key metrics for understanding service health: measure these well, and you'll know your system.

Distributed caching and in-memory data platforms for sub-millisecond latency and session management

TL;DR

Define end-to-end latency targets, track SLOs, and communicate availability guarantees via SLAs.

Clear definitions, interactions, and practical tuning to hit latency SLOs without sacrificing throughput.

Manage features for machine learning and serve models in production

Design systems that respond quickly and scale horizontally to handle increasing load while maintaining latency budgets.

Hard vs soft real-time requirements, deterministic execution, scheduling algorithms, priority inversion, and watchdog timers

Choose between synchronous request-response and asynchronous messaging. Understand coupling, latency, and availability trade-offs.