Skip to main content

Timeout

System Analysis

ReliabilityPRODUCTION

Normal Behavior

Prevents unbounded waiting by aborting requests that take too long.

Failure Behavior

Triggers exactly 1 millisecond before the database finally responds, wasting all the computation.

Business Consequence

Users refresh the page aggressively, doubling the load and ensuring nobody ever gets a response.

Visual Manifestation

"A stopwatch that explodes just as the runner crosses the finish line."

Satirical Behavior

"An arbitrary hardcoded integer (usually 30000ms) that engineers guess might be long enough, which exists solely to ensure users stare at a spinning wheel right before their payment fails."

Known Aliases

TimeoutRequest DeadlineTime LimitCancellation

Technical Terminology

connection timeoutread timeoutwrite timeoutrequest deadlinecontext cancellationSLA limittimeout propagationhard timeoutsoft timeoutcircuit trip

Failure Indicators

hung requestthread pool exhaustion504 gateway timeoutdelayed failurezombie process

System Architecture (Graph)

Click or hover to interact

FAQ

How does it normally behave?

Prevents unbounded waiting by aborting requests that take too long.

How does it fail?

Triggers exactly 1 millisecond before the database finally responds, wasting all the computation.

What is the business consequence?

Users refresh the page aggressively, doubling the load and ensuring nobody ever gets a response.

How does the lack of distributed deadline propagation cause thread pool exhaustion and wasted compute?

When an upstream API gateway has a 2-second timeout but downstream microservices and database queries lack context deadline propagation (such as gRPC deadlines or HTTP request cancellation contexts), the gateway aborts the client connection after 2 seconds while the downstream database continues running an expensive 60-second table scan. The backend wastes CPU, memory, and database connections servicing an abandoned client request.

Why do overly tight timeout configurations trigger catastrophic retry storms in distributed architectures?

When service timeouts are configured too close to the p99 latency threshold, transient network jitter or minor database latency spikes cause client requests to time out prematurely. If clients are configured with aggressive, unjittered automatic retries, each timed-out request spawns multiple immediate replacement requests, multiplying incoming traffic and pushing an already struggling backend service into complete operational collapse.

AI Summary

Timeout is a RELIABILITY system in TinyCTO.tv. Initiates an asynchronous timer upon dispatching an operation. If the remote service or database completes the request within the specified deadline, the timer is cancelled and execution proceeds normally; if the deadline expires before a response is received, the connection is immediately aborted, local resources are reclaimed, and a timeout error is returned to the caller.