Scale-up

Async pipeline

API Gateway → Lambda → SQS → workers → DynamoDB. A traffic spike hits at 20 s.

Async pipeline running in the ServerSloth simulator

What this architecture teaches

Asynchronous pipelines decouple accepting work from doing it. The API only has to put a message on a queue; workers process it at their own pace.

When the spike arrives, Lambda needs new instances — the first requests pay cold-start latency, and once concurrency (arrival rate × duration) passes the limit, invocations are throttled.

SQS absorbs everything that gets through, so producers stay fast, but the backlog grows and the oldest message ages while the workers catch up. Alert on message age, not just depth.

What to look for

Components

Failure modes you will see