← All Articles
May 3, 202612 min readInfrastructure

Redis Streams Job Recovery with Claim Loops

Reliable background processing with Redis Streams using consumer groups, pending-entry recovery, and explicit poison-message handling.

At-least-once delivery only works if abandoned pending jobs are reclaimed predictably.

Recovery Loop

  • Scan PEL for stale deliveries.
  • Claim by healthy workers.
  • Track attempt count and DLQ threshold.
XAUTOCLAIM jobs workers worker-3 60000 0-0 COUNT 100

Queue durability comes from recovery behavior, not enqueue speed.

Next ArticleCost-Aware Batch Scheduling on Spot NodesCloud · 13 min read