Posts

Showing posts with the label Rust

AWS Parks 75,000 Idle Agents on a Raspberry Pi

Image
AWS Parks 75,000 Idle Agents on a Raspberry Pi By Daniel Rao | October 24, 2026 Here is the dirty secret of the agent boom: most of your expensive AI workforce is doing nothing. It sits there, process held open, memory reserved, meter running, waiting for a build, a webhook, or a human approval tomorrow morning. AWS has just open-sourced a runtime that refuses to pay for that idleness, and its headline number is gloriously absurd: 75,000 concurrent agents fitted into the 8 GB of a Raspberry Pi 5. The runtime is called Infinity. It arrived on October 23, 2026, from AWS and UC Berkeley as part of the Hydro project, under the Apache 2.0 licence, as an early research release rather than a polished product. But the idea at its centre is elegant, and it attacks a cost every team running agents at scale already feels: waiting is not free when your architecture holds a process open for every waiting agent. Anyone who has watched a terminal sit blinking for twenty minutes while a build cra...