honest question: what use case requires cold starts below 100ms, considering TTFT of major LLMs are in the 300+ms range? presumably sandbox will be driven by an agentic loop, so.. you’re still bottlenecked by what essentially amounts to network I/O.

How much more lightweight is firecracker compared to a minimal image vm?

Because one could simply create a proper lightweight vm.

[dead]

This is a killer niche. Integrated Postgres solves the biggest headache with ephemeral sandboxes—actually keeping the agent's memory. 300ms is already solid, but getting under 100ms usually means moving from "booting" to Firecracker Snapshots.

If you haven't yet, look into pre-warming TAP devices and bypassing the HTTP API for direct process management. Exciting stuff!