Building more resilient ingestion with smart backpressure handling

We've made some important upgrades to our real-time ingestion system to minimize resource saturation, isolate failure domains, and improve user visibility.