6 ms·

https://blog.railway.com/p/incident-report-february-11-2026 https://blog.railway.com/p/incident-report-february-11-2026

• x0x0 4mo ago
  "we did not have the monitoring or controls to prevent our anti-fraud from hard killing 3% of workloads, including many instances of pg" Oof.
  • rzmmm 4mo ago
    Needs an anti-anti-fraud service which terminates malfunctioning anti-fraud services.
    • x0x0 4mo ago
      When I've written similar services, there was a (low) hard cap on how many fraud decisions they could action before they quit and paged. If we were getting hit with a wave of something, a human had to temporarily bump that limit.