Thank you for your patience. All queues are back to normal. The issue appears to have been related to underlying hardware in one of our AWS cluster and was resolved via cycling out all the hardware.

In the process of trying to manually keep queue volumes low and verify different potential solutions, some invalid webhooks were sent out (e.g webhooks for data that does not exist) and which are not able to be actioned on. These did not replace any valid webhooks, and all valid webhooks have been sent.

We have identified the root cause of the processing delays and have released a fix. We are processing background jobs that were delayed and expect them to catch up as the day progresses.

We continue to see intermittent delays in background jobs.

We are seeing intermittent delays with queues today again and are investigating. We'll provide updates as we have them.

Job delays have returned to normal.