This morning we identified delays in processing jobs for batch sending, routing (inbound mail), and mailing lists.
We were able to identify the issue as a sub-optimal database query in our new job queue that caused cascading slowdowns. We've since fixed the issue by utilizing a more efficient index as well as upgrading the version of the database we use which includes numerous improvements to the query planner.
We've been monitoring the new job queue since this morning and performance has returned to normal. We'll continue monitoring the job queue to ensure that a slowdown in delivery does not occur again.
Note, no inbound or outbound mail was lost as the new job queue was designed to be more robut in the case of failures such as the one that occurred in the morning.
-Mailgunners