Resolved -
Between 00:30 AEST and 12:15 AEST on October 9, our backend data processing pipeline experienced an interruption that temporarily stopped recording monitoring messages.
The issue was traced to an incompatibility in Apache Beam 2.67, which caused Google Dataflow to halt message processing. After upgrading to Apache Beam 2.68, normal operation resumed and data ingestion returned to expected levels.
All systems are now fully operational. We are continuing to monitor message throughput and have implemented additional alerts to detect silent processing stalls in the future.
Oct 8, 13:00 UTC