We use cookies to try and give you a better experience in Freshdesk.
You can learn more about what kind of cookies we use, why, and how from our Privacy policy. If you hate cookies, or are just on a diet, you can disable them altogether too. Just note that the Freshdesk service is pretty big on some cookies (we love the choco-chip ones), and some portions of Freshdesk may not work properly if you disable cookies.
We’ll also assume you agree to the way we use cookies and are ok with it as described in our Privacy policy, unless you choose to disable them altogether through your browser.
Geofencing halted (April 22–23, 2026)
Summary
Geofencing and activity generation stopped for all customers overnight. This caused delayed arrival and departure reporting across Port services.
All processing has been restored, and data has been reprocessed without loss.
Affected services
Port, Monitor and third-party webhook integrations
What happened
A peripheral dependency became unavailable, which disrupted the processing of incoming vessel position messages. Due to insufficient retry and recovery logic, this caused all processing nodes to stop handling real-time geofencing data.
As a result, location messages accumulated in the processing pipeline instead of being handled, leading to a growing backlog and halted activity generation across the system.
Impact
No activities were generated during the incident period, resulting in delays in arrival and departure reporting.
Timeline (UTC)
20:40 – Processing lag increasing
20:55 – Alert triggered (not handled as expected)
07:40 – Incident identified
07:55 – Mitigation started (nodes restarted and scaled for backlog processing)
16:00 – Processing backlog cleared and system normalized
Root cause
A service interruption in an external dependency, combined with insufficient error handling and recovery mechanisms, caused processing to halt across all nodes.
Follow-up actions
Improved retry and recovery mechanisms
Improved monitoring and alert response
Review of handling for external dependencies
0 Votes