Resolved -
Our upstream provider (Heroku/Salesforce) has marked the issues as resolved. The end of impact is stated as 05:00 UTC, June 11, 2025.
We observed occasional timeouts and increased load, especially until 13:00 CET. All our affected services — API, ID, Redis, and login — are now operational and accessible.
We expect systems to run smoothly going forward. We continue to monitor the situation closely and are investigating the number of potentially affected measurement values. Further updates will follow, including any additional information from Heroku/Salesforce regarding the root cause.
Jun 11, 16:21 CEST
Update -
We are continuing to monitor for any further issues.
Jun 11, 16:18 CEST
Monitoring -
The upstream provider implemented a fix is in the progress of deploying the fix globally.
We restarted all affected services and are monitoring our systems closely.
Jun 11, 07:56 CEST
Identified -
The upstream provider is implementing a solution to the identified problem.
Due to these changes, it appears that all Netilion services (including the API) experienced a major outage between 16:45 and 18:17 CET.
We are now seeing lower error levels in the affected applications.
The next update will be provided during Freiburg/Reinach office hours.
Jun 10, 21:30 CEST
Update -
Our upstream provider believes that the root cause has been found and is working on a mitigation.
We do not have an ETA for resolution.
Jun 10, 17:10 CEST
Update -
Our upstream provider is still investigating the issue.
Jun 10, 14:05 CEST
Update -
We still see issues with our upstream providers.
At the moment we see that the ID Application (responsible for Login into Netilion) is affected more than the other applications.
Jun 10, 10:20 CEST
Investigating -
Currently we see an increase in response time and an increase in errors at the upstream infrastructure provider.
We will inform again in 1h (10am CET).
Jun 10, 09:07 CEST