Customers in the Prod2, Prod3, and EU production clusters experienced page load errors when accessing Team Settings, Efficiency Profiles, and Efficiency Insights during a limited window on February 12, 11:30 PM PST to February 13, 2:21 AM PST.
No customer data was lost. Data ingestion, processing, and other core product capabilities remained fully operational throughout the incident. SEI 1.0 customers were not impacted.
During a production deployment, Harness team identified a process bug in the migration step. As a result, the application and database schema became temporarily out of sync. This schema mismatch caused specific pages (Team Settings, Efficiency Profiles, and Efficiency Insights) to fail to load properly.
The following functionalities were impacted during the incident window:
Users attempting to access these areas experienced page load errors.
Duration:
February 12, 11:30 PM PST – February 13, 2:21 AM PST
The following systems and capabilities remained fully operational:
No customer data was lost.
The issue was resolved by executing the required database migration procedure in the production environment, restoring synchronisation between the application and database.
To prevent recurrence and strengthen reliability, we are implementing the following improvements:
All production database migration steps will be integrated into our CI/CD deployment pipeline, eliminating manual execution and reducing the risk of human error.
We are converting schema validation into automated functional test coverage.
This ensures that any application–database mismatch is detected immediately during deployment.
We are enhancing our post deployment automation to detect and prevent such issues.