A few trial Current Gen(CG) CD customers had difficulty Login and accessing Harness Secret Manager in our Prod-2 environment. There was no impact on Next Gen(NG) customers.
| Time (UTC) | Event |
|---|---|
| 04:22 am | We received internal alerts for an increased error rate related to Secret Manager. |
| 06:09 am | An incident was raised when a trial customer reached out. |
| 06:28 am | The root cause was identified. |
| 07:34 am | Incident was resolved |
Upon referencing the code base, we identified a key configuration missing in our database records. The required data was restored from periodic snapshots.
As a part of the official EOL for CG CD, a cleanup activity in the backend database for all internal accounts was done. In the cleanup process, a legacy configuration which the Harness Secret Manager used was deleted.
We will perform stringent checks on data before cleanup, followed by sanity to ensure no functionality gets impacted.