Prod2: Multiple Pipeline executions are getting stuck

Incident Report for Harness

Resolved

Issue has been resolved.

Posted Dec 29, 2025 - 10:52 PST

Update

We are continuing to monitor for any further issues.

Posted Dec 29, 2025 - 09:18 PST

Monitoring

A fix has been implemented and we are monitoring the results.

Posted Dec 29, 2025 - 08:38 PST

Update

The issue has been resolved, and we’re currently aborting the stuck executions

Posted Dec 29, 2025 - 07:42 PST

Update

Issue has been identified and a fix is being rolled out. New Pipelines should run fine and existing stuck pipelines are being aborted.

Posted Dec 29, 2025 - 07:34 PST

Identified

The issue has been identified and a fix is being implemented.

Posted Dec 29, 2025 - 07:32 PST

Update

We are continuing to investigate this issue.

Posted Dec 29, 2025 - 07:23 PST

Investigating

We are currently investigating this issue.

Posted Dec 29, 2025 - 07:22 PST

This incident affected: Prod 2 (Continuous Delivery - Next Generation (CDNG), Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Security Testing Orchestration (STO)).