There was a delay in newly published artifacts showing up in Harness. Impact was limited to few customers in one of our clusters (prod-1).
To mitigate, we purged old redundant background job records which were slowing down the collection process.
There was up to a 30 minute delay in our system for collecting newly published artifacts. The typical delay is less than 4 minutes. The slow collection was due to a spike in the backlog of background job requests in our database. To mitigate, we purged old redundant background job records, and the system caught up automatically. The actual cause of build up of the background jobs is unknown. We have added more aggressive alerts in the system for the job queue build up.