Prekid servisa GitHub 12. октобар

Incident with Actions, Pull Requests and Issues

1. Rešeno · 20:16

   On October 12th 2026 11:51 UTC GitHub experienced elevated 500 responses across several application pages. This caused failures on Issues and Pull Requests as well as Projects and Actions. Customers also experienced delayed notifications in their web inbox and via email. <br /><br />The immediate impact to Issues, Pull Requests, Projects, and Actions was mitigated by 12:41 UTC on October 12th. Notifications deliveries to the web inbox and via email were recovering at 15:27 UTC and fully mitigated by 20:16 UTC. <br /><br />The incident was triggered through a latent condition in our notifications delivery pipeline that put a high volume of an expensive query on our sharded database replicas. This reduced available database capacity to serve requests for Issues, Pull Requests, Projects, and Actions.<br /><br />We have fixed the notifications pipeline’s code path that issued the expensive query. We are also improving resilience of the database layer to reduce the likelihood and impact of similar incidents.

2. Istražuje se · 19:28

   Web and email notifications will be delayed for 1 more hour as we are close to completing the backlog of notifications.

3. Istražuje se · 17:34

   Web and email notifications continue to be delayed as we work through a backlog of notifications.

4. Istražuje se · 15:50

   Notifications have resumed but will continue to be delayed as we work through a backlog.

5. Istražuje se · 15:19

   We have successfully applied a mitigation for notifications, and notifications have resumed but will continue to be delayed as we work through a backlog.

6. Istražuje se · 14:37

   We have mitigated the issues with Actions, issues, and projects, and have a mitigation in progress to address the delay with notifications.

7. Istražuje se · 14:36

   The degradation affecting Actions has been mitigated. We are monitoring to ensure stability.

8. Istražuje se · 14:35

   The degradation affecting Issues has been mitigated. We are monitoring to ensure stability.

9. Istražuje se · 13:38

   Our initial mitigation was not fully successful, and users may still experience delays and errors with Actions, issues and projects, and notifications are delayed. We're continuing to investigate the root cause and work on additional mitigations.

10. Istražuje se · 13:02

    Pull Requests is operating normally.

11. Istražuje se · 12:57

    We have a mitigation in progress and are monitoring for recovery. Users may also experience delayed web notifications as we mitigate.

12. Istražuje se · 12:33

    Users may experience issues loading the Actions tab UI, interacting with the Checks API, queueing new Actions runs, creating and updating issues, and requesting PR reviews, including via REST and GraphQL APIs.

13. Istražuje se · 12:21

    We are investigating reports of degraded performance for Actions, Issues and Pull Requests