Sự cố Basecamp ngày 29 tháng 9

Basecamp 5 and HEY are down

1. Đã khắc phục · 14:20

   This morning, power maintenance in our Ashburn datacenter caused our load balancers there to briefly stop serving customer traffic. That meant Basecamp and HEY were down for some customers in the U.S. and parts of Europe. Our three other datacenters remained online during the incident. After fixing the root cause, we noticed some lingering network instabilities. This led to increased errors with using Basecamp and HEY. Our Ops team quickly rolled out a fix for these as well. This was an avoidable problem. These devices should be resilient to this type of maintenance but were misconfigured. We’ve corrected the issue that caused today's incident to prevent this problem from recurring. We’re very sorry for interrupting your work today. If you have any questions, or if we can help in any way, please [reach out to our support crew](mailto:support@basecamp.com).

2. Đã khắc phục · 12:34

   Basecamp 5 and HEY are back up. We'll continue to monitor it to make sure it's stable. So sorry for the interruption today, folks.

3. Đang điều tra · 12:32

   Basecamp 5 and HEY are back up. We'll continue to monitor it to make sure it's stable. So sorry for the interruption today, folks.

4. Đang điều tra · 12:30

   Basecamp 5 and HEY are coming back online. We're actively monitoring both.

5. Đang điều tra · 12:26

   We've discovered the root cause and are actively working on a fix. No ETA yet, but we're on the case. Thanks for bearing with us, folks.

6. Đang điều tra · 12:20

   We're still investigating the trouble with Basecamp and HEY. We'll keep you posted here. We're so sorry, folks.

7. Đang điều tra · 12:10

   Basecamp and HEY are having trouble loading. We're looking into the root cause and will keep you posted here. We're so sorry for the interruption, everyone.