Tsayawar Basecamp a September 29

Basecamp 5 and HEY are down

1. An warware · 2:20 PM

   This morning, power maintenance in our Ashburn datacenter caused our load balancers there to briefly stop serving customer traffic. That meant Basecamp and HEY were down for some customers in the U.S. and parts of Europe. Our three other datacenters remained online during the incident. After fixing the root cause, we noticed some lingering network instabilities. This led to increased errors with using Basecamp and HEY. Our Ops team quickly rolled out a fix for these as well. This was an avoidable problem. These devices should be resilient to this type of maintenance but were misconfigured. We’ve corrected the issue that caused today's incident to prevent this problem from recurring. We’re very sorry for interrupting your work today. If you have any questions, or if we can help in any way, please [reach out to our support crew](mailto:support@basecamp.com).

2. An warware · 12:34 PM

   Basecamp 5 and HEY are back up. We'll continue to monitor it to make sure it's stable. So sorry for the interruption today, folks.

3. Ana bincike · 12:32 PM

   Basecamp 5 and HEY are back up. We'll continue to monitor it to make sure it's stable. So sorry for the interruption today, folks.

4. Ana bincike · 12:30 PM

   Basecamp 5 and HEY are coming back online. We're actively monitoring both.

5. Ana bincike · 12:26 PM

   We've discovered the root cause and are actively working on a fix. No ETA yet, but we're on the case. Thanks for bearing with us, folks.

6. Ana bincike · 12:20 PM

   We're still investigating the trouble with Basecamp and HEY. We'll keep you posted here. We're so sorry, folks.

7. Ana bincike · 12:10 PM

   Basecamp and HEY are having trouble loading. We're looking into the root cause and will keep you posted here. We're so sorry for the interruption, everyone.