The migration is completed. We'll be monitoring the system closely over the weekend for any lingering issues. We'll have a post up this week with a summary and postmortem.
Posted Aug 19, 2017 - 13:31 PDT
Update
The processing pipeline is now fully recovered and operational.
Posted Aug 19, 2017 - 13:07 PDT
Update
We're working to clear a processing backlog that was caused by side effects of the DNS issue.
Posted Aug 19, 2017 - 12:25 PDT
Update
We're fixing a DNS issue affecting rollbar.com in some geo regions. Fix is rolling out. API tier is not affected.
Posted Aug 19, 2017 - 11:48 PDT
Verifying
The main stages of the migration are complete. The web tier (including realtime updates), API tier, and processing pipeline are all operational. We're working through a few remaining noncritical issues across the system.
Posted Aug 19, 2017 - 11:44 PDT
Update
Notifications are caught up. The processing pipeline is fully operational.
Posted Aug 19, 2017 - 11:40 PDT
Update
The web tier is up to date (aside from realtime updates via websockets), but notifications are paused. We're fixing this now.
Posted Aug 19, 2017 - 11:25 PDT
Update
Processing pipeline is at about 5 minutes latency and catching up (from ~10min latency at peak during maintenance).
Posted Aug 19, 2017 - 11:16 PDT
Update
Web tier is back online.
Posted Aug 19, 2017 - 11:13 PDT
Update
API tier is mostly stable. Web tier will be in maintenance mode for the next few minutes.
Posted Aug 19, 2017 - 10:58 PDT
Update
Still experiencing some 502s on the API tier. We're working to fix asap.
Posted Aug 19, 2017 - 10:50 PDT
Update
502s issue is fixed; API tier is functional again.
Posted Aug 19, 2017 - 10:47 PDT
Update
We're fixing an issue where the API tier is returning 502s. Will be fixed in a minute or so.
Posted Aug 19, 2017 - 10:46 PDT
Update
We're starting the migration process now.
Posted Aug 19, 2017 - 10:37 PDT
Update
The migration hasn't started yet as we're still working through our pre-maintenance checklist. We now plan to start the maintenance at 10:00 PDT (1 hour later than planned). We still expect the migration itself to take around 20 minutes.
Will provide another update when the migration starts.
Posted Aug 19, 2017 - 09:31 PDT
In progress
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted Aug 19, 2017 - 09:00 PDT
Scheduled
Starting at 9 am PDT, we will be migrating many of our databases and app servers to a new datacenter. During this time, the API tier will still gather and accept occurrence data however the REST API will be put into read-only mode. The web tier will also be put into read-only mode and it's likely that it will be unavailable during the migration.
We expect the migration to take up to 20 minutes. During this time, processing delays will increase and notifications will be delayed. We will update this page with progress info during the process.