DB and app server migration
Scheduled Maintenance Report for Rollbar
Completed
The migration is completed. We'll be monitoring the system closely over the weekend for any lingering issues. We'll have a post up this week with a summary and postmortem.
Posted 4 months ago. Aug 19, 2017 - 13:31 PDT
Update
The processing pipeline is now fully recovered and operational.
Posted 4 months ago. Aug 19, 2017 - 13:07 PDT
Update
We're working to clear a processing backlog that was caused by side effects of the DNS issue.
Posted 4 months ago. Aug 19, 2017 - 12:25 PDT
Update
We're fixing a DNS issue affecting rollbar.com in some geo regions. Fix is rolling out. API tier is not affected.
Posted 4 months ago. Aug 19, 2017 - 11:48 PDT
Verifying
The main stages of the migration are complete. The web tier (including realtime updates), API tier, and processing pipeline are all operational. We're working through a few remaining noncritical issues across the system.
Posted 4 months ago. Aug 19, 2017 - 11:44 PDT
Update
Notifications are caught up. The processing pipeline is fully operational.
Posted 4 months ago. Aug 19, 2017 - 11:40 PDT
Update
The web tier is up to date (aside from realtime updates via websockets), but notifications are paused. We're fixing this now.
Posted 4 months ago. Aug 19, 2017 - 11:25 PDT
Update
Processing pipeline is at about 5 minutes latency and catching up (from ~10min latency at peak during maintenance).
Posted 4 months ago. Aug 19, 2017 - 11:16 PDT
Update
Web tier is back online.
Posted 4 months ago. Aug 19, 2017 - 11:13 PDT
Update
API tier is mostly stable. Web tier will be in maintenance mode for the next few minutes.
Posted 4 months ago. Aug 19, 2017 - 10:58 PDT
Update
Still experiencing some 502s on the API tier. We're working to fix asap.
Posted 4 months ago. Aug 19, 2017 - 10:50 PDT
Update
502s issue is fixed; API tier is functional again.
Posted 4 months ago. Aug 19, 2017 - 10:47 PDT
Update
We're fixing an issue where the API tier is returning 502s. Will be fixed in a minute or so.
Posted 4 months ago. Aug 19, 2017 - 10:46 PDT
Update
We're starting the migration process now.
Posted 4 months ago. Aug 19, 2017 - 10:37 PDT
Update
The migration hasn't started yet as we're still working through our pre-maintenance checklist. We now plan to start the maintenance at 10:00 PDT (1 hour later than planned). We still expect the migration itself to take around 20 minutes.

Will provide another update when the migration starts.
Posted 4 months ago. Aug 19, 2017 - 09:31 PDT
In progress
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted 4 months ago. Aug 19, 2017 - 09:00 PDT
Scheduled
Starting at 9 am PDT, we will be migrating many of our databases and app servers to a new datacenter. During this time, the API tier will still gather and accept occurrence data however the REST API will be put into read-only mode. The web tier will also be put into read-only mode and it's likely that it will be unavailable during the migration.

We expect the migration to take up to 20 minutes. During this time, processing delays will increase and notifications will be delayed. We will update this page with progress info during the process.
Posted 4 months ago. Aug 18, 2017 - 10:49 PDT