Automatic RDS SQL Server Cross-Region Fail-Over for HA/DR
Detecting RDS Unhealthy State
Leveraging CloudWatch, Route 53 HealthCheck and CLOUDBASIC API to Achieve Automatic Cross-Region Fail-Over
RDS SQL Server Disaster Recovery (DR) and High Availability (HA) with CLOUDBASIC Multi-AR™
Published: October 7, 2018
The overall strategy in this guide is based on the following high-level workflow:
"An RDS CloudWatch alarm goes into INSSUFICIENT DATA state" because the monitored RDS instance goes down
-> This condition triggers a "Route53 Health Check to FAIL"
-> This then triggers "A ROUTE 53 Health Check alarm to go into ALARM state"
-> This causes a notification to be send to an SNS topic
-> This triggers LAMBDA functions that are subscribers to the SNS topic to execute
-> The LAMBDA functions call CloudBasic API methods to configure the secondary RDS for Primary duties (activation of constraints, triggers, etc,) and to switch the Route53 record to point to the new Primary RDS instance
Here is how to setup the individual components needed for this workflow:
1. Setup a CloudWatch alarm for your RDS instance
a. Select the CPUUtilization metric and configure to look for condition of CPUUtilization > 100 %
b. Configure to look for "1 out of 1 datapoints"
c. Period to be "1 minute"
d. Configure Statistic to be "Standard" and select "Average"
2. Setup a Route53 Health check to monitor the RDS CloudWatch alarm
a. In the "What to monitor" select "State of CloudWatch" alarm
b. Under the "Monitor CloudWatch alarm" section select the AWS Region and the name of your RDS CloudWatch alarm
c. VERY IMPORTANT in the "Health check status" section, for the "When the alarm is in the INSUFFICIENT state" select the "the status is unhealthy" option
3. Set up a Route53 Health check alarm
a. Select the Route53 Health check you created in the last step
b. In the Alarms tab click on "Create alarm"
c. Under "Send notification" select "Yes"
d. Create a new SNS topic
e. Click on "Confirm"
4. Setup your Lambda functions as subscribers to the SNS topic
a. In the SNS service select the SNS topic you created in the previous step
b. In the "Subscriptions" section click the "Create subscription" button
i. Under "Protocol" select "AWS Lambda"
ii. Under "End point" select the Lambda function you would like to call
In our GitHub account you can find the sample code for a Lambda function that calls the CloudBasic API to promote a secondary RD to primary duties - https://github.com/cloudbasic/Lambda-API
Here is the code of a sample Lambda function that switches a Route53 record:
RDS\EC2 SQL Server Multi-AZ and Multi-AR (Cross-Region) Readable-Replicas for HA/DR, reporting, off-loading of primaries. On-Premise to AWS replication for Cloud HA/DR.
Amazing Product for RDS SQL Server replication
Cloudbasic RDS Always-On/Geo-Replicate for SQL Server provided us with just what we were looking for. It saved us a lot of time during our migration process by taking care of the database schema replication and keeping large amounts of data in sync. Also, the support has been amazing in terms of being available in-spite of the time zone differences. Read full review >>
Great product, fantastic support team!
We’re a small, growing company so our AWS budget is tight and the CloudBasic replication product is the perfect solution for our needs. This product has allowed us to implement a reliable, near real-time replication solution without resorting to expensive SQL Server/RDS replication solutions. The CloudBasic product has proven to be fast, reliable, easy to set up, use and manage.
Before our AWS migration we managed our own physical SQL Server installation and used SQL Server log shipping to sync our online and reporting databases with typical latencies of 15-30 minute range. With the CloudBasic solution our latencies are now in the 2-5 second range… Read full review >>
CloudBasic is an AWS Rockstar!
The CloudBasic RDS Always-On/Geo-Replicate for SQL Server solution is an absolute lifesaver when working with RDS SQL Server! SQL Server on RDS falls short in a lot of aspects when it comes to replication and disaster recovery, and this solution makes the process seamless. We’re able to migrate very large amounts of data and keep the in sync while we move applications around, as well as create usable read-replicas that RDS simply doesn’t provide. Anytime we’ve run into any snags in the process, CloudBasic support has been right there available to help get things going right away. I’m truly impressed with the product and the company behind it! Read full review >>
Great product, simplifies architecture and hassle free
CLOUDBASIC RDS Always-On/Geo-Replicate for SQL Server HA/DR/Redshift/S3 provided us a way to replicate multiple on site MSSQL DBs to other datacenters as well as Amazon RDS\EC2 and also from the cloud into our datacenters. After spending weeks of investigating how we could manage this using SQL’s own replication or writing our own replication jobs we found Cloudbasic. We were up and running within a hour and our DBA team could test replication paths hassle free and have full control over the source and destination DBs. The ability to replicate into SQL Web version saves us $10,000’s every year whilst maintaining the ability to have read\write replicas. The Cloudbasic support has been fantastic, helping us with any questions we have and also releasing new features to meet specific needs, we couldn’t ask for more from a product support group. I would highly recommend you trial this product if you are looking at any form of hybrid MSSQL replication and want the most cost optimised solution that works straight out the box (AMI). Read full review >>
Excellent product and support!
CloudBasic RDS AlwaysOn/Geo-Replicate for SQL Server HA/DR is an excellent product backed by great support. Using the pre-configured AMI we were up and running in minutes. Used CloudBasic to migrate SQL Server databases into RDS, followed by setting up cross-region Multi-AR RDS SQL replications for Disaster Recovery and Multi-AZ High Availability. It works well with RDS Multi-AZ, creates SQL Server read-replicas which can be used for reporting, data-locality and offloading of primary RDS SQL Servers. With help form the responsive CloudBasic support team we were able to migrate our databases with no down time. Setting up DR and HA was straightforward.
I strongly recommend the product and the CloudBasic advisory support team… Read full review >>
I’m really happy I found your product
I’m really happy I found your product as there are not many options for this sort of thing with RDS and SQL Server.
Does what it says on the box, easy to use, amazing support.
I found this tool when I was looking for a way to transfer databases between our development systems and our production systems. These comprised of a mix of in house physical SQL, EC2 SQL and and RDS. Cloudbasic Geo-replicate solved this problem.
The product improvements I asked for were implemented within days allowing me to extend our use of this product into our devops continuous delivery model.
Affordable SQL Server High Availability Solution
As a consultant I look for affordable and easy to maintain solutions for my customers. This SQL Server HA solution features a simple web interface. I did not have to worry about configuring server clusters, log shipping etc. I was able to setup a DB instance replication to a cross-region AlwaysOn RDS in minutes. I was pleasantly surprised that MSSQL Web Edition is also supported. I had to call for support related to DB issues on my end. I was assigned a dedicated support representative who proved to be very helpful. I did an extensive testing to ensure that this product is very reliable. With this product I am planning to scale up my Cloud Disaster Recovery implementation efforts.
Simple, Powerful, with Stellar Support
The software delivers what it promises. Its easy to use. The support is fantastic. We were impressed how fast they reached out to us to want to help. The software is fast, economical and affordable. It doesn’t put any stress on your source and destination databases. It seamlessly does what it does and it does it well. I highly recommend this product to anyone.
Simple cross-region RDS replication solution
We were looking for a way to continuously replicate our RDS based SQL Servers from west to east coast, for disaster recovery and reporting purposes. We started from looking for a SQL Server log shipping and high availability based solution ..then found CloudBasic’s Geo-Replicate server. We launched the server from the market place, entered RDS source and destination information and within minutes were able to stream data. The secondary DBs seeded very fast, and … Read All
Easy setup. Various deployment scenarios.
We were looking to utilize AWS as a fail-over site for our on-premise SQL Server based applications. We turned to the AWS Market place to find solutions to help us speed up implementation. Found this product, and within minutes were able to steam SQL Server data to an RDS SQL Server on AWS. All we had to do is enter source and destination SQL server connection strings. Then selected if we wanted a one time migration of the SQL server or also… Read full review >>
Works very well. Easy to use. Some minor issues need to be addressed.
We intended to use this software to do a one time migration of SQL databases from our co-located datacenter to AWS. Then figured it is very easy to setup continuous replication from East to West coast (AWS in California to AWS in Virginia). We currently use EC2 SQL Server Web edition in California, replicating to a small RDS Web Edition in Virginia… Read full review >>
Simple and inexpensive solution to replicate SQL Servers from West to East coast
Our customer base spans 100+ hospitals, including Tenet Healthcare, Baptist Health of South Florida and Texas Health Resources. We migrated our systems to AWS a year ago. Then shortly after, as part of our business continuity planning, selected the pre-AWS Marketplace version of CLOUDBASIC REPLICATE to … Read full review >>
Powerful Yet Simple Replication Solution
The most important feature we were looking for was to be able to access the end point of the replica for our reporting. This product replicates between SQL servers manages by us. We have to ensure the destination SQL Server is used in read-only mode, but this gives us the flexibility to setup replication in various scenarios: on-prem to AWS, across AWS regions, zone-to-zone. It does seem that SQL Server Web edition is supported in all scenarios as well… Read full review >>
CloudBasic SQL Migrate to RDS Solution
I used CloudBasic to Migrate my SQL2012 to an RDS 2012 instance. Install of CloudBasic was easy and once the connection strings were set on the CloudBasic Server webpage, my database connectivity was verified and the db migrated very fast to the RDS instance. CloudBasic is the easiest and fastest solution to replicate your data to an RDS instance for production and or testing. Thank You for making my job easier!!! Read full review >>
CloudBasic works great! Easy to setup and comes with outstanding support.
CloudBasic has a nice web user interface. There’s a quick setup feature to start replicating your databases in minutes after you setup the AMI from Amazon’s Marketplace. If you have any questions, RJ and their support team will go to great lengths to make sure CloudBasic gives you the ROI that you’re looking for in a database replication solution. Awesome product. Read full review >>