Financial Data Analytics on AWS

Case Study - S3 Data Lake/SAS scenario on AWS

CloudBasic makes vast historical data available for reporting and analytics in an AWS RDS/SQL Server to S3 Data Lake/SAS scenario and reduces TCO

AWS RDS/SQL Server to S3 Data Lake/SAS scenario

CloudBasic Multi-AR for SQL Server and S3 handles historical SCD Type 2 data feeding from RDS SQL Servers to S3 Data Lake/SAS Visual Analytics.

EXECUTIVE SUMMARY: OFX, a publicly-listed international payments service provider, recently migrated to AWS to optimize cloud architecture, achieve substantial savings in SQL Server licensing fees, and get a broad range of functional benefits thanks to readily available High-Availability Database Read-Replicas. A solution from CloudBasic enabled laying down vast historical data into S3 data lake without transforming it, enabling the company to absorb the data into SAS Visual Analytics for processing and visualization.


The Client

OFX, the premier name in international money transfers, is a publicly listed payments service provider with strong presence in multiple markets around the world. The company was originally established as OzForex in Australia in 1998 and today OFX is a consolidated global brand, powering the money transfer services of some of the best names in the financial services industry. To learn more about the company, visit https://www.ofx.com.

Recently the company deployed crucial financial IT infrastructure to the cloud, utilizing CloudBasic’s robust SQL Server replication technology to migrate its database servers to AWS.  (See Migration to AWS with High-Availability Case Study.)

The Case

The enormous amount of data that flows through the OFX systems calls for a sophisticated data analytics technology stack. Originally OXF deployed Informatica PowerCenter for ETL to Hadoop, when HDFS was used as the Data Lake and performed various transformations on the way in.

As the company systems evolved, OFX switched to using S3 as the Data Lake and Hadoop on demand. That change brought the challenge of bringing large sets of historical SCD Type 2 data, extracted from AWS RDS SQL Server, into S3 for the purpose of building BI reports based on SAS Visual Analytics.

The Solution

CloudBasic RDS Multi-AR for the Enterprise
View the benefits of CloudBasic RDS SQL Server tools for Enterprise migrations, DR, HA, Reporting, Data-Locality, EMR/Hadoop.

OFX identified the need for a tool that can handle the new generation Big Data systems, and chose CloudBasic Multi-AR as the right solution. With its low cost of maintenance and extensive self-service capabilities, CloudBasic Multi-AR is designed to be lightweight and purposely built form the ground up specifically for AWS RDS and S3/EMR/Hadoop in AWS environment.

After switching to using S3 as the Data Lake and Hadoop on demand, CloudBasic was instrumental in laying down historical SCD Type 2 data into S3. The key benefit is having the historical data laid down in a flexible managed data lake to pull from, run some heavy compute processes, and push back into S3. The solution allows OFX to absorb the data into SAS Visual Analytics for processing and visualization. Informatica Cloud remains available for specific application integrations and ETL processing.

The Results

Using S3 for storage instead of HDFS, and using Hadoop as a workload processor instead of running 24/7 on reserved instances, helps the company materialize substantial benefits.

Since CloudBasic Multi-AR was designed specifically to feed data from RDS/EC2 SQL Server to various other systems, it has a distinct advantage over general purpose big data systems designed to feed data form diverse sources. CloudBasic Multi-AR is easy to operate and maintain, as it naturally fits the AWS environment. It is launched from a preconfigured AMI in a VPC. Once activated, you operate the service in a browser just like with any other AWS service.

The necessary customization to fine tune the out-of-the-box product to the specific needs of OFX and SAS Visual Analytics processing was handled by CloudBasic Services, avoiding the need to hire a costly System Integrator. Ongoing support is also handled by CloudBasic.

For more information about CloudBasic and its cloud technology products and services, please contact CloudBasic.

You'll be in good company:

Amazing Product for RDS SQL Server replication

 

Cloudbasic RDS Always-On/Geo-Replicate for SQL Server provided us with just what we were looking for. It saved us a lot of time during our migration process by taking care of the database schema replication and keeping large amounts of data in sync. Also, the support has been amazing in terms of being available in-spite of the time zone differences. Read full review >>

Bernadette Hensley

Great product, fantastic support team!

We’re a small, growing company so our AWS budget is tight and the CloudBasic replication product is the perfect solution for our needs. This product has allowed us to implement a reliable, near real-time replication solution without resorting to expensive SQL Server/RDS replication solutions. The CloudBasic product has proven to be fast, reliable, easy to set up, use and manage.

Before our AWS migration we managed our own physical SQL Server installation and used SQL Server log shipping to sync our online and reporting databases with typical latencies of 15-30 minute range. With the CloudBasic solution our latencies are now in the 2-5 second range…  Read full review >>

Damien Hanna, Roomex Limited

CloudBasic is an AWS Rockstar!

The CloudBasic RDS Always-On/Geo-Replicate for SQL Server solution is an absolute lifesaver when working with RDS SQL Server! SQL Server on RDS falls short in a lot of aspects when it comes to replication and disaster recovery, and this solution makes the process seamless. We’re able to migrate very large amounts of data and keep the in sync while we move applications around, as well as create usable read-replicas that RDS simply doesn’t provide. Anytime we’ve run into any snags in the process, CloudBasic support has been right there available to help get things going right away. I’m truly impressed with the product and the company behind it! Read full review >>

Chris Kizziar

five-starsGreat product, simplifies architecture and hassle free

CLOUDBASIC RDS Always-On/Geo-Replicate for SQL Server HA/DR/Redshift/S3 provided us a way to replicate multiple on site MSSQL DBs to other datacenters as well as Amazon RDS\EC2 and also from the cloud into our datacenters. After spending weeks of investigating how we could manage this using SQL’s own replication or writing our own replication jobs we found Cloudbasic. We were up and running within a hour and our DBA team could test replication paths hassle free and have full control over the source and destination DBs. The ability to replicate into SQL Web version saves us $10,000’s every year whilst maintaining the ability to have read\write replicas. The Cloudbasic support has been fantastic, helping us with any questions we have and also releasing new features to meet specific needs, we couldn’t ask for more from a product support group. I would highly recommend you trial this product if you are looking at any form of hybrid MSSQL replication and want the most cost optimised solution that works straight out the box (AMI). Read full review >>

118118

five-starsExcellent product and support!

CloudBasic RDS AlwaysOn/Geo-Replicate for SQL Server HA/DR is an excellent product backed by great support. Using the pre-configured AMI we were up and running in minutes. Used CloudBasic to migrate SQL Server databases into RDS, followed by setting up cross-region Multi-AR RDS SQL replications for Disaster Recovery and Multi-AZ High Availability. It works well with RDS Multi-AZ, creates SQL Server read-replicas which can be used for reporting, data-locality and offloading of primary RDS SQL Servers. With help form the responsive CloudBasic support team we were able to migrate our databases with no down time. Setting up DR and HA was straightforward.

I strongly recommend the product and the CloudBasic advisory support team…  Read full review >>

Dev OPS

five-starsI’m really happy I found your product

I’m really happy I found your product as there are not many options for this sort of thing with RDS and SQL Server.

 

Daniel O’Connor, OpenAgent.com.au

five-starsDoes what it says on the box, easy to use, amazing support.

I found this tool when I was looking for a way to transfer databases between our development systems and our production systems. These comprised of a mix of in house physical SQL, EC2 SQL and and RDS. Cloudbasic Geo-replicate solved this problem.

The product improvements I asked for were implemented within days allowing me to extend our use of this product into our devops continuous delivery model.

Oniqua Cloud

five-starsAffordable SQL Server High Availability Solution

As a consultant I look for affordable and easy to maintain solutions for my customers. This SQL Server HA solution features a simple web interface. I did not have to worry about configuring server clusters, log shipping etc. I was able to setup a DB instance replication to a cross-region AlwaysOn RDS in minutes. I was pleasantly surprised that MSSQL Web Edition is also supported. I had to call for support related to DB issues on my end. I was assigned a dedicated support representative who proved to be very helpful. I did an extensive testing to ensure that this product is very reliable. With this product I am planning to scale up my Cloud Disaster Recovery implementation efforts.

Nick Semer, IT Consultant

five-starsSimple, Powerful, with Stellar Support

 

The software delivers what it promises. Its easy to use. The support is fantastic. We were impressed how fast they reached out to us to want to help. The software is fast, economical and affordable. It doesn’t put any stress on your source and destination databases. It seamlessly does what it does and it does it well. I highly recommend this product to anyone.

Otelz Development Team

five-starsSimple cross-region RDS replication solution

We were looking for a way to continuously replicate our RDS based SQL Servers from west to east coast, for disaster recovery and reporting purposes. We started from looking for a SQL Server log shipping and high availability based solution ..then found CloudBasic’s Geo-Replicate server. We launched the server from the market place, entered RDS source and destination information and within minutes were able to stream data. The secondary DBs seeded very fast, and … Read All

Radmeister, Inc.

five-starsEasy setup. Various deployment scenarios.

We were looking to utilize AWS as a fail-over site for our on-premise SQL Server based applications. We turned to the AWS Market place to find solutions to help us speed up implementation. Found this product, and within minutes were able to steam SQL Server data to an RDS SQL Server on AWS. All we had to do is enter source and destination SQL server connection strings. Then selected if we wanted a one time migration of the SQL server or also… Read full review >>

J.P., Solution Architect

five-starsWorks very well. Easy to use. Some minor issues need to be addressed.

We intended to use this software to do a one time migration of SQL databases from our co-located datacenter to AWS. Then figured it is very easy to setup continuous replication from East to West coast (AWS in California to AWS in Virginia). We currently use EC2 SQL Server Web edition in California, replicating to a small RDS Web Edition in Virginia… Read full review >>

John M.

five-starsSimple and inexpensive solution to replicate SQL Servers from West to East coast

Our customer base spans 100+ hospitals, including Tenet Healthcare, Baptist Health of South Florida and Texas Health Resources. We migrated our systems to AWS a year ago. Then shortly after, as part of our business continuity planning, selected the pre-AWS Marketplace version of CLOUDBASIC REPLICATE to … Read full review >>

Versant Holdings, LLC

five-stars-review-on-AWS-MarketplacePowerful Yet Simple Replication Solution

The most important feature we were looking for was to be able to access the end point of the replica for our reporting. This product replicates between SQL servers manages by us. We have to ensure the destination SQL Server is used in read-only mode, but this gives us the flexibility to setup replication in various scenarios: on-prem to AWS, across AWS regions, zone-to-zone. It does seem that SQL Server Web edition is supported in all scenarios as well… Read full review >>

George K.

five-starsCloudBasic SQL Migrate to RDS Solution

I used CloudBasic to Migrate my SQL2012 to an RDS 2012 instance. Install of CloudBasic was easy and once the connection strings were set on the CloudBasic Server webpage, my database connectivity was verified and the db migrated very fast to the RDS instance. CloudBasic is the easiest and fastest solution to replicate your data to an RDS instance for production and or testing. Thank You for making my job easier!!! Read full review >>

Tampa Bay Times

five-starsCloudBasic works great! Easy to setup and comes with outstanding support.

CloudBasic has a nice web user interface. There’s a quick setup feature to start replicating your databases in minutes after you setup the AMI from Amazon’s Marketplace. If you have any questions, RJ and their support team will go to great lengths to make sure CloudBasic gives you the ROI that you’re looking for in a database replication solution. Awesome product. Read full review >>

AnswerFirst Communications