Big Data & Analytics Blog

News and views from the team at Keylink

High-Performance Amazon Redshift & Amazon S3 Connectivity Solution

Tuesday, November 10, 2015

The last few years have seen a dramatic rise in the use of cloud computing services in the enterprise, and the acknowledged leader of the pack in this area is Amazon Web Services (AWS) with over 1 million customers in 190 countries.

It can be difficult to keep up to date with the range of capabilities that AWS offers, it seems like there are new services being added almost every week. However, two of the more popular ones are Amazon Redshift - a fast, fully managed, petabyte-scale data warehouse service, and Amazon Simple Storage Service (Amazon S3) - for secure, durable, highly-scalable object storage.

Organisations with a considerable investment in existing on-premise infrastructure are often looking for a cost-effective tool to get large volumes of data into and out of these cloud services quickly and easily. You’ll find things can start to get a bit complex when you need to do something like blend customer order data from the company website (landed to S3 in JSON format) with customer demographic data from an on-premise Teradata warehouse, then run a number of complex analytical queries on the blended data in Redshift, and output the results to Tableau for reporting to business users.

We find a fast, simple solution for this type of requirement is Syncsort DMX which offers high-performance Amazon Redshift and Amazon S3 connectors out of the box along with an easy to use graphical user interface. These aren’t just generic ODBC or JDBC connectors either, but have been specifically engineered for speed, security and reliability. The Redshift connector for example, will automatically create multiple parallel data streams when bulk-loading to your Redshift cloud data warehouse, delivering significant performance gains compared with a standard ODBC/JDBC connection.

In fact DMX comes with a range of high-speed connectors to almost any business system, from flat file (CSV, XML, JSON), to database (Teradata, Oracle, SQL Server, DB2) to Mainframe, to Big Data (Hadoop HDFS and NoSQL) and Business Intelligence software such as Tableau and Qlikview. So whatever format your data is in and wherever it’s located, Syncsort DMX can collect, prepare, blend, transform and distribute your data seamlessly.

Like to test the range of cloud and on-premise connectivity options for yourself?

Take a 30-day software trial of Syncsort DMX >

Syncsort DMX

Need Help?

Struggling with data integration, ETL, Hadoop, dashboards? We can help.

Our ProductsContact us