Ganesh Muni

AWS Kinesis Data Firehose

Lots of data in petabyte scale is generated every moment and to analyze these data quickly is getting tough for organizations. Streaming data makes the job even more complex. AWS comes with a solution called Kinesis, which is capable to collect, process and analyze real-time streaming data, so that we can get timely insights and react accordingly.

Automate Data Pipeline with Glue, Lambda and CloudWatch

Abstract Data pipeline is a set of operations, starting from getting data, transforming them and moving them to required destination for process and analysis. In Amazon we have Redshift, a petabyte scale data warehouse, where the data is stored for faster analysis. Data can be moved to Redshift swiftly from Amazon S3 with copy command …

Automate Data Pipeline with Glue, Lambda and CloudWatch Read More »