Data Lake, Firehose, Glue, Athena, S3 and AWS SDK for .NET

Data Lake, Firehose, Glue, Athena, S3 and AWS SDK for .NET

• The purpose of this class is to demonstrate a proof of concept using a series of lab exercise's (in the AWS Console using AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK, with C# code using the AWS SDK) of building a Data Lake in the AWS ecosystem.

• In this class, we will be sending data from a local SQL Server database to AWS RDS securely, and automatically.

• I am utilizing the .NET SDK for AWS, however, this could easily be migrated to your language of choice once you understand the concepts that I am teaching.

• I will be providing the full working source code of this proof of concept.

• I will also provide a working example of creating Parquet files and sending to S3 (without using Firehose).

Leverage AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK to build a Data Lake.

Url: View Details

What you will learn

• How to build a Data Lake using Firehose API for .NET, S3, AWS Glue and Athena

Rating: 4.25

Level: All Levels

Duration: 2 hours

Instructor: Darren Cox