Projects
Assignments
Overview
Big Data on AWS introduces you to cloud-based big data solutions such as Amazon Elastic MapReduce (EMR), Amazon Redshift, Amazon Kinesis and the rest of the AWS big data platform. In this certification & training course, we show you how to use Amazon EMR to process data using the broad ecosystem of Hadoop tools like Hive and Hue. We also teach you how to create big data environments, work with Amazon DynamoDB, Amazon Redshift, Amazon QuickSight, Amazon Athena and Amazon Kinesis, and leverage best practices to design big data environments for security and cost effectiveness.
Objectives
At the end of Big Data on AWS training course, participants will be able to
Prerequisites
We recommend that attendees of this course have the following prerequisites:
- Basic familiarity with big data technologies, including Apache Hadoop, HDFS, and SQL/NoSQL querying.
- Students should complete the Big Data Technology Fundamentals web-based training or have equivalent experience.
- Working knowledge of core AWS services and public cloud implementation.
- Students should complete the AWS Essentials course or have equivalent experience.
- Basic understanding of data warehousing, relational database systems, and database design.
Course Outline
Day 1edforce2022-07-15T16:43:29+05:30
- Overview of Big Data
- Ingestion
- Big Data streaming and Amazon Kinesis
- Using Kinesis to stream and analyze Apache server logs
- Storage Solutions
- Querying Big Data using Amazon Athena
- Using Amazon Athena to analyze log data
- Introduction to Apache Hadoop and Amazon EMR
Day 2edforce2022-07-15T16:44:59+05:30
- Using Amazon Elastic MapReduce
- Storing and Querying Data on DynamoDB
- Hadoop Programming Frameworks
- Processing Server Logs with Hive on Amazon EMR
- Streamlining Your Amazon EMR Experience with Hue
- Running Pig Scripts in Hue on Amazon EMR
- Spark on Amazon EMR
- Processing New York Taxi dataset using Spark on Amazon EMR
