Monitoring and logging Part 2 - Cloudwatch & S3

This workshop has been deprecated and archived. The new Amazon EKS Workshop is now available at www.eksworkshop.com.

Let’s head over to cloudwatch logs.

open the log group /emr-on-eks/eksworkshop-eksctl and filter stream by driver/stdout:

EMR on EKS cloudwatch logs

Now click on the log stream and you will be able to see the output of the job.

EMR on EKS cloudwatch logs

You can also go to the s3 bucket that we configured for logging and see the logs.

EMR on EKS cloudwatch logs

Download the stdout.gz file and extract it.

You should be able to find its contents similar as below:

Pi is roughly 3.138760