AWS EMR Engineer

Job Title : AWS EMR

Location : PAN India

Experience : 4 to 9 years

Skills : AWS, EMR Clusters, Terraform, IAC, IaaS

Job Description :

Minimum 2-6 years of experience in AWS technologies.

Setting up and managing EMR clusters for processing large-scale data using frameworks like Apache Hadoop, Apache Spark, Apache Hive, etc.

Configuring EMR clusters based on specific requirements, including choosing the appropriate instance types, storage configurations, and software settings.

Implementing and optimizing data processing workflows on EMR clusters, leveraging distributed computing frameworks for tasks such as data cleansing, transformation, and analysis.

Writing scripts and code to interact with EMR clusters, often using languages like Python, Java, or Scala, to develop and execute data processing jobs.

Integrating EMR with other AWS services, such as Amazon S3 for storage, AWS Glue for ETL (Extract, Transform, Load), AWS Lambda and other complementary services to create end-to-end data pipelines.

Optimizing cluster performance by fine-tuning configurations, adjusting resource allocation, and implementing best practices for efficient data processing.