Search by job, company or skills
Information Technology
Job Title : AWS EMR
Location : PAN India
Experience : 4 to 9 years
Skills : AWS, EMR Clusters, Terraform, IAC, IaaS
Job Description :
Minimum 2-6 years of experience in AWS technologies.
Setting up and managing EMR clusters for processing large-scale data using frameworks like Apache Hadoop, Apache Spark, Apache Hive, etc.
Configuring EMR clusters based on specific requirements, including choosing the appropriate instance types, storage configurations, and software settings.
Implementing and optimizing data processing workflows on EMR clusters, leveraging distributed computing frameworks for tasks such as data cleansing, transformation, and analysis.
Writing scripts and code to interact with EMR clusters, often using languages like Python, Java, or Scala, to develop and execute data processing jobs.
Integrating EMR with other AWS services, such as Amazon S3 for storage, AWS Glue for ETL (Extract, Transform, Load), AWS Lambda and other complementary services to create end-to-end data pipelines.
Optimizing cluster performance by fine-tuning configurations, adjusting resource allocation, and implementing best practices for efficient data processing.
Role:Team Leader/Technical Leader, Software Engineer/Programmer
Industry:Information Technology
Function:IT
Job Type:Permanent Job
Date Posted: 26/09/2024
Job ID: 94273989