AWS ETL Data Engineer

Job Description:

AWS ETL Data Engineer experienced in designing and implementing robust data pipelines and ETL workflows in AWS. The ideal candidate will possess strong skills in Python, SQL, and AWS services, with a focus on efficient data integration, transformation, and automation.

Location :

Chennai,Hyderabad,Banglore

Key Responsibilities:

• Develop, maintain, and optimize data pipelines on AWS using S3, Glue, Lambda, Redshift, and DynamoDB.
• Implement workflow orchestration using Airflow to streamline ETL processes.
• Leverage CloudWatch for monitoring and IAM for secure access management.
• Utilize VPC and Secret Manager to ensure data security and compliance.
• Apply DBT and Python for data transformation, testing, and modular pipeline development.
• Collaborate on data modelling and architecture to support data-driven decision-making across teams.
• Work with DevOps team to manage the deployment.
• Should be able to pick the data model from the DB team and define the extractions methods which can be from various DBs, excel or JSON files.
• Should be able to interact with business users, team leads, product owner and work on the solutioning under minimum guidance.

Skills & Qualifications:

Hands-on working skills in AWS services, specifically S3, Glue, Lambda, Redshift.

Should have good understanding of DynamoDB, VPC, IAM, and Secret Manager.

Hands-on experience with Python&Pyspark for scripting, automation, and data transformation.

Familiarity with data modelling concepts and tools such as DBT for analytics and transformation.

Experience using Airflow for scheduling and orchestrating ETL workflows.

Strong knowledge of SQL for querying and data manipulation.