Hello
We are looking for Senior AWS Engineer Candidates for Hybrid ,Bengaluru Location.
Functional Title: Senior AWS Engineer/Lead
Location: 1st Floor, Shrutha Complex, Primrose Rd, Ashok Nagar, Bengaluru, Karnataka 560025
Start Date: ASAP
Work mode: 4 days/week in office
Job Description:
As a Senior Data Engineer, you will collaborate with Software Engineers, Data Scientists, and Business Intelligence Engineers to transform data into actionable insights. You will design and maintain data pipelines on AWS, optimize data processes, and ensure data security and quality. Your expertise will drive the integration of new data sources and the implementation of advanced technologies.
Key Responsibilities:
- Collaborate with cross-functional teams to understand data requirements and design optimal data solutions.
- Develop and maintain data pipelines and ETL processes on AWS.
- Implement data transformation, cleansing, and enrichment processes.
- Optimize data pipelines for performance, scalability, and cost-effectiveness using AWS services.
- Ensure data security and compliance with appropriate controls and encryption.
- Troubleshoot data pipeline issues and improve data quality.
- Design and build reusable components and frameworks for analytics.
- Implement automated workflows and CI/CD processes.
- Drive collaborative design, code, and test reviews.
- Mentor and develop other data engineers in best practices.
Technical Skills:
- Proficient in SQL, Spark, PySpark (4+ years), and Airflow (3+ years).
- Experience with AWS, GCP, or Azure.
- Skilled in creating/configuring Jenkins pipelines and building Docker images.
- Strong knowledge of Data Warehousing, Data Modeling, Governance, and Data Architecture.
- Experience with EMR, Airflow, Databricks, and Lakehouse Medallion architecture.
- Familiar with Agile and Scrum development processes.
- Experience with SQL databases, Presto, and Snowflake.
- Expertise in Streaming, Serverless, and Microservices Architecture.
Soft Skills:
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Capable of building positive relationships across teams.
- Self-motivated with a passion for data solutions.
