About Client:
Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84,000 entrepreneurial professionals across more than 30 countries, it caters to over 700 clients with its extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes.
Job Description:
- Develop AWS data pipelines in AWS cloud environment.
- Strong knowledge in writing, understanding and debugging complex SQL and PG/ PLSQL scripts.
- Use transformation logics in AWS Glue/Pyspark with dataframes handling structured data/semi structured data.
- Good working knowledge in Snowflake data warehouse.
- Knowledge of DBT will be a plus.
- Experienced in debugging, diagnosing and troubleshooting Medium/complex production code.
- Develop various AWS services such as Glue, RDS,Redshift, Lambda etc., services.
- Strong hands-on experience in native AWS Glue ETL engineering, S3, Redshift Database, integration with other native AWS services and CICD using Python, pyspark and AWS APIs.
- Hands-on experience in any User defined functions in Lambda, EC2 Instances type &; Details, Secret Manager Ids, Roles and policies (Inline policies), Lifecycle Policies at bucket level and S3 Glacier details, Code commit repositories, SNS system etc.
- Good to have knowledge in developing and maintaining data pipelines using AWS Cloud formation.
- Guide Team to ensure success in building and migrating applications, software and services following the principles of the AWS Well-Architected Framework.
- Experience building and optimizing AWS data pipelines, architectures and data sets.
- Experience in automation and provisioning services on AWS.
- Capture and share best-practice knowledge among the AWS solutions architecture community
- AWS solutions architect and/or AWS developer certification is preferred.
- Strong communication skills
- Should have worked on at least 3-4 End-to-End Implementations/ Projects.
