Search by job, company or skills

**********

Data Engineer

Company name confidential
Quick Apply
  • a month ago
  • Over 200 applicants

Job Description

Positions Open: AWS with Glue Developer, Snowflake with Python, GCP with Big Query, Azure Data Engineer.

JD of the profiles mentioned below:

AWS withGlueDeveloper:

Exp: 5 to 12 yrs

Location: Mumbai/Pune/Chennai/Bengaluru/Hyderabad

Skill:AWSandGlue

  • Minimum 5 years of experience withAWSdevelopment.
  • Hands on experience on Technical skills especially AWSGlue, Pyspark programming and Postgres SQL
  • Strong exposure in Relational Databases, i.e. MS SQL and Postgres SQL
  • Good in SQL, PL/SQL, DDL, DML Commands.
  • Hands on experience inAWSservices i.e. AWSGlue, SCT, DMS, RDS/Aurora. Cloud Watch,AWSSDK/CLI etc.
  • Good understanding ofAWSSecurity best practices
  • Strong analytical & troubleshooting skills
  • Excellent communication skills and proven customer consulting experience
  • Working knowledge in Agile and traditional SDLC project execution methodologies
  • Technical Skills :AWSAurora;AWSRDS;AWSDynamo DB;AWSS3; Lambda; AWSGlue;AWSStep Functions;AWSEventBridge; Python; PySpark; SQL; Data Migration

GCP and BigqueryDeveloper:

Exp: 5 to 12 yrs

Location: Mumbai/Pune/Chennai/Bengaluru/Hyderabad

Skill: GCP and Bigquery

  • Skill: GCP and Bigquery
  • strong Experience in GCP and Big Query.
  • Strong proficiency in Python with an emphasis in building data pipelines.
  • Ability to write complex SQL to perform common types of analysis and aggregations
  • Detail-oriented and document all the work
  • Ability to work with others from diverse skill sets and backgrounds
  • Strong proficiency in Python with an emphasis in building data pipelines

Profile:Snowflake and Python

  • Minimum 5 years of experience withSnowflake development.
  • Data Warehouse is a must. Design and implement effective Analytics solutions and models withSnowflake.
  • Knowledge ofSnowSQL, SQL, BTEQ is a must.
  • Additional experience in Migrating Legacy RDBMS such as TD, Oracle toSnowwill be good to have.
  • Will be designing, developing and responsible for implementation inSnowflake.
  • Will be loading and Migrating data from Teradata data sets and translating complex. functionality. Knowledge ofSnowSQL,SnowArchitecture is a must have.
  • Good to have : Knowledge of Migration project, Certification inSnowflake.
  • Strong programming language usingSnowflakeSnowSQL andSnowpipe is a must
  • Experience in handling semi structured XML JSON data inSnowflake
  • Experience in Stages Streams Tasks External Tables is a mandate
  • Working Knowledge of Pythonscripting is desirable
  • Experience in creatingSnowflake Procedures UDFs
  • Experience in Query Optimization techniques is desirable
  • Strong experience in SQL and advanced SQL

Azure Data Engineer

  • Minimum 5 years of experience with Azuredevelopment.
  • High proficient w/ Azuredata technologies including AzureData Factory, Databricks, AzureSynapse Analytics
  • Strong proficiency in SQL and complex queries
  • Deep experience in Data Analysis, including source data analysis, data profiling and mapping
  • Good experience in building data pipelines using ADF/AzureDatabricks, Synapse, PySpark, Scala
  • Proven hands-on experience with a large-scale data warehouse
  • Hands-on data migration experience from legacy systems to new solutions, such as from on-premises clusters to Cloud
  • Ability to learn and adapt to new data technologies
  • Knowledge on US healthcare industry/Pharmacy data is an added advantage
  • Work with other Azurestack modules like AzureData Lakes, SQL DW, etc.
  • Having knowledge on pyspark and python using Azurenotebook
  • Expert level knowledge on AzureData Factory/AzureData Bricks
  • Knowledge of otherAzure

Skills Required

Login to check your skill match score

Login

Date Posted: 01/11/2024

Job ID: 98838359

Report Job

Hi , want to stand out? Get your resume crafted by experts.

Similar Jobs

Data Engineer Only Hyderabad Candidate

Infec Services Private LimitedCompany Name Confidential

Azure Data Engineer

Capgemini Technology Services India LimitedCompany Name Confidential
Last Updated: 12-11-2024 05:00:24 AM