Delivery Module Lead- Data bricks

About the Company:

ARA's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology know how, domain, and process expertise. The accolades that the company has been garnering can be attributed to its undeterred focus on delivering quality solutions across verticals that meet the challenging requirements of its esteemed customers. Recently, it has been felicitated by the Economic Times as the most distinguished digital company of 2015. It has also been ranked 29th among the 100 largest financial technology vendors by American Banker and BAI in the FinTech Forward Top 100 rankings.

The Role:

We are looking for a data bricks lead engineer (developer), having strong software development experience of5 to 8 years on AWS, Kubernetes, Python andDataBricks.

Key Responsibilities:

• Candidate must have hands on experience in AWS Data Databricks
• Good development experience using Python/Scala, Spark SQL and Data Frames
• Hands-on with Databricks, Data Lake and SQL knowledge is a must.
• Performance tuning, troubleshooting, and debugging SparkTM

Skills Required:

Technical Skills:

• Strong knowledge & hands-on experience inAWS Data Bricks
• Experience in AWS S3, Redshift, EC2,OpenSearch,Secrets Manager, VPC,DynamoDB, SNS and Lambda services
• Extensive experience in developing and deploying Bigdata pipelines
• Strong experience in Kubernetes.
• Experience in Azure data lake
• Strong hands on in SQL developmentand in-depth understanding of optimization and tuning techniques in SQL with Redshift
• Development inNotebooks(like Jupyter, DataBricks, Zeppelin etc)
• Development experience inSpark/Pyspark
• Experience working as a lead engineer.
• Experience in programming language likepythonornode.jsand any other programming language.

Process Skills:

• Agile Scrum

Behavioral Skills:

• Result oriented team player
• Good in communication
• Interpersonal skills

Qualifications & Experience:

• Bachelor of Engineering (Computer background preferred)