AWS Databricks Pyspark

Description

We are looking for a highly skilled AWS Databricks Pyspark Developer with 5-8 years of experience to join our team in Bangalore ,India. The ideal candidate will have a strong background in developing and maintaining large-scale data processing systems using AWS Databricks and Pyspark.

Responsibilities

• Design and develop data processing pipelines using AWS Databricks and Pyspark
• Develop and maintain ETL processes to transform raw data into meaningful insights
• Collaborate with cross-functional teams to design and implement data-driven solutions
• Optimize data processing workflows for performance and scalability
• Troubleshoot and resolve issues with data pipelines and ETL processes
• Document technical designs, data flows, and processes for future reference

Skills and Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 5-8 years of experience in developing and maintaining data processing systems using AWS Databricks and Pyspark
• Strong programming skills in Python and experience with data processing frameworks such as Apache Spark
• Experience with AWS services such as S3, EMR, and Glue
• Experience with data warehousing and ETL processes
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills