Lead Software Engineer

Requirements:

7+ years of experience in software development experience using Java and PySpark

2+ years of experience in designing, developing and optimizing data pipelines and jobs using PySpark and Apache Spark framework

2+ years of experience in application support and maintenance of PySpark applications.

2+ years of experience in designing and implementing data workflows with Apache Airflow.

2+ years of experience in performance tuning techniques for large-scale data processing.

2+ years of experience in handling implementations involving data storage, and database querying using Spark SQL, PostgreSQL

5+ Years Experience with Apache Spark: Candidates should possess proficiency in utilizing the Apache Spark framework, particularly the Spark SQL module for database querying.

Proficiency in Python and Java: Applicants must demonstrate expertise in one or more of these programming languages, as they are supported by Apache Spark APIs and are essential for executing processes with Apache Spark.

Adherence to clean coding principles: Candidates should be capable of producing code that is devoid of bugs and can be easily understood and replicated by other developers.

Database management skills: Candidates should have practical experience in managing PostgreSQL databases and organizing extensive datasets effectively.

Strong teamwork abilities: Apache Spark developers typically collaborate closely with data scientists and other backend developers. Therefore, candidates should exhibit excellent communication and collaboration skills.

Additional Requirements:

Adherence to clean coding principles: Candidates should be capable of producing code that is devoid of bugs and can be easily understood and replicated by other developers.

Strong teamwork abilities: Apache Spark developers typically collaborate closely with data scientists and other backend developers. Therefore, candidates should exhibit excellentcommunication and collaboration skills.

Scope for Request:

Apache Spark

Java

Python

Spark SQL

Notice Period: Immediate Joining only