Position: PySpark Glue Developer
Location: Pune, Gurgaon
Experience: 4-6 Years
Key Skills
Nice To Have
- Hadoop, Spark, Hive, Impala
Responsibilities
- Design, develop, and maintain efficient, scalable solutions using PySpark and AWS Glue.
- Ensure data quality and integrity through rigorous testing, validation, and data cleansing processes.
- Integrate data from multiple sources such as databases, APIs, and external datasets.
- Optimize and tune PySpark jobs for enhanced performance and reliability.
- Document data engineering processes, workflows, and best practices.
- Demonstrate strong knowledge of databases, data modeling, and ETL tools.
Required Skills
- Strong programming skills in Python and proficiency with PySpark and SQL.
- Experience working with relational databases and big data technologies like Hadoop, Spark, Hive, and Impala.
- Excellent communication and collaboration abilities.
Education
- Bachelor's or Master's degree in Engineering/Technology (BE/BTech or ME/MTech).
Skills: spark,data modeling,aws glue,glue,etl,impala,sql,pyspark,databases,hadoop,aws,python,hive
