Python Pyspark Developer

Job Description

• Exp:- 4-8years

• Key Responsibilities:

Designing and developing robust PySpark applications for large-scale data processing.

Building and optimizing data ingestion, transformation, and storage processes.

Implementing efficient algorithms and data structures for distributed computing.

Collaborating with cross-functional teams to integrate data-driven solutions into business processes.

Troubleshooting performance bottlenecks and ensuring high availability and reliability of data pipelines.

Writing and optimizing SQL queries for data extraction and manipulation.

Required Skills and Qualifications:

Bachelor's/Master's degree in Computer Science, Engineering, or a related field.

Proven experience (3-10 years) in Python development with a focus on PySpark.

Strong understanding of distributed computing principles and experience with Apache Spark.

Proficiency in SQL and experience with relational databases (MySQL, PostgreSQL, etc.).

Experience with data serialization formats such as JSON, Parquet, Avro.

Familiarity with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) is a plus.

Excellent problem-solving skills and ability to work independently or as part of a team.

Good communication skills with the ability to effectively collaborate with stakeholders.

Preferred Qualifications:

Certification in Apache Spark or related technologies.

Experience with stream processing frameworks like Apache Kafka.

Knowledge of machine learning frameworks (e.g., TensorFlow, PyTorch) for data analysis.

Additional Information

Required Qualification

Master of Computer Applications (M.C.A.) ,

Bachelor of Engineering - Bachelor of Technology (B.E./B.Tech.) ,

Required Qualification

Bachelor of Engineering - Bachelor of Technology (B.E./B.Tech.)

Job Type: Full-time

Pay: 1,600,

• 00 - 3,000,000.00 per year
  
  Jadwal:
• Day shift

Fixed shift

• Monday to Friday

Tipe Lokasi:

• In-person

Education:

• Bachelor's (Preferred)

Experience:

• pyspark: 3 years (Preferred)

SQL: 3 years (Preferred)

• Python: 4 years (Preferred)

total work: 4 years (Preferred)

License/Certification:

• Apache Spark or Related Certification (Preferred)

Work Location: In person