Currently we are looking for Lead Databricks/Pyspark Developer.
Responsibilities
Position -Lead Databricks/Pyspark Developer.
Exp -7+Yrs
Notice -Immediate to 30 Days
Location -Hyderabad,chennai (Hybrid)
JD
Design and development of data ingestion pipelines (Databricks background preferred).
- Performance tune and optimize the databricks jobs
- Evaluated new features and refractors existing code
- Mentor junior developers and makes sure all patterns are documented
- Perform data migration and conversion activities.
- Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
- Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
Minimum Qualifications And Job Requirements
Must Have Following
SCALA
SQL
Spark/Spark Streaming
Big Data Tool Set
Linux
Python/PySpark
Kafka
- Experience collaborating with dev team, project managers, and engineers.
- Excellent communication and teamwork skills
Qualifications
Any Gradation fine.
Skills: scala,sql,spark,big data,linux,python,kafka
