Search by job, company or skills
Need Data Engineer (Databricks) - (US Travel for 3 -6 months - Business Visa is Mandatory)
2-5 YRS of exp.
Your role:
-Engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways using cloud data platform infrastructure.
-Develop data engineering techniques to automate manual processes and solve challenging business problems.
-Ensure the highest level of data quality & validation checks within enterprise data lakes.
Your expertise:
-4+ years experience with Big Data Technologies such as Apache Spark, Kafka, and Delta Lakes.
-2+ years with Databricks capabilities related to data engineering (Legacy Migration, Delta Lake, Pipeline modernization).
-Comfortable writing code in either Python or Scala, with proficiency in SQL (stored procs & triggers, dynamic SQL, query optimization)
-Hands-on experience with at least one of the leading public cloud data platforms (Azure / AWS / GCP)
-Data validation and quality frameworks, and data lineage frameworks
-(Preferred) Databricks Certified Data Engineer Associate/Professional Certification.
Azure, Databricks
4+ years
Remote
Any
Software Engineer
BCA/MCA, B.Tech/M.Tech or equivalent
Please share resume,
[Confidential Information]
Date Posted: 11/07/2024
Job ID: 84186133