Data Engineer (Databricks, AWS, Data Warehousing, SQL)

Job Title:Data Engineer (Databricks, AWS, Data Warehousing, SQL)

Location:Gurgaon

Job Description:

We are looking for a talented Data Engineer with extensive experience in Databricks, AWS, data warehousing, and SQL to join our innovative team. As a Data Engineer, you will play a critical role in designing, building, and maintaining robust data pipelines and infrastructure to support our data-driven initiatives.

Responsibilities:

Design, develop, and maintain scalable data pipelines using Databricks for data ingestion, transformation, and storage.

Implement and optimize ETL processes to handle large-scale datasets efficiently using SQL, Python, or Scala.

Collaborate closely with stakeholders to understand data requirements and translate them into technical solutions.

Ensure data quality, integrity, and availability across various data sources and platforms.

Architect and manage data warehouse solutions on AWS (e.g., Redshift, Snowflake, or similar) to support analytics and reporting needs.

Monitor and troubleshoot data pipeline issues, identify bottlenecks, and implement effective solutions.

Work with data scientists and analysts to deploy machine learning models and enable advanced analytics capabilities.

Stay updated with industry best practices and emerging technologies in data engineering and cloud computing.

Requirements:

Bachelor's degree in Computer Science, Engineering, or a related field (Master's degree preferred).

6 to 12 years of experience in data engineering roles, with a strong background in Databricks and AWS cloud services.

Proficiency in SQL and experience with database technologies (e.g., PostgreSQL, MySQL, etc.).

Hands-on experience with data warehousing solutions (e.g., Redshift, Snowflake, Big Query) and data modeling techniques.

Solid programming skills in Python, Scala, or Java for data processing and ETL tasks.

Experience designing and optimizing data pipelines for performance, scalability, and reliability.

Strong analytical and problem-solving skills with a detail-oriented mindset.

Excellent communication and collaboration skills with cross-functional teams.

Preferred Qualifications:

Certification in Databricks (e.g., Databricks Certified Associate Developer for Apache Spark).

AWS Certification (e.g., AWS Certified Solutions Architect, AWS Certified Data Analytics Specialty).

Experience with streaming data technologies (e.g., Kafka, Kinesis) and real-time data processing.

Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

Knowledge of DevOps practices and tools for CI/CD pipelines.

Please submit your resume and cover letter outlining your qualifications and interest in the position to [Confidential Information]. We look forward to hearing from you!