Job Title: Senior Data Engineer
Location: Remote, India
Experience Required: 7+ Years
Job Summary:
We are seeking a highly skilled and experienced Senior Data Engineer to join our team, working for a confidential client in the healthcare domain via Impetus. The ideal candidate will have a strong background in Databricks, ADF, Azure, Python, SQL, Shell scripting, and basic AI/ML concepts.
Key Responsibilities:
- Design, develop, and implement scalable data pipelines using Databricks and Azure Data Factory (ADF).
- Utilize Azure cloud services for data integration and transformation tasks.
- Develop robust Python scripts to support data engineering processes and ensure high-quality data delivery.
- Work with SQL for data manipulation, querying, and data validation.
- Write Shell scripts for automation of routine tasks and deployment processes.
- Apply basic AI/ML techniques where applicable to enhance data analysis and processing.
Required Skills:
- 7+ years of hands-on experience in data engineering or related fields.
- Expertise in Databricks and Azure Data Factory (ADF).
- Strong programming skills in Python.
- Proficiency in SQL for database management and querying.
- Experience with Azure cloud infrastructure.
- Knowledge of Shell scripting for automation.
- Understanding of basic AI/ML concepts and their application.
- Excellent problem-solving skills and the ability to work in a fast-paced environment.
Preferred Qualifications:
- Prior experience in the healthcare domain is a plus.
- Strong communication skills and ability to collaborate with international teams.
- Self-motivated, with the ability to work independently in a remote environment.
Selection Process:
Two video screening calls to assess technical skills and cultural fit.
