Data Engineer

Data Engineer

Design, build, and maintain scalable and reliable data pipelines to ingest, process, and store large volumes of data from various sources.

Design and implement data warehouse solutions that support business intelligence and analytics requirements.

Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet their needs.

Implement data quality and validation processes to ensure the accuracy and integrity/reliability of data.

Monitor and optimize the performance of data pipelines and data storage solutions.

Document data processes, architectures, and workflows to ensure transparency and reproducibility.

Ensure data security, privacy, and compliance with relevant regulations and best practices.

Technical Skills

Proficiency in programming languages such as Python, JSQL and PySpark.

Good to have experience on Snowflake and informatica

Knowledge of containerization using docker/ Amazon EKS is a plus

Good to have Healthcare/Pharma experience