We are looking for a talentedDataEngineerwith experience in ETL processes, database administration, and scripting, as well as expertise in tools such asSnowflake, AzureDataFactory, DBT, and Talend. The ideal candidate will have a strong technical background and be capable of working on various aspects ofdataengineering, from buildingdatapipelines to optimizingdatastorage and retrieval.
Key Responsibilities:
ETL Development and Maintenance:
- Design, develop, and maintain scalable ETL processes to extract, transform, and loaddatafrom various sources intodatawarehouses anddatalakes.
- Utilize Talend and AzureDataFactory to create and manage ETL workflows that ensuredataaccuracy and efficiency.
Database Administration:
- Administer and optimize databases, ensuring high performance, availability, and security ofdataassets.
- Manage Snowflakedatawarehouse, including schema design,datapartitioning, and performance tuning.
DataEngineeringand Scripting:
- Develop and maintain Python scripts fordataprocessing, automation, and integration tasks.
- Implement and optimizedatatransformation processes using DBT (DataBuild Tool) to ensuredataquality and consistency.
DataIntegration and Management:
- Integratedatafrom multiple sources and ensure seamlessdataflow and accessibility.
- Collaborate withdataanalysts anddatascientists to understanddatarequirements and deliver relevant solutions.
Performance Optimization:
- Monitor and optimizedatapipelines and database performance to ensure efficientdataprocessing and retrieval.
- Troubleshoot and resolve issues related todatapipelines, database operations, anddataquality.
Documentation and Best Practices:
- Documentdataengineeringprocesses, workflows, and architecture to support knowledge sharing and maintenance.
- Implement best practices fordataengineering, includingdatagovernance, version control, and code review.
Collaboration and Communication:
- Work closely with cross-functional teams to gather requirements, provide updates, and ensure alignment ondataengineeringprojects.
- Communicate technical concepts and solutions effectively to both technical and non-technical stakeholders.
Qualifications:
Education & Experience:
- Bachelor's degree in Computer Science,DataEngineering, or a related field. Advanced degree preferred.
- Minimum of 5 years of experience indataengineeringor a similar role, with hands-on experience in ETL processes and database administration.
Technical Skills:
- Proficiency in ETL tools such as Talend and AzureDataFactory.
- Experience with Snowflakedatawarehouse platform.
- Strong scripting skills in Python fordataprocessing and automation.
- Knowledge of DBT (DataBuild Tool) fordatatransformation and modelling.
- Experience with database administration, performance tuning, and optimization.
Additional Skills:
- Familiarity with cloud platforms (e.g., Azure, AWS, Google Cloud) is a plus.
- Strong problem-solving skills and attention to detail.
- Ability to work independently and as part of a team in a fast-paced environment.
- Excellent communication and interpersonal skills.
