Job summary
CCL is seeking a Data Engineer to join our fast-growing team. The successful candidate will join the data engineering team at CCL to work on ETL and development tasks. This is an exciting and challenging opportunity to build new pipelines combining and processing large amounts of structured, semi-structured and unstructured data from a variety of sources.
Key Responsibilities
- Build pipelines using AWS cloud computing solutions that make data available with robustness, maintainability, efficiency, scalability, availability and security.
- Develop Python and PySpark code that implements complex data transformations.
- Maintain databases and APIs for storage and transmission of data between applications.
- Monitor pipelines in production (and develop tools to facilitate this).
- Work collaboratively with other team members (brainstorming, troubleshooting, and code review).
- Liaise with other development teams to ensure the integrity of data pipelines.
Skills, Knowledge and Expertise
Skills
- Outstanding interpersonal skills
- Excellent verbal and written communication skills
- Fluent English
Knowledge
- Data modelling, data pipeline architecture, Big Data implementation
- Scrum/Agile best practices
- Financial knowledge would be an asset
Experience
- Developing and monitoring complex production data pipelines that interact with a range of data sources (file systems, web, database, users)
- Strong experience with Amazon Web Services (AWS)
- At least 2 years work in a similar role, and at least 3 yrs of overall experience in IT
Qualifications/Training
- Bachelors degree or equivalent in Computer Science or a related subject.
Benefits
- Competitive salary package
- Private healthcare contribution
- Annual pay review
- Regular team socials
- Working within a culture of innovation and collaboration
- Opportunity to play a key role in a pioneering growth company
