Responsibilities:
- Develop and maintain scalable data pipelines for efficient data ingestion, processing, and analysis.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business objectives.
- Perform thorough data analysis to derive insights, identify trends, and support decision-making processes.
- Optimize query performance and data processing workflows to enhance system efficiency and reduce latency.
- Utilize Python and SQL to manipulate, transform, and cleanse data as needed.
- Stay updated with emerging technologies and best practices in data engineering and analysis. Requirements:
- Bachelor's degree in computer science, Engineering, or related field; advanced degree preferred.
- Proven experience in data engineering with a strong emphasis on data analysis.
- Proficiency in Python and SQL for data manipulation, querying, and scripting.
- Familiarity with AWS services such as S3, EC2, Redshift, Glue, etc.
- Experience optimising performance and scalability of data pipelines and databases.
- Strong problem-solving skills and ability to work independently with minimal supervision.
- Excellent co
mmunication and collaboration skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
- Self-motivated and proactive, with a passion for continuous learning and improvement
