Job Description
Job DescriptionRole Purpose
We are seeking a Lead Data Engineer to join our team of data experts. The ideal candidate will have a passion for designing and implementing end-to-end data solutions, from data ingestion and processing to analytics and reporting. As a Senior Data Engineer, you will work closely with the Data Architect and other stakeholders to understand their data needs and provide solutions to meet those needs. You will also be responsible for leading a team of data engineers and ensuring that all data engineering projects are completed on time and within budget.
Role Responsibilities
Collaborate with the Data Architect and other stakeholders to understand their data needs and provide solutions to meet those needs
Design and implement end-to-end data solutions using technologies such as Snowflake, Databricks, Azure
Build and maintain data pipelines and ETL processes using Python, Spark, and SQL
Ensure data quality and integrity by developing and implementing data validation and testing strategies
Design and implement data security measures to protect the confidentiality, integrity, and availability of our organization's data
Stay up-to-date with the latest data technologies and trends and provide recommendations for their adoption
Skills & Experience
Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
10+ years of experience in data engineering and data architecture
Strong knowledge of data technologies, such as Snowflake, Databricks, Apache Spark, Dbt, Azure Data Factory
Experience designing and developing end-to-end data solutions, data pipelines, and ETL processes
Strong understanding of data governance, data quality, and data security principles
Strong expertise in Python and SQL
Excellent problem-solving and analytical skills
Strong communication and leadership skills
Ability to work independently and as part of a team
Experience working in an Agile environment
Experience managing projects and teams
Experience in pre-sales activities, including scoping and estimation of projects, and presenting solutions to clients
Experience in complete project life cycle activities on development and maintenance projects.
Knowledge and experience in developing software using agile methodologies.
Experience working with a globally distributed team.
Proven track record of technical leadership roles delivering solutions within defined timeframes.
Skilled in building relationships with clients and in practice development activities.
Demonstrated success in performing work and managing complex and/or large consulting projects.
Excellent written and oral communication skills; Ability to communicate effectively with technical and non-technical staff.
Retail domain knowledge is preferred.
