We areseeking an accomplished Lead Data Engineer with strong programming skills,cloud expertise, and in-depth knowledge of BigQuery/Snowflake data warehousingtechnologies.
As a key leader in our data engineering team, you will play acritical role in designing, implementing, and optimizing data pipelines,leveraging your expertise in programming, cloud platforms, and modern datawarehousing solutions.
Responsibilities:
1. Data Pipeline Architecture:
Lead the design and architecture of scalable and efficient datapipelines, ensuring optimal performance and reliability.
Programming and Scripting:
Utilize strong programming skills, particularly in languages likePython, for developing robust and maintainable data engineering solutions.
Cloud Platform Expertise:
Apply extensive experience with cloud platforms (e.g., AWS, Azure,Google Cloud) to design, deploy, and optimize data engineering solutions in acloud environment.
BigQuery/Snowflake Knowledge:
Demonstrate deep understanding and hands-on experience withBigQuery/Snowflake for efficient data storage, processing, and analysis.
ETL Processes:
Lead the development of Extract, Transform, Load (ETL) processes,ensuring seamless integration of data from various sources into the datawarehouse.
Data Modeling and Optimization:
Design and implement effective data models to support ETL processes andensure data integrity and efficiency.
Collaboration and Leadership:
Collaborate with cross-functional teams, providing technical leadershipand guidance to junior data engineers.
Work closely with data scientists, analysts, and business stakeholdersto understand requirements and deliver effective data solutions.
Quality Assurance:
Implement comprehensive data quality checks and validation processes toensure the accuracy and completeness of data.
Documentation:
Create and maintain detailed documentation for data engineeringprocesses, data models, and cloud configurations.
Technical Skills:
Programming Languages: Expertise in programming languages, with a strong emphasis on Python.
Cloud Platforms: Extensive experience with cloud platforms such as AWS, Azure, or Google Cloud.
Big Data Technologies: Proficiency in big data technologies and frameworks for distributed computing.
Data Warehousing: In-depth knowledge of modern data warehousing solutions, with specific expertise in BigQuery/Snowflake.
ETL Tools: Experience with ETL tools like Apache NiFi, Talend, or similar.
SQL: Strong proficiency in writing and optimizing SQL queries for data extraction, transformation, and loading.
Collaboration Tools: Experience using collaboration and project management tools for effective communication and project tracking.
Soft Skills:
Strong leadership and mentoring capabilities.
Excellent communication and presentation skills.
Strategic thinking and problem-solving abilities.
Ability to work collaboratively in a cross-functional team environment.
Educational Qualifications:
Bacheloru2019s or Masteru2019s degree in Computer Science Data Engineering, or a related field.
Experience:
8+ years of experience in data engineering roles with a focus on programming, cloud platforms, and data warehousing.
Ifyou are an experienced Lead Data Engineer with a strong programming background,cloud expertise, and specific knowledge of BigQuery/Snowflake, we encourage youto apply. Please submit your resume and a cover letter highlighting yourtechnical skills, leadership experience, and contributions to data engineeringprojects.
