Senior Data Engineer

Responsibilities:

• Design and implement efficient data CICD pipelines (ETLs) in order to integrate data from a variety of sources into Snowflake warehouse.
• Design and implement data model changes that align with warehouse standards.
• Design and implement backfill or other warehouse data management processes.
• Develop and execute testing strategies to ensure high quality warehouse data.
• Provide documentation, training, and consulting for data warehouse users.
• Have a strong data and BI mindset to handle multiple priorities.
• Provide input and feedback to support continuous improvement in processes.

Skills:

• Extensive experience (4+ years) in designing and implementing a fully operational solution on Snowflake Data Warehouse.
• Strong hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, SnowFlake data share, Streams, tasks, Snowflake stored procedures etc.
• Extensive experience (4 + years) in SQL is a must.
• Extensive experience (4 + years) in building frameworks using python.
• Strong experience in building data pipeline using AWS technology stack. S3, Lambda, Ec2, Steps functions, cloud formation.
• Strong experience with programming scripting and data science languages such as PowerShell, R, SQL, Javascript etc.
• Experience in building data models, including conceptual, logical, and physical for enterprise Relational, and dimensional Databases.
• Strong understanding of Data warehouse and BI concepts.
• Working knowledge of Big Data concepts in organizing both structured and unstructured data is a big plus.
• Bachelor s degree or higher in a technology related field (e.g. Engineering, Computer Science, etc.) required, Master s degree a plus

Must Have:

• AWS - S3, Lambda, Step Functions, Cloud formation, AWS Glue, AWS EC2 etc.
• Cloud Databases- Snowflake, AWS aurora, AWS RDS
• Data Integration/Programming languages - Python, Java, C#, SQL, Stored procedures
• ETL/ELT Tools - Fivetran / Matillion and/or Informatica
• Orchestration -- Apache Airflow, Autosys, Tidal

Good to Have:

• Additional AWS services
• Data management - Experience working with data governance, data operations
• BI - Power BI, Tableau, Python plotly, AWS Quicksight
• CICD
• Asset management industry experience