Job Title: Senior Snowflake Data Engineer
Job Summary:
We are seeking a highly skilled Senior Snowflake Data Engineer with strong data modeling experience to lead the design, implementation, and optimization of large-scale data intelligence solutions on the Snowflake Cloud Data Warehouse. The ideal candidate will have a proven track record in architecting robust data pipelines and managing complex data workflows, with a deep understanding of data architecture and analytics.
Key Responsibilities:
- Lead the architecture and implementation of high-performance, production-grade data solutions using Snowflake Data Warehouse, ensuring scalability and reliability.
- Design and manage advanced ETL workflows, utilizing tools such as Python, Snowpipe, and other ETL technologies for seamless data integration and processing.
- Develop both real-time and batch data processing pipelines, maintaining a strong focus on data quality and availability.
- Collaborate with cross-functional teams in an Agile environment (Scrum) to drive successful project outcomes using tools like Azure DevOps or JIRA.
- Write and optimize stored procedures and functions using Snowflake Scripting or JavaScript for efficient data manipulation and retrieval.
- Leverage Snowflake features such as data sharing, event-driven architecture, and lake-house patterns to enhance data accessibility and usability.
- Oversee data migration from RDBMS to Snowflake, implementing best practices for data transformation and modeling, with a strong emphasis on dimensional modeling techniques (star and snowflake schemas).
- Implement Role-Based Access Control (RBAC) for secure user and data management, ensuring compliance with security protocols.
- Design and manage file formats and external/internal stages for integrating with cloud storage solutions (e.g., AWS S3, Azure Blob).
- Apply deep knowledge of Snowflake architecture, including storage and compute resources, to optimize performance and cost.
- Utilize features like Time Travel and Failsafe to ensure data integrity, availability, and recovery.
- Translate complex BI and reporting requirements into effective database and reporting designs.
- Provide mentorship and guidance to junior team members, fostering a culture of continuous learning and improvement.
Basic Qualifications:
- Familiarity with Agile methodologies and project management tools (e.g., JIRA, Azure DevOps).
- Strong experience in data modeling principles and best practices.
Key Skills:
- Extensive expertise in Snowflake architecture and internals, including advanced data modeling and integration with BI/reporting tools.
- Proficient in programming languages such as Python, Java, or Scala for data processing and pipeline development.
- Strong understanding of structured and semi-structured data formats (e.g., XML, JSON, Parquet).
- Experience with Snowflake utilities (SnowSQL, SnowPipe) and best practices for data ingestion and processing.
- Knowledge of cloud data warehousing solutions like AWS Redshift or Google BigQuery is a plus.
Keywords: Senior Data Engineer, Snowflake, Snowpipe, ETL, Data Warehouse, SQL, Data Modeling, Cloud Solutions, Agile, Data Migration, RBAC.
