We are seeking a strong technical leader to join our team as a Principal Quality Software Engineer for the Lake House team. This role is ideal for someone who has a background in testing data warehouses, data lakes, or data at scale. This role will work closely with the Lakehouse team and will be responsible for ensuring the quality of the functionality & performance of the data lake house.
You will - Responsible for developing & building testing strategy to validate Data Lakehouse functionality & data quality at scale.
- Build monitors using SQL for Data Lakehouse for observability.
- Work closely with cross-functional teams to understand customer requirements and develop use case scenarios for testing new features.
- Responsible for establishing new tools & QE methodologies across the QE organization.
- Actively participate and provide technical inputs during the product development cycle.
- Develop and enhance the REST API/UI automation framework, write and review testing code, debug failures, and integrate applications with third-party web services.
- Develop scalable back-end components to improve application performance.
- Responsible for mentoring other team members & grooming the team from scratch.
You are - Able to take on very complex problems, learn quickly, iterate, and persevere toward a robust solution
- Familiarity with Apache Spark, Apache Kafka, and Apache Airflow.
- Product-focused and passionate about building truly usable systems
- Collaborative and comfortable working across teams including data engineering, front end, product management, and DevOps
- Responsible and like to take ownership to improve user experience
- A good communicator, and facilitates teamwork via good documentation practices
- Comfortable with ambiguity and thrive in designing algorithms for evolving needs
- Intuitive in using the right type of models to address different product needs
- Curious about the world and your profession, constant learner
- Able to work in a startup environment, optimized for high-velocity feature delivery
You Have
- 15+ years of product quality & automation experience
- Bachelors degree in Computer Science, Engineering or related field
- Expertise & experience in testing Data warehouse and/or Data Lakehouse.
- Strong SQL Knowledge.
- Strong experience and knowledge of micro-services, distributed systems, and performance optimizations
- Knowledge of Aws/Azure/GCP native services & ecosystem.
