What You Will Be Doing:
- Design, develop, and optimize data pipelines and architectures to support our composable CDP product.
- Implement and maintain ETL processes using dbt.
- Work with large datasets and develop scalable data models on Snowflake.
- Utilize Databricks for big data processing and machine learning workflows.
- Manage and optimize cloud infrastructure on AWS and GCP to ensure high performance and availability.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure data quality, governance, and compliance across all data pipelines.
- Implement best practices for data management, including data security and privacy.
- Lead and mentor junior data engineers, fostering a culture of continuous learning and improvement.
- Actively participate in the product development process as part of the core team.
- Publish product updates on Snowflake and Databricks marketplace.
Experience & Requirements:
- Database and Data Warehousing: Advanced experience with Snowflake, Databricks, and other data warehousing solutions.
- Data Transformation and ETL: Proficiency in dbt and experience in building and maintaining ETL pipelines.
- Cloud Platforms: Extensive experience with AWS and GCP,
- Programming Languages:
- Strong proficiency in Python programming language.
- Experience designing and implementing scalable and efficient data pipelines using Python and relevant libraries (such as Pandas, NumPy, SQLAlchemy, etc.).
- Solid understanding of ETL principles, data modeling, and schema design.
- Big Data Technologies: Experience with Apache Spark, Kafka, and other big data technologies.
- Data Integration and Automation: Familiarity with data integration and automation technologies (such as Airbyte, Apache Airflow, Luigi, etc.).
- DevOps and CI/CD: Familiarity with DevOps practices and tools like Jenkins, Docker, and Kubernetes.
- Data Governance: Knowledge of data governance frameworks and practices, including data security and privacy regulations.
- Experience in Startups: Proven experience working with data startups and being part of the product development team.
- Analytical Skills: Strong analytical and problem-solving skills, with the ability to troubleshoot data-related issues.
- Communication and Collaboration: Excellent communication and collaboration skills.
- Attention to Detail: Attention to detail and a strong focus on data quality and integrity.
Required Skills & Mindsets:
- Strong foundation in software engineering best practices, including design patterns and modular architecture.
- Excellent analytical and problem-solving skills, with the ability to work independently and within a team.
- Strong work ethic, supported by solid time-management skills, and a professional, team-oriented attitude.
- Commitment to high-quality software development, with a focus on testing and code quality.
- Fast learner, enthusiastic about tackling new challenges and technologies.
What we offer
- You will work with seasoned entrepreneurs and learn from the best
- We have a dynamic and flexible remote work environment
- You will work with cutting-edge AI technologies
- You will make a significant impact in a fast-growing start-up
If you're passionate about AI and looking to make a significant impact in a dynamic start-up, we'd love to hear from you! Apply today and let's reshape the future of work together. Email us at: [Confidential Information]
At iCustomer, we value diversity and always treat all employees and job applicants based on merit, qualifications, competence, and talent. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We will consider for employment all qualified applicants with criminal histories in a manner consistent with applicable law.
To learn more about our company and what we do, please visit our website atiCustomer.ai.
How to apply
Thank you for your interest in joining our team! Please complete the form below, and we will respond within 12 hours.
https://forms.gle/Z7we5gsMTierFN7k9
