What we're looking for
We are in search of a Backend Engineer passionate about advancing AI technology. The ideal candidate will spearhead the development of our backend infrastructure, focusing on post-evaluation processes for AI models. This role involves creating robust and scalable APIs to manage the AI model inputs, outputs, training data, and analytics. The successful candidate will also develop SDKs to streamline data transmission for our clients. A strong background in Python, Rust, or Go is essential, alongside expertise in distributed data processing, messaging queues, and Kafka. Familiarity with storage solutions like MinIO, analytics databases such as ClickHouse, and vector databases like Milvius is highly valued.
Responsibilities
- Design and implement backend infrastructure for AI model evaluation and analytics.
- Develop scalable APIs for efficient data storage, retrieval, batch processing, and real-time processing pipelines.
- Craft SDKs that enable seamless data integration for clients.
- Utilize Python, Rust, or Go for data processing, ensuring high performance and scalability.
- Manage distributed data processing systems and integrate messaging queues and Kafka for data handling.
- Work with storage solutions like MinIO, and specialize in analytics and vector databases including ClickHouse and Milvius.
- Partner with our design, product, and fullstack teams in order to enhance and expand our product roadmap.
Qualifications
- Strong proficiency in Python, Rust, or Go, with a solid foundation in backend development.
- Demonstrated experience with distributed data processing at scale.
- Familiarity with messaging queues, Kafka, and other data orchestration tools.
- Strong experience writing concurrent and distributed programs.
- Knowledge working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.
- Experience building and operating highly complex SaaS platforms / systems.
- Proven experience leading and/or significantly contributing to end-to-end large scale projects.
Bonus Points, But Not Required
- Prior experience working in a start up enviornment
- Working knowledge of Machine Learning and/or Data Science
Benefits
- Cutting-Edge Technology: Engage with the latest advancements in AI, working on projects that push the boundaries of what's possible in post-production AI evaluation.
- Exceptional Talent: Collaborate with some of the brightest minds in the field, fostering a culture of innovation and shared success.
- Competitive Compensation: Receive industry-leading remuneration for your contributions to our pioneering projects.
- Comprehensive Health Benefits: Enjoy a full suite of health benefits designed to ensure the well-being of you and your loved ones.
- Generous ESOPs: Benefit from attractive Employee Stock Ownership Plans (ESOPs) that let you share in the company's success.
- Flexible Work Hours: Embrace work-life balance with flexible working hours that adapt to your personal needs and lifestyle.
- Remote Work Opportunities: Take advantage of the flexibility to work from anywhere in the world, connecting with a global team.
- Continuous Learning and Development: Grow your skills and career with access to professional development opportunities, including workshops, courses, and conferences.
- Diverse and Inclusive Environment: Thrive in a culture that values diversity and inclusivity, where every voice is heard and respected.
- Innovative Work Environment: Work in an environment that encourages creativity and out-of-the-box thinking to solve complex challenge