Job Type: Full-Time
Work Arrangement: Hybrid
- Onboarding: 1 month in the office
- After Onboarding: 50% office visits per month Urgency: Super Urgent
- Location: Gurgaon
Job Description:
We are looking for a highly skilled
Middle Dev+ML+Data Engineer to join our dynamic team. This role is ideal for someone with strong expertise in working with big data and hands-on experience in managing and deploying machine learning models in real-time environments. If you are passionate about building robust data pipelines, have strong experience with ML lifecycles, and enjoy working in fast-paced environments, this role is for you!
Key Responsibilities:
- Design, implement, and manage real-time data streaming pipelines using Spark and Spark Streaming.
- Build and maintain CI/CD pipelines for deploying ML models in live frameworks.
- Collaborate with data scientists and software engineers to ensure smooth deployment of ML models.
- Work with Kubernetes and Docker to manage containerized ML applications.
- Ensure high availability and scalability of data infrastructure.
- Be available for 24/7 on-call support to troubleshoot and resolve critical issues.
- Handle and process large volumes of data, ensuring efficient data workflows.
- Implement and optimize the full ML lifecycle from data ingestion to model monitoring.
Must-Have Skills:
- Proficiency with Spark and Spark Streaming.
- In-depth knowledge of the ML lifecycle and experience deploying models in production environments.
- Experience with CI/CD pipelines for machine learning.
- Hands-on experience with Kubernetes and Docker for container orchestration and deployment.
- Strong experience with Python and working with real-time streaming pipelines.
- Expertise in working with big data and processing large-scale datasets.
Nice-to-Have Skills:
- Experience with Scala.
- Experience with managing large, distributed systems and infrastructure.
On-Call Requirement:
- Must be available for 24/7 on-call support to manage and resolve production issues as they arise.
Qualifications:
- Proven hands-on experience in big data environments.
- 3+ years of relevant experience in machine learning, data engineering, and real-time data processing.
- Ability to work in high-pressure environments with tight deadlines.
Compensation: Competitive, based on experience.
