Position: LLM Ops Engineer
Location: Hyderabad
Experience Required: 8+ Years
Key Responsibilities:
- Infrastructure as Code (IaC): Hands-on experience with tools like Terraform or Ansible for automating infrastructure provisioning.
- Containerization and Orchestration: Proficiency in Docker and Kubernetes for managing large language model (LLM) deployments.
- Cloud Platforms: Familiarity with AWS (Bedrock), Azure, or GCP and experience in deploying and managing applications in a cloud environment.
- Monitoring and Logging Tools: Experience with Prometheus, Grafana, and the ELK stack for real-time performance monitoring and analysis.
- Security Measures: Knowledge of security guardrails using tools like LLM Guard, and experience in protecting sensitive data and managing performance implications.
- Scripting and Automation: Proficiency in Python, Shell, or similar scripting languages to automate deployment and maintenance processes.
