Title : LLM Ops engineer
Experience : 10+ Years
Location: Hyderabad
Skills
- Infrastructure as Code (IaC) - Experience with IaC tools such as Terraform or Ansible for automating infrastructure provisioning.
- Containerization and Orchestration - Proficiency in containerization technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes) for managing LLM deployments.
- Cloud Platforms - Familiarity with cloud platforms such as AWS (Bedrock), Azure, or GCP, and experience in deploying and managing applications in a cloud environment.
- Monitoring and Logging Tools - Knowledge of monitoring tools (e.g., Prometheus, Grafana) and logging systems (e.g., ELK stack) for real-time performance monitoring and analysis.
- Security Measures - Understanding of security guardrails using tools like LLM Guard and familiarity of how to mask/redact / obfuscate sensitive data, protect the input and output of toxic and harmful content to/from LLMs and understand the performance implications of the same.
- Scripting and Automation - Proficient in scripting languages such as Python, Shell, or similar, and experience in automating deployment and maintenance processes.
Skills: containerization,cloud,kubernetes,automation,scripting languages,infrastructure,security,security measures,grafana,aws,gcp,scripting and automation,ansible,orchestration,shell scripting,terraform,infrastructure as code (iac),azure,monitoring and logging tools,cloud platforms
