Position Overview:
We are seeking an experienced
AI/ML Testing Engineer to join our team. The ideal candidate will have a strong background in testing AI and machine learning applications, ensuring that models function as intended, are reliable, and meet quality standards. You will work closely with data scientists, AI/ML engineers, and software developers to design, develop, and implement testing frameworks and strategies specifically for AI/ML-based systems.
Key Responsibilities:
- Develop and execute test plans and strategies for AI/ML models, focusing on accuracy, bias, performance, and fairness.
- Collaborate with AI/ML engineers to ensure model outputs are thoroughly validated, including edge-case testing.
- Perform functional, non-functional, integration, and system testing on AI/ML algorithms and models.
- Conduct data validation and quality testing to ensure inputs to models are correct and produce reliable outcomes.
- Design and implement automated testing frameworks for AI/ML workflows to improve efficiency and coverage.
- Validate model updates, retraining, and versioning for accuracy and performance.
- Test AI models for interpretability, explainability, and consistency in decision-making.
- Identify and test for potential bias or ethical concerns in AI model outputs.
- Work with DevOps teams to automate testing processes within CI/CD pipelines.
- Troubleshoot and resolve defects, collaborating with developers to find effective solutions.
- Document test cases, test results, and issues, providing detailed feedback for continuous improvement.
Skills and Qualifications:
- Educational Background: Bachelor's or Master's degree in Computer Science, Data Science, AI/ML, or a related field.
- Experience: 7+ years of experience in software testing with at least 2-3 years in testing AI/ML systems.
- Technical Skills:
- Hands-on experience with AI/ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn).
- Proficiency in Python, Java, or other programming languages commonly used in AI testing.
- Experience in designing and implementing automated testing frameworks for AI/ML models.
- Familiarity with data science concepts and model evaluation metrics (e.g., precision, recall, AUC, F1 score).
- Experience in testing ML models on cloud platforms (AWS, Azure, GCP).
- Knowledge of CI/CD pipelines and DevOps tools (e.g., Jenkins, Docker, Kubernetes).
- Strong understanding of ethical AI principles and bias testing.
- Soft Skills:
- Strong problem-solving skills and attention to detail.
- Ability to work in a fast-paced, dynamic environment and manage multiple tasks.
- Excellent communication skills for cross-functional team collaboration.
Preferred Qualifications:
- Experience with NLP, Computer Vision, or other specialized AI fields.
- Knowledge of regulatory requirements related to AI/ML (e.g., GDPR, CCPA).
- Familiarity with MLOps tools and frameworks.
- Certification in AI/ML or Testing tools (e.g., ISTQB, TensorFlow certification).
About NomiSo:
NomiSo is a Product Engineering company currently focussed on Video Stream Engineering, backed by AI and ML. We are a team of Software Engineers, Architects and Cloud Experts with more than 100 years of combined expertise in Technology and Delivery Management.
Our mission is to Empower and Enhance the lives of our customers, through simple solutions for their complex business problems.
At NomiSo we encourage entrepreneurial spirit - to learn, grow and improve. A great workplace, thrives on ideas and opportunities. That is a part of our DNA. We're in pursuit of colleagues who share similar passions, are nimble and thrive when challenged. We offer a positive, stimulating and fun environment with opportunities to grow, a fast-paced approach to innovation, and a place where your views are valued and encouraged.
We invite you to push your boundaries and join us in fulfilling your career aspirations!
We are an equal opportunity employer and are committed to diversity, equity, and inclusion. We do not discriminate on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other protected characteristics.
