Job Details

Job Summary

We are seeking a skilled QA Automation Engineer with experience in both traditional software testing and AI/ML application validation. The ideal candidate will be responsible for designing, developing, and executing automated test strategies for AI-powered products, including applications leveraging Large Language Models (LLMs), NLP capabilities, data pipelines, and intelligent automation solutions.

Required Qualifications

• Bachelor’s degree in computer science, Engineering, or related field.
• 4+ years of experience in software QA or test automation.
• 1–2 years experience testing AI/ML applications or data pipelines.
• Strong understanding of REST APIs, LLM behavior (e.g., OpenAI, Claude), NLP tasks, and AI evaluation metrics.
• Hands-on experience with test automation tools (e.g., Selenium, Postman, Pytest, Robot Framework).
• Experience in Python or JavaScript-based test scripting.
• Familiarity with CI/CD tools (Jenkins, GitHub Actions, etc.).
• Ability to write and execute SQL queries for data validation.
  
  

• Exposure to prompt engineering and LLM evaluation techniques
• Experience with vector databases, embeddings, or agent frameworks (LangChain, LangGraph, etc.)
• Knowledge of model fairness, safety, and explainability testing
• Experience in using tools like Weights & Biases, MLflow, or similar for AI monitoring
• Performance testing experience with tools like JMeter or Locust