Senior QA Automation Engineer (AI Applications UK)

Join our team as a Senior QA Automation Engineer, where you will play a crucial role in ensuring the quality, reliability, and performance of our AI-powered applications. You will design and maintain automated test suites, automate QA workflows, perform API testing, and define quality strategies for AI-powered applications. The ideal candidate has strong programming skills in Python, experience in test automation, and a passion for learning new technologies.

• Design and maintain automated test suites, evaluation scenarios, metrics, and test datasets for AI-powered features.
• Automate QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins), leveraging AI-powered testing tools to improve test development, maintenance, and coverage.
• Define quality strategy and acceptance criteria for AI-powered applications across functional, API, integration, and AI/ML features.
• Strong programming skills in Python, with experience in test automation
• Bachelor’s degree in Computer Science, Engineering, or equivalent experience
• Hands-on experience using AI-powered testing tools or AI coding assistants to improve test automation, productivity, and quality
• Proficient in automation and UAT test suites/frameworks
• Familiarity with popular CAD environments and tooling
• Understanding of software architecture and design patterns
• Ability to work in an Agile development environment
• Strong communication and collaboration skills
• Experience designing QA frameworks or platforms used by multiple teams
• 5+ years of professional experience in software quality assurance, test automation, or software engineering
• Excellent problem-solving skills and attention to detail
• Experience with CI/CD tools and processes
• You enjoy learning and collaborating across global locations
• You demonstrate initiative to provide solutions and to learn and develop new technologies
• Comfortable building QA systems from scratch and writing maintainable automation
• You are comfortable working in newly forming ambiguous areas
• You are comfortable building scalable and maintainable QA automation frameworks that will be relied on by others
• You effectively leverage AI-powered tools to improve testing workflows and engineering productivity
• You can communicate well with others
• Experience testing AI/ML applications or validating machine learning models
• Experience with data validation tooling (e.g., Great Expectations) or labeling workflows
• Knowledge of MLOps practices (e.g., model monitoring, drift detection, deployment validation)
• Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)
• Familiarity with ML frameworks (e.g., PyTorch, TensorFlow)
• Knowledge of ML evaluation methods, metrics, and benchmarking
• Passion for learning new technologies and improving existing systems
• Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform)
• Experience testing AI/ML services in production environments
• Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights & Biases)