QA / Automation Engineer

The role

Key responsibilities

• Translate requirements and acceptance criteria into test plans, test cases, and automated checks.
• Conduct functional, integration, end-to-end, and regression testing.
• Build and maintain automated test suites for APIs, applications, and critical business workflows.
• Test AI workflows against representative inputs, edge cases, ambiguous requests, and failure scenarios.
• Collaborate with the AI engineer on evaluation datasets while independently validating acceptance outcomes.
• Verify authorization boundaries, data handling, human approval steps, and audit records.
• Test retries, fallbacks, interrupted workflows, duplicate requests, and external-service failures.
• Validate performance and response times against agreed requirements.
• Maintain test environments and appropriately controlled test data.
• Record defects with clear reproduction steps and verify fixes.
• Provide release-readiness reports covering test results, open defects, and residual risks.
• Track escaped defects and improve test coverage based on production findings.

Required experience and capabilities

• Experience testing web applications, APIs, and integrated software systems.
• Practical experience with test automation frameworks and scripting.
• Understanding of test design, regression strategy, defect management, and release processes.
• Ability to distinguish deterministic software defects from variable AI-output behavior.
• Experience testing data flows, permissions, and exception handling.
• Strong attention to detail and clear written communication.
• Ability to challenge unclear requirements and incomplete acceptance criteria.

Preferred experience

• Testing of AI-enabled applications or agent workflows.
• Experience with model evaluations, adversarial testing, or prompt-injection testing.
• Familiarity with load testing, accessibility testing, and security-testing tools.
• Experience integrating automated tests into deployment pipelines.