QA Engineer IV Automation & AI/ML Testing

Location: Atlanta, GA Contract- 6 Months Client- Southern Company Services.

Position Overview

We are seeking a highly experienced QA Engineer IV to lead quality engineering initiatives with a strong emphasis on automation, non-functional testing, and AI/ML system validation.

This role is responsible for planning, developing, implementing, and maintaining robust quality management systems while driving automation strategy across UI, API, performance, and AI-enabled applications.

The ideal candidate brings deep technical expertise, strong defect isolation skills, and the ability to translate complex findings into actionable business insights.

Key Responsibilities

Quality Engineering & Governance

• Assist in planning, development, implementation, and maintenance of quality management systems.
• Ensure compliance with quality standards and engineering best practices.
• Monitor product quality and recommend improvements.

Automation Engineering (Core Focus)

• Design and build scalable automated regression suites.
• Develop test frameworks using:
  • Playwright / Cypress / Selenium (UI)
  • REST-assured / Postman / Newman (API)
  • pytest / JUnit / TestNG or equivalent frameworks
• Write and maintain automated test code in:
  • Java
  • Python
  • TypeScript / JavaScript
  • C#

AI/ML System Testing

• Validate AI/ML systems including:
  • Prompt workflows
  • Model endpoints
  • Retrieval systems
  • Ranking systems
  • Evaluation pipelines
• Perform structured validation of model outputs and behavior.
• Ensure reliability and performance of AI-powered applications.

Performance & Non-Functional Testing

• Execute performance testing using industry-standard tools.
• Conduct load, stress, and scalability testing.
• Evaluate system performance under real-world conditions.

CI/CD & DevOps Integration

• Integrate automated tests into CI/CD pipelines:
  • Azure DevOps
  • GitHub Actions
  • Jenkins
• Ensure automated quality gates before production deployment.

Defect Management & Communication

• Perform strong defect isolation and root cause analysis.
• Distinguish between test framework issues and product defects.
• Provide clear risk assessments and remediation recommendations.
• Communicate findings effectively to technical and business stakeholders.

Required Qualifications

• 10+ years of experience in Quality Engineering.
• 5+ years focused on automation and non-functional testing.
• Hands-on experience testing AI/ML systems.
• Strong programming skills in at least one language:
  • Java
  • Python
  • TypeScript/JavaScript
  • C#
• Experience building and maintaining automation frameworks.
• Experience integrating testing into CI/CD pipelines.
• Demonstrated expertise in performance testing tools.
• Strong analytical and troubleshooting skills.
• Excellent communication skills with the ability to translate technical findings into business impact.

Technical Skills Summary

• Automation Frameworks: Playwright, Cypress, Selenium
• API Testing: REST-assured, Postman, Newman
• Test Frameworks: pytest, JUnit, TestNG
• Programming: Java, Python, TypeScript, C#
• CI/CD: Azure DevOps, GitHub Actions, Jenkins
• AI/ML Testing: Model validation, prompt workflows, evaluation pipelines
• Performance Testing Tools
• Quality Management Systems

Core Competencies

• Automation-first mindset
• Analytical thinking & defect isolation
• Risk-based quality assessment
• Cross-functional collaboration
• Clear technical communication
• Continuous improvement orientation