Quality Assurance Engineer

We are seeking an experienced Quality Assurance Engineer to join our Personalization team as a contractor. This role will focus on device testing for mobile app initiatives and developing comprehensive testing strategies for LLM-powered features.

Key Responsibilities

Device Testing Leadership

• Own end-to-end testing for Prime Video mobile app Search CX revamp
• Develop and execute comprehensive test plans for living room devices and customer experience features
• Utilize on-site device lab for hands-on testing across multiple platforms and form factors
• Collaborate with general QA teams while maintaining dedicated focus on search functionality

LLM Testing Framework Development

• Evaluate and enhance existing automation frameworks built by engineering teams
• Design and implement structured test plans for large language model features
• Create regression testing suites for AI-powered personalization and search algorithms
• Build automated test cases for LLM performance validation and quality assurance

Test Strategy & Execution

• Gather product requirements and translate them into comprehensive testing strategies
• Create detailed test plans that cover functional, performance, and edge case scenarios
• Execute testing independently and provide clear reporting on results and quality metrics
• Identify testing gaps and recommend improvements to existing processes

Stakeholder Collaboration

• Work directly with Product/Program Managers to understand feature requirements and success criteria
• Collaborate with Engineering teams to understand technical implementation and constraints
• Partner with TPMs on project timelines and deliverable coordination
• Provide regular updates on testing progress and quality status

Required Qualifications

Experience

• 5+ years of quality assurance engineering experience
• Proven experience creating test plans from product requirements
• Experience with both manual and automated testing methodologies

Technical Skills

• Python programming (primary requirement for LLM testing work)
• Experience with test automation frameworks and tools
• Knowledge of mobile device testing across iOS and Android platforms
• Familiarity with living room device testing (Fire TV, gaming consoles, smart TVs)
• API testing and backend validation capabilities

Preferred Qualifications

Experience

• Testing AI/ML features, recommendation systems, or personalization algorithms
• Experience with large language model testing or AI model validation
• Video streaming or entertainment industry experience (nice to have, not required)

Skills

• Quality assurance, Automation, Selenium, Quality assurance testing, Test case, Test plan, Java, Test script, Python, Test automation, Automation testing, Automated testing, Javascript, Mobile

Pay and Benefits

The pay range for this position is $75.00 - $80.00/hr. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:

• Medical, dental & vision
• Critical Illness, Accident, and Hospital
• 401(k) Retirement Plan Pre-tax and Roth post-tax contributions available
• Life Insurance (Voluntary Life & AD&D for the employee and dependents)
• Short and long-term disability
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Time Off/Leave (PTO, Vacation or Sick Leave)

Workplace Type

This is a fully onsite position in New York, NY.

Application Deadline

This position is anticipated to close on Aug 11, 2025.

About TEKsystems

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.