AI Project - QA Automation Engineer
Job Description
Job Description
OverviewWe are seeking highly skilled QA Engineer 3-5 years experience with expertise in AI-driven systems to support the AI initiative. The role involves validating AI-powered customer interactions and ensuring high-quality, scalable, and reliable system behavior across multiple channels.
Key Responsibilities Execute standard QA testing cycles including Functional, Regression, and Synthetic testing.Validate AI-driven customer interactions across chat, voice, and email channels.
Perform integration testing with backend systems (APIs, case management, data services).
Test agent handoff and escalation workflows to ensure seamless transitions.
Ensure consistency of customer experience across multiple communication channels.
Conduct User Experience (UX) testing for clarity, usability, and interaction quality.
Perform Data Quality testing to validate accuracy and completeness of data used by AI systems.
Develop and maintain QA automation frameworks and test suites.
Design and implement AI-driven test suites to validate model accuracy, response quality, consistency, and overall system behavior.
Build and maintain API test automation.
Develop conversation simulation tests for AI interaction validation.
Maintain and enhance regression automation suites.
Integrate QA automation into CI/CD pipelines to enable continuous testing. Required Skills & Expertise Strong experience in QA methodologies and automation frameworks.
Hands-on experience testing AI/LLM-based applications.
Experience with API testing and automation tools (e.g., pytest, Postman, REST frameworks).
Understanding of multi-channel communication systems (chat, voice, email).
Experience with CI/CD tools and pipeline integration.
Strong analytical and problem-solving skills.
This is a remote position.
Recommended Jobs
Receiving Coordinator
Job Description Job Description Job Title: Receiving Coordinator Location: Middlesex, NJ Pay Rate: $20 - $24 an hour Shift: 1:00 pm - 9:00 pm A highly reputable company is looking…
Travel ER RN
Travel ER RN Company: Fusion Medical Staffing Location: Facility in Somers Point, New Jersey Job Details Fusion Medical Staffing is seeking a skilled ER RN for a 12-week travel assignme…
Hospitalist - 3900
Hospitalist – 3900 Stress LESS – Rehab Work *Minutes outside of NYC, is one of the best places to live in NJ. Or just do a reverse commute! *Need an Internal Medicine Physician/Hospitalist to w…
Assistant Coach Acro & Tumbling
Job Description Job Description This part-time position provides assistance in planning, budgeting, organizing, recruiting and maintaining a well-balanced, competitive NCAA Division 2 Acrobatics …
Physician Assistant - Long Term Care
Looking for a job with full benefits, no call, no nights and no weekends? A skilled nursing facility in North Bergen, NJ is looking for a full-time Physician Assistant to provide primary and post-acu…
Chief Engineer - Maintenance Technician III
POSITION SUMMARY Respond and attend to guest repair requests. Communicate with guests/customers to resolve maintenance issues with little to no supervision. Perform preventive maintenance on to…
Travel Speech Language Pathologist (SLP)
Travel Speech Language Pathologist Company: Fusion Medical Staffing Location: Facility in Morristown, New Jersey Job Details Fusion Medical Staffing is seeking a skilled Speech Language…
Veterinarian
Associate Veterinarian near the New Jersey Shore! Parkway Veterinary Hospital was established in 1986. In an ideal location, close to the sandy beaches of the Atlantic Ocean and the natural stran…
Licensed Practical Nurse (LPN/LVN)
Join a Company That Puts People First! Licensed Practical / Vocational Nurse – LPN/LVN We are one of the largest private duty nursing companies in the nation and growing! At Aveanna, we’re proud…
Sr. Clinical Research Associate
SystImmune is a leading and well-funded clinical-stage biopharmaceutical company located in Redmond, WA and Princeton, NJ. It specializes in developing innovative cancer treatments using its establis…