Full Stack SQA Engineer for AI Based Product (Manual + Automation QA)
Worldwide
We are building and maintaining a growing AI-based software product, and quality is one of our highest priorities. Because our product is powered by AI, testing goes beyond traditional pass/fail checks — outputs can be dynamic and non-deterministic, so we need someone who understands how to test AI-driven features and validate their quality reliably. As our application expands, we need a dedicated quality specialist who can take complete ownership of testing — not just execute test cases, but actually think about our product, anticipate where things can break, and build a testing process that keeps our releases stable and reliable. This is NOT a short, one-off task. We are looking for one committed professional for a long-term engagement who can grow with our project, understand it deeply over time, and become the single reliable point of quality assurance for our team. If you are the kind of engineer who takes pride in shipping bug-free software and treats the product as if it were your own, this role is for you. ------------------------------------------------------------------------ THE ROLE IN A NUTSHELL ------------------------------------------------------------------------ You will be our Full Stack SQA (Software Quality Assurance) Engineer, responsible for managing and executing both manual and automation testing across the entire application. You will design the testing strategy, write and maintain automated test suites, run manual test passes where needed, test our APIs, report and track bugs to closure, and continuously improve how we approach quality. On top of traditional QA skills, we want someone who actively uses AI tools to work faster and smarter — generating test cases, improving coverage, and reducing repetitive manual effort. Because this is a long-term role, we want someone who communicates clearly, works independently, meets deadlines, and can be trusted to manage the quality of the product without needing to be micromanaged. ------------------------------------------------------------------------ KEY RESPONSIBILITIES ------------------------------------------------------------------------ MANUAL TESTING - Analyze requirements, user stories, and designs to create clear, thorough test plans and test cases. - Perform functional, regression, smoke, sanity, exploratory, cross-browser, and cross-device testing on web applications. - Verify UI/UX against designs and expected behavior, catching both obvious and edge-case issues. - Execute manual test passes before major releases to ensure stability. AUTOMATION TESTING - Design, build, and maintain automated test suites using Selenium and Playwright. - Write clean, reusable, and maintainable automation code in Python and JavaScript. - Build and structure test frameworks (Page Object Model or similar) so tests stay maintainable as the product grows. - Keep automated suites up to date as features change, and reduce test flakiness. - Integrate automated tests into the development workflow / CI pipeline where applicable. API TESTING - Test REST APIs thoroughly using Postman — validating responses, status codes, schemas, authentication, error handling, and edge cases. - Build and maintain reusable Postman collections and, where useful, automate API test runs. - Verify data integrity between the frontend, backend, and database. BUG REPORTING & QUALITY MANAGEMENT - Log clear, detailed, reproducible bug reports (steps, expected vs. actual, screenshots, logs, environment). - Track bugs through their full lifecycle and verify fixes before closing. - Prioritize issues by severity and impact, and communicate risks to the team. - Own and continuously improve the overall QA process, standards, and documentation. TESTING THE AI FEATURES (CORE TO THIS ROLE) - Test our AI-based / AI-driven features, where outputs may be dynamic and non-deterministic (e.g., AI-generated responses, recommendations, content, or predictions). - Validate the quality, relevance, accuracy, and consistency of AI outputs, and flag issues such as wrong answers, hallucinations, biased or unsafe responses, and broken formatting. - Design test approaches for non-deterministic behavior (acceptable ranges, expected patterns, guardrails) rather than only exact-match checks. - Test prompts, inputs, and edge cases to make sure the AI behaves reliably across a wide variety of scenarios. - Verify AI integrations and API responses (including third-party AI / LLM APIs) work correctly end to end. AI-ASSISTED TESTING (USING AI TO WORK FASTER) - Use AI tools to accelerate and improve our testing work — for example, generating test cases from requirements, expanding test coverage, drafting automation scripts faster, analyzing logs, and reducing repetitive manual work. - Bring ideas on how AI can make our QA process more efficient over time. ------------------------------------------------------------------------ REQUIRED SKILLS & EXPERIENCE ------------------------------------------------------------------------ - Proven, hands-on experience as a QA / SQA Engineer in BOTH manual and automation testing. - Strong programming ability in Python and JavaScript for writing automation. - Solid, real-world experience with Selenium. - Solid, real-world experience with Playwright. - Strong API testing experience using Postman. - Practical experience using AI tools to improve testing speed, coverage, and efficiency. - Understanding of how to test AI-based / AI-driven features, including handling non-deterministic outputs and validating AI response quality (a strong plus, and important for this specific project). - Ability to design test strategies and manage the full testing process independently. - Strong attention to detail and a genuine "break-it-before-users-do" mindset. - Good English communication skills — written and verbal. - Reliability, self-management, and consistent availability for a long-term remote role. ------------------------------------------------------------------------ NICE TO HAVE (BONUS, NOT REQUIRED) ------------------------------------------------------------------------ - Experience integrating automated tests into CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI, etc.). - Experience building test frameworks from scratch. - Performance / load testing exposure (e.g., JMeter, k6). - Familiarity with Git and modern development workflows. - Experience testing in Agile / Scrum teams. - Basic knowledge of databases and writing SQL queries for data validation. ------------------------------------------------------------------------ WHAT WE'RE LOOKING FOR IN A PERSON ------------------------------------------------------------------------ - Someone dependable who we can trust with the quality of our product long-term. - A clear communicator who reports progress and raises risks early. - Someone organized who can manage their own workload and meet deadlines. - A problem-solver who is curious, thorough, and takes ownership rather than waiting to be told every step. ------------------------------------------------------------------------ WHAT YOU CAN EXPECT FROM US ------------------------------------------------------------------------ - A long-term, stable engagement with steady work. - Clear requirements, cooperative communication, and prompt feedback. - The freedom to shape and improve our QA process. - Room to grow with the project over time. ------------------------------------------------------------------------ HOW TO APPLY ------------------------------------------------------------------------ To help us find the right fit, please include the following in your proposal: 1. A brief overview of your experience in manual and automation testing (mention the types of projects you've tested). 2. Links to sample work — GitHub repositories, automation test suites, portfolios, or examples of test cases/frameworks you've built. 3. Which of these you've used in real projects: Python, JavaScript, Selenium, Playwright, Postman. 4. One concrete example of how you've used AI tools to improve your testing work. 5. Any experience you have testing AI-based products or validating AI/LLM outputs (this is a big plus for our project). 6. Your availability (hours per week / timezone overlap) and confirmation that you're looking for a long-term role. Applications that clearly address the points above will be prioritized. Generic copy-paste proposals will not be considered. We look forward to working with a quality-focused professional who takes pride in their craft.
- More than 30 hrs/weekHourly
- 6+ monthsDuration
- ExpertExperience Level
$10.00
-
$15.00
Hourly- Remote Job
- Complex projectProject Type
Skills and Expertise
Activity on this job
- Proposals:50+
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- United StatesSugar Land10:38 AM
- $44K total spent87 hires, 3 active
- 2,660 hours
- Individual client
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by