AQA Python Specialist, Data/Python Developer with a interest in QA and AI-based document processing.

Posted 3 weeks ago

Worldwide

Summary

The role requires a solid understanding of test automation in Python, OCR pipelines, document extraction workflows, RAG, embeddings, chunking strategies, large document processing, and AI evaluation concepts such as extraction accuracy, field-level precision/recall, citation correctness, confidence scoring, hallucination detection, and regression testing. C# and TS/JS experience would be a plus. :test_tube: Should be able to build an evaluation framework from scratch for AI/OCR-based extraction systems, including golden datasets, expected structured outputs, automated comparison logic, dashboards, and release gates. :page_facing_up: The role will also include manual testing of business workflows, document-processing flows, UI forms, task management, communication flows, and operator scenarios. The person should be able to deeply understand the current system, business logic, edge cases, and expected operator behavior, not just click through screens. :cloud: Experience with Azure AI services is highly desirable, especially Azure AI Document Intelligence / OCR, Azure OpenAI, Azure AI Search, and document-processing pipelines involving PDFs, scanned documents, tables, layouts, RAG, embeddings, chunking, large document retrieval, and source citations. :dart: This position requires someone who is curious, detail-oriented, ready to learn the business domain, and capable of combining automation, data validation, manual QA, and AI evaluation into one practical testing approach.

  • More than 30 hrs/week
    Hourly
  • 6+ months
    Duration
  • Expert
    Experience Level
  • $30.00

    -

    $40.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Python
Artificial Intelligence
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:3 weeks ago
  • Interviewing:
    5
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Sep 9, 2008
  • United States
    Brooklyn7:56 AM
  • $277K total spent
    25 hires, 5 active
  • 9,852 hours

Explore similar jobs on Upwork

Test Automation Framework
Automated Testing
JavaScript
Python
Auto-GPT
Go High Level ExpertHourly‐ Posted 1 month ago
Affiliate Marketing
Internet Marketing
Email Marketing
Search Engine Optimization

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo