AQA Python Specialist, Data/Python Developer with a interest in QA and AI-based document processing.
Worldwide
The role requires a solid understanding of test automation in Python, OCR pipelines, document extraction workflows, RAG, embeddings, chunking strategies, large document processing, and AI evaluation concepts such as extraction accuracy, field-level precision/recall, citation correctness, confidence scoring, hallucination detection, and regression testing. C# and TS/JS experience would be a plus. :test_tube: Should be able to build an evaluation framework from scratch for AI/OCR-based extraction systems, including golden datasets, expected structured outputs, automated comparison logic, dashboards, and release gates. :page_facing_up: The role will also include manual testing of business workflows, document-processing flows, UI forms, task management, communication flows, and operator scenarios. The person should be able to deeply understand the current system, business logic, edge cases, and expected operator behavior, not just click through screens. :cloud: Experience with Azure AI services is highly desirable, especially Azure AI Document Intelligence / OCR, Azure OpenAI, Azure AI Search, and document-processing pipelines involving PDFs, scanned documents, tables, layouts, RAG, embeddings, chunking, large document retrieval, and source citations. :dart: This position requires someone who is curious, detail-oriented, ready to learn the business domain, and capable of combining automation, data validation, manual QA, and AI evaluation into one practical testing approach.
- More than 30 hrs/weekHourly
- 6+ monthsDuration
- ExpertExperience Level
$30.00
-
$40.00
Hourly- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:15 to 20
- Last viewed by client:last week
- Interviewing:5
- Invites sent:0
- Unanswered invites:0
About the client
- United StatesBrooklyn9:27 PM
- $277K total spent24 hires, 4 active
- 9,845 hours
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by