AI + API Integration Developer (ShopMetrics + Claude) for Mystery Shopping Validation Platform

Posted 2 weeks ago

Worldwide

Summary

Project Overview We use ShopMetrics as our mystery shopping platform. Evaluators complete detailed surveys, ratings, narratives, and verbatim comments that are returned to ShopMetrics for manual validation and quality review. We are seeking a developer to build an AI-powered validation and report-processing workflow that integrates with ShopMetrics and Claude. The goal is not simply to edit reports. The system should function as an intelligent quality assurance layer that reviews completed mystery shop submissions, identifies issues, improves report quality, and either automates corrections or routes exceptions for human review. The system should: • Pull completed assignments from ShopMetrics via API • Analyze the entire report, including scored questions, yes/no or similar multiple choice responses, narratives, and verbatim comments • Validate that survey responses and written comments are logically consistent and do not contradict one another • Identify situations where a score, answer selection, or narrative conflicts with other information contained within the report • Detect missing information, insufficient detail, unanswered questions, incomplete narratives, or gaps that prevent the report from meeting client standards • Apply Coyle-specific validation rules, editorial guidelines, style standards, and business requirements • Rewrite and enhance narratives and verbatim comments to meet established standards for grammar, spelling, clarity, professionalism, tone, formatting, and consistency while preserving the evaluator’s observations and intent • Standardize report language and reporting style across evaluators without normalizing the content too much • Flag content that appears fabricated, inconsistent, vague, unsupported, or otherwise requires further review • Generate specific validation notes explaining why a report failed review and what corrections are required • Where possible, automatically generate feedback requests that can be sent back to the evaluator identifying missing information or required revisions • Support workflows where reports are either: * Automatically approved when confidence thresholds are met * Routed to human validators for review * Returned to evaluators for clarification or revision • Maintain a complete audit trail showing: * Original submission * AI-generated recommendations * AI-rewritten content * Human edits and approvals * Final version written back to ShopMetrics • Write approved and validated content back into ShopMetrics via API for downstream processing and client delivery We understand that ShopMetrics provides a full API (v3) with query and command endpoints for retrieving and updating data. We also understand that similar AI-assisted validation workflows have successfully been implemented by other organizations using ShopMetrics and Claude. We are looking for an experienced developer who can design and implement a production-ready version of this capability.

  • Less than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Complex project
    Project Type
Skills and Expertise
Mandatory skills
JSON
AWS Lambda
API
Claude
Activity on this job
  • Proposals:50+
  • Last viewed by client:last week
  • Interviewing:
    3
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Oct 28, 2015
  • United States
    Mahopac4:52 PM
  • $881K total spent
    69 hires, 9 active
  • 36,998 hours

Explore similar jobs on Upwork

Software DeveloperHourly‐ Posted 7 months ago
ASP.NET MVC
Django
Python
AngularJS
JavaScript
jQuery
WordPress
Google Chrome Extension
React
CRM Development
Microsoft Dynamics 365
Microsoft Dynamics CRM
Microsoft Dynamics Development
Microsoft PowerApps
Single Sign-On
Three.js
JavaScript
WordPress
AR Plugin
WooCommerce
3D Modeling

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo