Wallpaper Product Catalog Data Pipeline, n8n Workflow, LLM Processing & Cloud Run Service

Posted yesterday

Worldwide

Summary

We're looking for a developer to build a complete product data pipeline for our wallpaper catalog. All 5 components are bundled into a single fixed-price contract of $200 USD, paid as one milestone upon completion of all of them. What needs to be done: 1) Cloud Run Scraper Service Setup: Set up a reliable Python-based scraper service deployed on Google Cloud Run. The service should be able to retrieve product pages from our own website catalog reliably and efficiently. 2) Python Scraper for Wallpaper Product Catalog: Build a Python scraper that collects all wallpaper product data from our catalog. The scraper should handle pagination and extract all relevant product fields (name, images, dimensions, SKU, category, etc.). 3) n8n Automation Workflow: Create an n8n workflow that orchestrates the data pipeline end to end: triggering the scraper, collecting output, and passing data to downstream steps (LLM processing, JSON generation, and storage). 4) LLM-Based Name Translation and Data Processing: Integrate an LLM step (e.g. OpenAI or similar) to translate product names and normalize the data. Output should be clean, structured product records ready for import. 5) JSON Output Generation and BE Service: Generate a standardized JSON file of all collected and processed products. The backend service on Cloud Run should expose this data and include logic to detect changes between runs (e.g. new products, updated fields, removed items). Deliverables: - All services deployed and running on Google Cloud Run. - n8n workflow exported and documented. - JSON output file with full product catalog. - BE service with change-detection logic. - A short handover note explaining the architecture, environment variables, and how to re-trigger the pipeline. Timeline: roughly 7 to 10 business days total. Revisions: up to 2 rounds of revisions per component within original scope, included. IP and Confidentiality: All code becomes our property upon final payment. Contractor agrees not to share or reuse the codebase or business logic. Ideal candidate: intermediate-to-senior Python developer comfortable with data pipelines, n8n, LLM APIs, and Google Cloud Run deployments. When applying, please briefly mention similar data pipeline or automation work you have done.

  • $200.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Data Scraping
Web Scraping
Activity on this job
  • Proposals:20 to 50
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Sep 2, 2023
  • Israel
    Givatayim5:40 AM
  • $2.3K total spent
    26 hires, 2 active
  • 20 hours
  • Retail & Consumer Goods
    Small company (2-9 people)

Explore similar jobs on Upwork

Local Lead GenerationHourly‐ Posted 2 weeks ago
Web Scraping
Data Scraping
Data Extraction
Lead Generation
Data Entry
Data Mining
Data Collection
Data Processing
Web Scraping Framework
Web Crawler Framework
Web Scraping Software
Web Scraping Plugin
Web API
Search Tool
Search Engine
Microsoft Word
Data Entry
Administrative Support
Microsoft Excel

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo