Senior Magento Data Engineer

Posted last month

Worldwide

Summary

SCOPE 1 — MAGENTO PRODUCT DATA CORRECTION & STANDARDISATION Fixed Price: $2,000 1. Existing Catalogue Data Correction * Analyse the existing Magento 2 catalogue of approximately 287,981 products. * Identify and decode Magento option IDs incorrectly stored instead of readable attribute values. * Correct encoded attribute values across the relevant product families. * Correct ABEC ratings and other affected technical attributes. * Fix approximately 1,375 SKUs containing Cyrillic characters. * Correct and normalise affected attribute sets and product data. * Write corrected values into the appropriate Magento fields. * Validate the corrected data after processing. 2. Technical Data Standardisation * Standardise product technical values and units. * Normalise measurements and SI units where applicable. * Map/classify products against ETIM and eCl@ss structures where the required data is available. * Apply relevant ISO / DIN / EN technical conventions to the product data. 3. Search & Indexing * Rebuild Elasticsearch indexes after data correction. * Rebuild/update Qdrant vector indexes. * Verify product search and indexing after the migration. 4. FR + EN Technical Content * Generate structured technical product descriptions and specification summaries from corrected product attributes. * Support both French and English. * Ensure generated content is based on actual structured product data. 5. Automated Data Pipeline * Build an automated validation and correction workflow for incoming ETL data. * Detect encoded values, invalid SKUs, inconsistent units and other known data issues. * Validate and standardise products before they become live. * Prevent the identified historical import errors from being reintroduced by future ETL batches. SCOPE 2 — AI PRODUCT & ATTRIBUTE IMAGE AUTOMATION Fixed Price: $2,000 1. Magento Image Detection * Detect products without required images. * Detect attributes and attribute options missing images. * Retrieve required data through Magento REST APIs. * Create a processing queue for image generation. 2. AI Image Generation Pipeline * Build a dedicated AI image-generation workflow. * Create an automated prompt builder based on product and attribute data. * Generate consistent technical product images. * Generate technical specification and attribute diagrams. * Maintain a consistent visual style across the catalogue. * Generate square images with a target final resolution of 2048x2048. 3. Image Processing * Remove backgrounds where required. * Upscale images to the required resolution. * Sharpen and optimise image quality. * Convert images to WebP and compress them. * Add relevant metadata such as SKU and attribute information. 4. Magento Integration * Automatically upload generated images to Magento. * Assign product images to the correct SKUs. * Store and reference attribute/specification images appropriately. * Implement the required Magento integration and display templates. 5. Full Automation * Automatically detect missing images. * Generate appropriate prompts. * Generate images through the selected AI provider. * Process and optimise generated images. * Upload and assign images to Magento. * Implement logging and error handling. * Run the workflow through scheduled/cron-based processing for future products. 6. Quality Control * Validate generated images against the required technical style. * Check resolution, orientation and image quality. * Ensure product images do not contain unwanted text or visual artifacts. * Validate attribute diagrams for consistency and clarity. 7. Documentation * Document the complete architecture and workflow. * Document configuration and maintenance procedures. * Provide documentation for future operation and maintenance. TOTAL PROJECT Scope 1 — Magento Data Correction & Standardisation: $2,000 Scope 2 — AI Product & Attribute Image Automation: $2,000 TOTAL FIXED PRICE: $4,000 The objective is to deliver both systems as reusable and automated workflows, so they can continue processing future catalogue imports rather than being only a one-time correction.

  • $4,000.00

    Fixed-price
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
SQL
PHP
JavaScript
MySQL
Activity on this job
  • Proposals:15 to 20
  • Last viewed by client:3 weeks ago
  • Interviewing:
    6
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Oct 26, 2015
  • France
    Brignais7:37 AM
  • $257K total spent
    158 hires, 14 active
  • 9,791 hours
  • Manufacturing & Construction
    Mid-sized company (10-99 people)

Explore similar jobs on Upwork

Data engineering interview mock prepHourly‐ Posted 2 weeks ago
Database Design
SQL
Python
Data Modeling
CoachHourly‐ Posted 1 month ago
Data Engineering
ETL Pipeline
Databricks Platform
Data Warehousing & ETL Software
Data Migration
Azure Cosmos DB
API Development
PySpark
Azure Cognitive Services
.NET Core
Database Integration
Big Data
AWS Glue
Microsoft Azure SQL Database
Data Lake
C#
Python

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo