Public Vietnam procurement data web scraping

Posted yesterday

Worldwide

Summary

We need publicly available Vietnam procurement records extracted and delivered as UTF-8 NDJSON, mapped to our existing PostgreSQL schema. You deliver data (plus a short field-mapping note) and its script. Source: public pages on dauthau / equivalent public listings. Target schema (we will share the full DDL after hire) Map records into these entity types (one NDJSON file per entity, or one file with entity_type): Procurement projects bidding_plans (KHLCNT) bid_packages bid_solicitations (TBMT) bid_documents (public file metadata/URLs only) bid_openings (KQMT) bid_submissions bid_results (KQLCNT) rfq_requests qualification / prequal notices if public investor selection results if public auction notices if public Organizations organizations (investor / procuring / contractor) org_roles contractor_profiles (public fields only) financial_reports (public fields only) consortia / joint-venture names when shown Keep source_url, source external_id, and raw payload so we can upsert: external_id unique per source source_url crawled_at (ISO 8601) raw_payload (original public HTML/JSON) raw_sha256 / checksum Required field quality Vietnamese text unchanged (UTF-8) Money as raw VND numbers Dates/times ISO 8601 Typed nulls: null or [] Nested arrays kept (goods lines, participants, non-winners, equipment, work items) Stable keys so we can ON CONFLICT (external_id) DO UPDATE Coverage Historical backfill of public listings After backfill: daily incremental updates (new + changed records)

  • $100.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Scrapy
Selenium
Data Scraping
Activity on this job
  • Proposals:20 to 50
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Jul 22, 2011
  • United States
    Newark7:54 AM
  • $7.8K total spent
    252 hires, 0 active
  • 705 hours
  • Education
    Large company (100-1,000 people)

Explore similar jobs on Upwork

Freelancers for Student Data CollectionFixed-price‐ Posted 3 weeks ago
Data Entry
Data Mining
Microsoft Excel
English
Data Entry
Data Scraping
Microsoft Excel

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo