Backend Engineer Needed for Collection System Pipeline

Posted 4 days ago

Worldwide

Summary

I need someone who is able to take a handful of local scripts that collect various data across the internet, parse, enrich and then store that data into our web application. The scripts interact with various 3rd parties, and should be built to scale with a large amount of customers and data-points that we'll be querying, so speed, scalability, accuracy are all things we need. Ultimately, we'll need to move about 30 or so local scripts into AWS with them running as efficient as possible. We should expose metrics for these scripts as well, so we can see how much we're spending for each script and what not. Some example services we work with include social media platforms, various REST API's, LLM's, we can be language-agnostic as well, but prefer Python for ease of use. Looking for someone who has immediate time available for this, we are ready to hire someone ASAP, and would need them available for a lot of hours in the next 2-3 weeks, with potential opportunities for future contracting work.

  • Less than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Intermediate
    Experience Level
  • $15.00

    -

    $35.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Python
ETL Pipeline
Database
Activity on this job
  • Proposals:50+
  • Last viewed by client:4 days ago
  • Interviewing:
    1
  • Invites sent:
    1
  • Unanswered invites:
    0
About the client
Member since Mar 10, 2017
  • United States
    Perry Hall5:59 AM
  • $62K total spent
    53 hires, 3 active
  • 2,256 hours

Explore similar jobs on Upwork

ASP.NET MVC
ASP.NET
.NET Framework
Apache HTTP Server
NGINX
API
JavaScript
Python
PHP
C#
Stapes.js
Google Tag Manager
Google Analytics 4

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo