AWS / Node.js Engineer – Scalable Video Processing Architecture
Worldwide
We are looking for a Senior Backend / AWS Engineer with strong experience in Node.js, TypeScript, AWS, and video processing to help us migrate and improve the video export infrastructure of one of our SaaS products. Our product is a video editor built with React, Node.js, and TypeScript. Currently, video exports/downloads are processed on our VPS. The main issue is scalability: video jobs are effectively processed sequentially. For example, if one user exports 5 videos, another user may have to wait until those 5 jobs are completed before their own video starts processing. We want to move this infrastructure to AWS and, more importantly, redesign the processing architecture so that video jobs can run concurrently and scale with demand. What you will do: Review our existing video export/download implementation and understand the current architecture. Propose a scalable AWS architecture for video processing. Implement the new architecture and migrate the existing system from our VPS. Design an asynchronous job/queue-based processing system. Allow video jobs from different users to be processed concurrently. Implement proper job status tracking, error handling, retries, and concurrency controls. Move generated videos to appropriate cloud storage. Avoid routing large video files through our main application server whenever possible. Set up appropriate logging and monitoring. Provide documentation so our team can understand and maintain the new infrastructure. We are considering services such as AWS S3, SQS, ECS/Fargate, Lambda, MediaConvert, and CloudFront, but we do not want to prescribe the architecture. We want someone who can first understand our current system and then recommend the simplest, most reliable, scalable, and cost-effective solution for our specific use case. Requirements Strong professional experience with AWS. Strong experience with Node.js and TypeScript. Experience designing asynchronous/job-based architectures. Experience with AWS S3, SQS, ECS/Fargate, or equivalent technologies. Experience with FFmpeg, video processing, video rendering, or media pipelines is highly preferred. Experience building scalable SaaS infrastructure. Ability to work with an existing codebase and understand the current implementation before proposing changes. Strong communication skills and ability to explain technical decisions clearly to a non-technical founder. Important We are not simply looking for someone to move our VPS to EC2. The main goal is to solve the underlying architecture and scalability problem so that jobs from different users do not block each other. For example: User A starts 5 video exports. User B starts 1 video export shortly afterwards. User B's video should be able to start processing without waiting for User A's 5 videos to finish. We are looking for a senior engineer who can analyze the current system, propose the right architecture, and implement the solution in production. To apply Please briefly explain how you would architect this system and which AWS services you would consider using. Also, please provide 1–2 examples of similar video processing, media processing, or asynchronous AWS systems you have built.
- Less than 30 hrs/weekHourly
- < 1 monthDuration
- IntermediateExperience Level
$7.50
-
$15.00
Hourly- Remote Job
- One-time projectProject Type
Skills and Expertise
Activity on this job
- Proposals:20 to 50
- Last viewed by client:3 days ago
- Interviewing:3
- Invites sent:0
- Unanswered invites:0
About the client
- ESPFuengirola9:44 AM
- $4.5K total spent7 hires, 4 active
- 426 hours
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by