Backend Engineer — Reliable Async Job Queue for AI API Calls
Worldwide
We're building a backend that makes a lot of calls to OpenAI/Anthropic and a few other third-party APIs, and we're hitting the usual problems: dropped jobs on timeouts, no retry/backoff strategy, rate limits (429s) breaking delivery, and no visibility into what actually ran vs. failed silently. Looking for a backend engineer to help us architect and implement a reliable async job pipeline — jobs get queued, retried with backoff on failure, rate-limited per downstream, and delivered to a webhook with acknowledgment. Comfortable working in Node.js/TypeScript or Python. Scope for this engagement: Review our current setup and recommend an approach (self-hosted queue vs. managed service — open to your recommendation) Implement retry/backoff, rate limiting, and dead-letter handling for failed jobs Set up webhook delivery with basic observability (logs / attempt history) This could grow into ongoing work if it's a good fit. Please include in your proposal: what you've used before for background jobs (Redis+BullMQ, SQS, Celery, RabbitMQ, Cloud Tasks, QStash, Inngest, or similar), and a project where you've handled retries/rate limits against a third-party API.
$3,000.00
Fixed-price- IntermediateExperience Level
- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:50+
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- United States7:54 PM
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by