Reddit Data Collection: r/adjusters Complete Thread and Comment Scrape
Worldwide
I need a Python developer to collect complete thread and comment data from Reddit's r/adjusters subreddit for a research project. SCOPE All threads and all comments — including nested replies at every depth — from the trailing 24 months. Nested replies are essential. I need the full conversation structure, not just top-level posts. OUTPUT JSON or CSV — tell me which you prefer and why. Each record should include: thread title, thread URL, author, timestamp, comment text, comment depth, parent ID, upvote count, and any metadata you think adds value. Deleted and removed comments should be handled explicitly rather than silently dropped. DELIVERABLES 1. A paid test run on one week of data so I can validate the format before full collection 2. The complete dataset once the format is approved 3. A short note on your method — library used, rate-limit handling, deduplication approach PLEASE ANSWER THIS IN YOUR PROPOSAL: Reddit's API caps listing retrieval at roughly 1,000 items per sort order. How will you get complete coverage of a 24-month window despite that cap? TERMS Reddit's official API only. Compliant collection — no HTML crawling. If you see a better approach than what I've described, propose it rather than following my spec silently. WORKING STYLE I respond quickly and I'd rather hear about a problem early than receive a clean-looking file that's quietly incomplete. Ask questions.
$400.00
Fixed-price- IntermediateExperience Level
- Remote Job
- One-time projectProject Type
Skills and Expertise
Activity on this job
- Proposals:20 to 50
- Last viewed by client:2 hours ago
- Interviewing:3
- Invites sent:0
- Unanswered invites:0
About the client
- USAPhoenix2:53 PM
- $175 total spent1 hire, 0 active
- LegalMid-sized company (10-99 people)
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by