Independent second rater - title and abstract screening for a psychology scoping review (Covidence)
Worldwide
I am a psychology researcher and I need an independent second rater for study selection on a scoping review. This is a screening job, not a writing job. THE FULL JOB - TWO STAGES Stage 1: Title and abstract screening of approximately 105 records in Covidence. Stage 2: Full-text screening of whatever passes Stage 1 (expect roughly 30-40 records). Both stages are independent dual screening. You screen blind to my decisions, we then calculate percentage agreement and Cohen's kappa, and resolve every conflict by discussion. I will provide a two-page written criteria brief covering the definitions, the include and exclude rules, worked examples of the hardest exclusions, and the known false-positive traps in this search. I will set up your reviewer account in Covidence. The topic is psychological interventions that support people through major life transitions. You do not need subject expertise - the criteria are written out and the definitions are given. Related social science or health backgrounds are fine. WHAT MATTERS TO ME Careful, consistent application of a fixed set of criteria across a long list. Specifically: - Every exclusion needs a one-line reason naming the rule it fails, not a general impression. - Genuinely ambiguous records should be flagged as Maybe with a short note, rather than guessed. There is no penalty for using Maybe - I would much rather have three honest Maybes than three confident coin-flips. - Attention needs to hold at record 90 as well as record 5. HOW I WOULD LIKE TO STRUCTURE IT Stage 1 as its own contract first. If it goes well, Stage 2 follows as a separate contract on the same basis. The Stage 1 batch includes a small number of records I have already screened myself, so that we can both see how our agreement looks before going further. PLEASE TELL ME 1. Which review was your last independent dual screening for - the topic, roughly how many records, and what the agreement or kappa came out at. I ask for specifics because screening and review writing are different skills and it is the first one I am hiring for. 2. Whether you have used Covidence, or another screening platform. 3. Your quote for Stage 1, and your availability over the next two weeks. I have not set a budget because I would rather hear your own number than have you work backwards from mine. Please also raise any questions about the criteria before screening begins rather than resolving them silently along the way.
- Less than 30 hrs/weekHourly
- < 1 monthDuration
- IntermediateExperience Level
- Remote Job
- One-time projectProject Type
Skills and Expertise
Activity on this job
- Proposals:20 to 50
- Last viewed by client:2 weeks ago
- Hires:1
- Interviewing:23
- Invites sent:17
- Unanswered invites:5
About the client
- AUSStrathfield3:44 PM
- 1 hire, 0 active
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by