Python Utility for Duplicate Line Detection

Posted 4 weeks ago

Worldwide

Summary

Need to develop a Python utility for detecting duplicate lines in a text file. The script should read a TXT file, identify duplicate entries (such as URLs, emails, usernames, or any repeated text lines), and generate a report showing unique values, duplicate values, and the number of occurrences for each duplicate. The user should be able to save the cleaned data (without duplicates) into a new TXT file. Clean code structure, basic error handling, and a short README with usage instructions are required.

$10.00
Fixed-price
Intermediate
Experience Level
Remote Job
One-time project
Project Type

Skills and Expertise

Mandatory skills

Python

Machine Learning

Nice-to-have skills

Scrapy

Django

Activity on this job

Proposals:20 to 50
Last viewed by client:4 weeks ago
Hires:
1
Interviewing:
7
Invites sent:
9
Unanswered invites:
1

About the client

Member since May 14, 2026

UKR
Kyiv7:54 PM
$70 total spent
7 hires, 0 active

Explore similar jobs on Upwork

Job Aggregation and Dashboard CreationHourly‐ Posted 8 months ago

Automation

Data Scraping

Data Extraction

API

UI/UX Prototyping

Web Scraping

AI UGC Video Generator - n8n WorkflowHourly‐ Posted 7 months ago

Automation

AI Agent Development

CRM Automation

Artificial Intelligence

Business Services

AI Content Creation

Make.com

n8n

OpenAI API

Business Process Automation

Lead Generation

Google Ads

Email Automation

Social Media Marketing Automation

Omnichannel Automation

How it works

Create your free profile
Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you want
Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securely
From contract to payment, we help you work safely and get paid securely.