US Company Public Release Web Scraping Project

Posted yesterday

Only freelancers located in the U.S. may apply.U.S. located freelancers only

Summary

I need a developer to collect real press releases and extract the main body text into 480 individual .txt files. Each file represents a unique combination of company ticker, year, and category. There are 96 ticker–year pairs and 5 categories. The developer must remove boilerplate, disclaimers, forward looking statements, and “About the Company” sections. No repeated articles are allowed. A master Excel spreadsheet must also be generated with working hyperlinks to each .txt file and source URLs. Developer must provide all .txt files, the Excel tracker, and a README. I do not need source code. PROJECT REQUIREMENTS DOCUMENT Automated Collection and Extraction of Real Press Releases into Individual .txt Files with Master Excel Tracker 96 Ticker–Year Pairs × 5 Categories = 480 Files Summary The client, Christopher, requires a developer to collect real corporate press releases for a defined set of 96 ticker–year combinations, extract the main body text only, and save each release as an individual .txt file across five predefined categories, resulting in 480 total files. The developer must ensure no repeated articles, remove boilerplate and disclaimers, and produce a master Excel spreadsheet containing metadata and working hyperlinks to each .txt file. Preferred sources include BusinessWire, GlobeNewswire, PR Newswire, and official company investor relations sites. The final deliverables include all .txt files, the Excel tracker, and documentation. 1. Project Overview The developer must: Collect real press releases from reputable sources Extract only the main press release body Generate 480 individual .txt files Ensure each press release is unique Remove boilerplate, disclaimers, and forward looking statements Create a master Excel tracker with working hyperlinks Document all source URLs 2. Input Data: 96 Ticker–Year Combinations The developer must use the following exact list: AAOI 2016 AAOI 2017 AAOI 2018 AAOI 2020 AAOI 2021 AAOI 2023 AAPL 2013 AAPL 2015 AAPL 2018 AAPL 2020 AAPL 2021 AAPL 2023 ACN 2014 ACN 2016 ACN 2021 ACN 2022 CALX 2015 CALX 2017 CALX 2020 CALX 2022 CALX 2023 CALX 2025 CIEN 2014 CIEN 2016 CIEN 2018 CIEN 2020 CIEN 2023 CIEN 2025 CSCO 2012 CSCO 2014 CSCO 2016 CSCO 2018 CSCO 2023 CSCO 2025 CTSH 2015 CTSH 2017 CTSH 2019 CTSH 2021 DELL 2018 DELL 2020 DELL 2021 DELL 2023 FFIV 2013 FFIV 2014 FFIV 2018 FFIV 2019 FFIV 2020 FFIV 2021 HPE 2019 HPE 2021 HPE 2022 HPE 2023 HPQ 2012 HPQ 2013 HPQ 2017 HPQ 2018 HPQ 2020 HPQ 2021 IBM 2013 IBM 2014 IBM 2018 IBM 2019 IBM 2021 IBM 2022 KD 2023 KD 2024 LITE 2018 LITE 2019 LITE 2021 LITE 2022 PLTR 2022 PLTR 2023 PLTR 2024 PLTR 2025 QCOM 2015 QCOM 2016 QCOM 2018 QCOM 2020 QCOM 2021 QCOM 2023 RBBN 2017 RBBN 2018 RBBN 2023 RBBN 2024 STX 2013 STX 2015 STX 2016 STX 2018 STX 2019 STX 2020 WDC 2012 WDC 2014 WDC 2018 WDC 2019 WDC 2021 WDC 2023 Total: 96 unique combinations 3. Category Definitions Each ticker–year pair must produce five press releases, one for each category: CAT1 Product or Technology Launch A real press release announcing a product, service, platform, or technology innovation. CAT2 Organizational or Leadership Change A real press release describing leadership transitions, executive appointments, restructuring, or organizational realignment. CAT3 Strategic Positioning A real press release describing strategic direction, market repositioning, long term initiatives, or competitive strategy. CAT4 Partnership or Collaboration A real press release announcing alliances, joint ventures, ecosystem partnerships, or technology collaborations. CAT5 Financial or Market Update A real press release summarizing financial performance, market expansion, revenue trends, or investor focused updates. 4. Preferred Sources for Press Releases Primary Preferred Sources Business Wire GlobeNewswire PR Newswire MarketWire AccessWire Newswire.com Official company investor relations websites Examples include Cisco Newsroom, Apple Newsroom, IBM Press Room Secondary Acceptable Sources Official company blogs or newsroom posts Archived press releases from corporate websites SEC Exhibits such as 8 K press release attachments Industry trade publications that publish full press releases such as LightReading or TelecomTV Sources Not Allowed News articles Analyst reports Blog commentary Social media posts Marketing landing pages Product documentation Investor presentations Earnings call transcripts Source Documentation Requirement Developer must record the URL of each press release and include it in the Excel tracker. 5. Press Release Extraction Requirements Developer must extract only: Headline Dateline Main press release body paragraphs Developer must not include: Forward looking statements Legal disclaimers About the Company boilerplate Investor relations footers Contact information Copyright notices Subscription links Web tracking junk Email addresses Phone numbers No repeated articles All 480 files must contain unique press releases. No article may be reused across categories or years. 6. Output Requirements 6.1 Individual .txt Files Developer must generate one .txt file per Ticker × Year × Category. 6.2 File Naming Convention TICKER_YEAR_CAT1 ProductLaunch.txt TICKER_YEAR_CAT2 LeadershipChange.txt TICKER_YEAR_CAT3 StrategicPositioning.txt TICKER_YEAR_CAT4 Partnership.txt TICKER_YEAR_CAT5 FinancialUpdate.txt Example: ACN_2022_CAT4_Partnership.txt AAPL_2020_CAT1_ProductLaunch.txt RBBN_2024_CAT2_LeadershipChange.txt 6.3 Directory Structure Preferred: output AAOI AAOI_2016_CAT1_ProductLaunch.txt AAOI_2016_CAT2_LeadershipChange.txt ... AAPL AAPL_2013_CAT1_ProductLaunch.txt ... 7. Excel Master Spreadsheet Requirements Required Columns Ticker Year CategoryNumber CategoryName Filename Filepath FileLink SourceURL FileLink Requirements Must use relative paths Must work on Windows Must open the .txt file directly Example: HYPERLINK output AAOI AAOI_2016_CAT1_ProductLaunch.txt, Open File 8. Technical Requirements Developer may use any language. Developer Responsibilities Locate real press releases Extract only the main body Save each press release to its own .txt file Build the Excel master tracker Ensure all links work Ensure all content is legally sourced Ensure no repeated articles Provide documentation 9. Deliverables 480 .txt files Master Excel tracking spreadsheet README including instructions and source documentation 10. Acceptance Criteria All 480 .txt files exist All files contain real press release text All boilerplate and disclaimers removed All files follow naming conventions All press releases are unique Excel master file contains working links Developer provides documentation

  • Less than 30 hrs/week
    Hourly
  • < 1 month
    Duration
  • Intermediate
    Experience Level
  • $25.00

    -

    $35.00

    Hourly
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Mandatory skills
Data Scraping
Data Mining
Activity on this job
  • Proposals:5 to 10
  • Last viewed by client:yesterday
  • Interviewing:
    2
  • Invites sent:
    1
  • Unanswered invites:
    0
About the client
Member since Jul 30, 2026
  • United States
    9:07 AM

Explore similar jobs on Upwork

Artificial Intelligence
AI Agent Development
Automation
AI Development
Python
AI App Development
Document AI
Generative AI
AI Bot
AI Chatbot
Data Extraction
LLM Prompt Engineering
LangChain
OCR Algorithm
Prompt Engineering
Claude
n8n
AI Implementation
Retrieval Augmented Generation
AI Model Integration
Patent Data CollectionHourly‐ Posted 3 days ago
Data Entry
Patent
Data Collection

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo