Need Kaggle Expert for Search Relevance Competition (Current LB 0.903)

Posted 3 days ago

Worldwide

Summary

I am participating in a private Kaggle e-commerce search relevance competition and currently have a public leaderboard score of 0.903. The task is binary query-product relevance classification. The training data contains only positive labels, and the test set contains approximately 3.36 million query-product pairs. The evaluation metric is Macro F1. I already have an advanced working solution involving: - Semantic retrieval models - NLP ranking and reranking - LLM-based judging systems - Consensus-based label correction - Promote/demote label-flip strategies - Pseudo-labeling - Ensemble methods - Self-hosted open-source models I am NOT looking for a beginner machine learning tutor or someone to build a basic baseline from scratch. I need an experienced Kaggle competitor, preferably Kaggle Expert, Master, or Grandmaster level, who can review my current solution and identify the highest-impact improvements. Main goals: 1. Review my current pipeline, submissions, and experiment history. 2. Identify the main bottleneck after reaching a 0.903 leaderboard score. 3. Evaluate whether my consensus label-flip strategy is statistically sound. 4. Review my validation methodology and identify possible leaderboard overfitting. 5. Suggest the top 3–5 experiments most likely to improve the score. 6. Provide a concrete and prioritized action plan that can be executed quickly. Important technical constraint: The final solution must be fully reproducible offline and self-hosted. Paid APIs, free hosted APIs, commercial model endpoints, closed-source services, and any method that depends on an external online inference service are not allowed. The final predictions must be reproducible later without internet access. Therefore, all recommendations must be based on: - Open-source models - Downloadable model weights - Local or self-hosted inference - Offline reproducible pipelines - Reproducible preprocessing and prediction code Recommendations that depend on OpenAI, Anthropic, Google, proprietary hosted models, paid APIs, free APIs, or non-reproducible online services will not be considered. Preferred experience: - Kaggle competitions - NLP - Search relevance - Information retrieval - Ranking and reranking systems - Pseudo-labeling - Ensemble methods - Weak supervision or positive-unlabeled learning - Offline inference and self-hosted open-source models Expected deliverables: - A review of my current approach - Identification of the most important remaining bottleneck - A critique of the current validation and label-flip strategy - A ranked list of the highest-impact next experiments - A practical short-term action plan - Recommendations that comply with the offline and self-hosted requirement When applying, please include: - Your Kaggle profile - Your highest Kaggle rank - Competition medals or notable results - Relevant NLP, retrieval, ranking, or recommendation experience - Experience with pseudo-labeling and ensemble methods - Experience building offline and self-hosted machine learning pipelines This is initially a small consulting and solution-audit task. If the collaboration is successful, additional work may follow. Applications without a Kaggle profile or relevant competition experience will not be considered.

  • $50.00

    Fixed-price
  • Expert
    Experience Level
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Mandatory skills
Machine Learning
Natural Language Processing
Activity on this job
  • Proposals:Less than 5
  • Interviewing:
    1
  • Invites sent:
    1
  • Unanswered invites:
    0
About the client
Member since Jul 15, 2026
  • Turkey
    Adana1:54 PM

Explore similar jobs on Upwork

Google Business PageHourly‐ Posted 1 month ago
Google My Business
Google Analytics
Need to get Audit signed in SpainHourly‐ Posted 4 weeks ago
Finance & Accounting

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo