Local Ollama / AI / LLM Infrastructure Expert — Open-Source Models

Posted 2 weeks ago

Worldwide

Summary

We are looking for an experienced AI/LLM infrastructure expert to consult on and potentially build a local, self-hosted AI environment for our business. Objective We currently rely heavily on LLM APIs for tools like OpenClaw and others and are expecting high token costs and API/rate limits. We want to evaluate and implement a local solution using hardware such as an Apple M3/M4 machine or NVIDIA GPU server or others and open-source models. Scope * Recommend the best hardware/configuration for our needs and budget. * Compare Apple Silicon vs. NVIDIA GPU solutions or others. * Set up and optimize local LLM inference. * Deploy models such as Llama and other appropriate open-source models. * Evaluate performance, scalability, context windows, and concurrent usage. * Recommend tools/frameworks such as Ollama, vLLM, or similar. * Help integrate the local models with our existing applications/APIs. * Provide a realistic cost comparison vs. OpenAI/Anthropic/API usage. * Design the solution so we can minimize dependence on external API limits and recurring token costs. Ideal Candidate * Strong experience deploying LLMs locally/on-premise. * Experience with open-source models. * Strong NVIDIA/CUDA and/or Apple Silicon experience. * Experience with Ollama, vLLM, Docker, APIs, and AI infrastructure. * Able to advise on both the architecture and actual implementation. We are open to starting with a paid consultation/architecture assessment and then moving to implementation if the proposed solution makes sense. Please provide examples of local LLM environments you have built, including the hardware, models, and approximate performance/cost savings.

  • $150.00

    Fixed-price
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Machine Learning
ollama
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:2 weeks ago
  • Hires:
    1
  • Interviewing:
    14
  • Invites sent:
    18
  • Unanswered invites:
    2
About the client
Member since Sep 4, 2009
  • United States
    Southwick6:11 AM
  • $26K total spent
    71 hires, 6 active
  • 808 hours
  • Media & Entertainment
    Small company (2-9 people)

Explore similar jobs on Upwork

Artificial Intelligence
Job Search Strategy
LinkedIn Recruiting
Resume Writing
Cover Letter Writing
Applicant Tracking Systems
Career Coaching
Virtual Assistance
Data Entry
EEG based emotion recognitionHourly‐ Posted 4 weeks ago
Machine Learning
Python
Keras
PyTorch
Deep Neural Network

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo