Build an Enterprise AI Knowledge Assistant (Python + FastAPI + RAG + Local LLM)

Posted 2 days ago

Worldwide

Summary

Build an Enterprise AI Knowledge Assistant (Python + FastAPI + RAG) We are looking for an experienced Python AI developer to build a modern Retrieval-Augmented Generation (RAG) application using local open-source models. The application should allow users to upload documents, search their contents using semantic search, and chat with an AI assistant that provides accurate answers with source citations. This is a portfolio/demo project, but the code should follow clean architecture and production-quality standards. Technical Stack Python 3.12+ FastAPI LangChain or LlamaIndex ChromaDB / FAISS Sentence Transformers Ollama (Llama 3.2 / Mistral) SQLite Docker React or Streamlit Required Features Backend FastAPI REST API Modular project structure Async endpoints Swagger/OpenAPI Logging Environment variables AI / RAG PDF Upload DOCX Upload TXT Upload Automatic document chunking Embedding generation Vector database indexing Semantic search Context retrieval AI response generation Source citations Chat Features Chat interface Streaming responses Chat history Conversation memory Follow-up questions Source Citation Every answer should display: Document name Page number (if available) Relevant text source Optional CSV support Excel support OCR Image search Admin dashboard Multiple knowledge bases Deliverables Complete source code FastAPI backend Frontend Docker setup README API documentation Sample documents GitHub repository Proposal Requirements Please include: Similar RAG or AI projects. GitHub profile. Which vector database would you use? Which local LLM would you recommend? Estimated completion time. ⭐ Bonus (Will Increase Your Chances) If you have experience with: MCP (Model Context Protocol) AI Agents CrewAI LangGraph Hybrid Search Redis PostgreSQL + pgvector please mention it in your proposal. Screening Questions Add these in Upwork: 1. Have you built a RAG application before? Please share GitHub or screenshots. 2. Which vector database would you use and why? 3. Which local LLM do you recommend (Llama 3.2, Mistral, Gemma, DeepSeek, etc.)? 4. How would you structure this project for production use? 5. Can you complete this within 5–7 days? Attach a Reference Image When you reach the attachments section, include a simple architecture diagram like this in the description: User │ React / Streamlit UI │ FastAPI │ ┌──────────┴──────────┐ │ │ Document Upload Chat Request │ │ └──────► RAG Pipeline ◄──────┐ │ │ Chunk Documents │ │ │ Generate Embeddings │ │ │ ChromaDB Vector Store │ │ │ Retrieve Context │ │ │ Ollama (Llama 3.2/Mistral) │ Answer + Source Citations

  • $30.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Mandatory skills
Python
Artificial Intelligence
Activity on this job
  • Proposals:20 to 50
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Apr 21, 2026
  • IND
    Surat5:37 AM
  • 1 hire, 0 active
  • Food & Beverage
    Individual client

Explore similar jobs on Upwork

Predictive Model
SQL
pandas
Data Science
Python
Machine Learning
Python Scikit-Learn
Deep Learning
Predictive Analytics
Data Analysis
Gen AI Developer (Contract)Fixed-price‐ Posted 2 months ago
AI Agent Development
Python
JavaScript
API
Node.js
Deep Learning
React
PostgreSQL

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo