Expert PostgreSQL Database Engineer (pgvector & High-Concurrency Tuning)
Worldwide
We are building a highly scalable "Enterprise Secure Knowledge-Base Retrieval and Analytics Dashboard." Our system relies on a unified database that must handle standard hierarchical relational data (users, sub-accounts, logs) alongside millions of heavy AI vector embeddings. We need an expert to architect the schema, configure the vector indexes, and implement strict connection pooling to survive massive traffic spikes. The Tech Stack - Database Engine: PostgreSQL - Vector Extension: pgvector - Connection Pooling: PgBouncer - Infrastructure: Google Cloud / Docker Key Responsibilities - Design a scalable database schema that safely partitions heavily updated relational tables (like chat logs) from static, heavy vector embedding tables. - Configure and tune pgvector using HNSW indexing for millisecond-latency cosine similarity searches. - Implement and configure PgBouncer to manage high-volume, concurrent traffic from our serverless Python backend without crashing the database. - Optimize database memory (shared_buffers, work_mem) specifically for vector search workloads. Required Experience - Proven, production-level experience managing heavy PostgreSQL databases. - Direct, hands-on experience building and tuning the pgvector extension (specifically configuring m and ef_construction parameters). - Deep understanding of connection pooling architecture (PgBouncer). - Experience packaging database configurations via Docker for cloud deployment.
- More than 30 hrs/weekHourly
- 6+ monthsDuration
- ExpertExperience Level
- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:20 to 50
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- United States3:53 AM
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by