Hire the Best Data Engineers in New York

Most data pipelines don’t fail because of code. They fail because they weren't built for scale. With 8+ years of experience engineering data systems at companies like Microsoft and Coreweave, I help businesses move away from "brittle prototypes" to production-grade, scalable infrastructure. I don’t just move data; I build the "Source of Truth" that leadership and AI systems actually trust. 💬What I Solve for You: Productionizing AI Pipelines: Hardening Python prototypes into scalable RAG and LLM infrastructures (AWS/Azure). ➔Infrastructure-as-Code: Building automated, modular ETL/ELT pipelines that don't require daily manual fixes. ➔The "One-Source" Dashboard: Integrating messy data from APIs, SaaS (Shopify, HubSpot), and DBs into clean Snowflake/BigQuery layers. ➔Performance Recovery: Optimizing slow SQL queries and high-cost cloud warehouses to save you thousands in monthly spend. 🛠 Tech Stack: Languages: Python (FastAPI, Pandas, PySpark), SQL Cloud & Warehousing: AWS (Glue, Lambda, S3), Snowflake, BigQuery, Azure Orchestration: Airflow, dbt, GitHub Actions Data Ops: API Integrations, Vector DBs, Data Validation ✅ Why Me? 8+ Years Experience: I’ve seen what breaks at the enterprise level and how to prevent it in your startup. Speed over Perfection: I focus on shipping high-impact systems that drive revenue, not just technical documentation. Transparent Communication: You get regular updates and a partner who challenges requirements to find better solutions. Ready to clean up your data debt? 📩 Message me for a FREE 15-minute technical consultation. Let’s discuss your architecture and see if I’m the right fit for your system.

I’m a founder and software engineer with 7+ years of experience building automation, data pipelines, analytics platforms, and internal tools. My background includes engineering work at major financial institutions, where I built systems for data aggregation, reporting, workflow automation, and operational analysis. I specialize in turning messy processes into reliable software: backend pipelines, dashboards, integrations, database workflows, and tools that save teams time. I can help with: Python automation and scripting Backend development Data pipelines and reporting tools React/TypeScript dashboards Database design and optimization Workflow automation Internal business tools Technical product planning I work best on projects where the goal is clear: reduce manual work, improve visibility, automate repeated tasks, or build a practical tool that helps a business operate better.

Hello, Welcome to my profile! I am a highly skilled Business Intelligence Expert with a strong background in statistics and programming. With over 6 years of experience, I have successfully worked across diverse industries such as healthcare, retail, and services, delivering comprehensive reports based on operational data. Whether it's HR, financial, medical, or surveys, I have the expertise to handle it all. Here are the services I offer: -Automatized Power BI Reports and Dashboards: I specialize in creating dynamic and visually appealing reports and dashboards using Power BI. This enables you to gain valuable insights from your data and make informed decisions. -BI Consultation: I provide expert guidance on leveraging the full potential of BI tools for your business. From data modeling to visualization best practices, I can help you maximize the value of this powerful tool. -BI Training: If you or your team are looking to enhance your BI skills, I offer comprehensive training sessions tailored to your specific needs. Learn how to create impactful visualizations and unlock the full potential of your data. -DAX Optimization: I can optimize your Data Analysis Expressions (DAX) queries to improve performance and efficiency. By fine-tuning your DAX formulas, your Power BI reports will run faster and deliver accurate results. -Web Scraping: Extracting data from websites can be a time-consuming task. I offer web scraping services to gather data from various online sources, enabling you to access valuable information without the hassle. -Data Engineering: As part of my services, I can design and implement Extract, Transform, Load (ETL) processes to ensure smooth and efficient data integration from multiple sources into your BI system. -Statistical Analysis: I possess strong statistical analysis skills, allowing me to uncover patterns, trends, and correlations within your data. From descriptive statistics to advanced modeling techniques, I can provide valuable insights to support your decision-making process. Toolkit: Power BI Looker Tableau R Python SQL (Server, MySQL, SSIS, SSAS, SSMS, PostgreSQL, SQLite) Power Automate Power Query Power Apps Ms. Excel Why choose me? -Client satisfaction is my top priority. I strive to understand your unique requirements and deliver solutions that exceed your expectations. -I am known for my punctuality and dedication to meeting project deadlines. You can rely on me to deliver your work on time, every time. -I am committed to delivering high-quality results. I pay meticulous attention to detail, ensuring accuracy and precision in every task I undertake. -I offer tailored solutions that are customized to your specific needs. I believe in providing personalized services that address your unique challenges and goals. If you have any questions or need assistance with your BI projects, feel free to message me. I am here to help. Best regards. Omar Peguero

⭐⭐⭐⭐⭐ Keith is a highly skilled Python freelancer on Upwork, and I am overly impressed and satisfied with his outstanding services. From the moment we initiated our collaboration, Keith exhibited a level of professionalism and expertise that truly set him apart. His proficiency in Python programming is commendable, and he consistently delivered high-quality consultative services. Keith's responsiveness and willingness to accommodate our evolving needs demonstrated a level of dedication rarely seen in freelance professionals. His adaptability to project changes and his ability to quickly grasp complex concepts showcased his genuine passion for his craft. ⭐⭐⭐⭐⭐ "Keith was great to work with. He dove into the project, and made it his own. He always responded quickly to any questions/communications, and tackled all the problems that came up along the way with the coding. The project involved technology that was new to both of us. We learned a lot along the way, and he handled the new material well." ⭐⭐⭐⭐⭐"Really knowledgeable and explained things in a very easy way to understand." I'm a top-rated plus freelancer 🥇, and a highly skilled python developer based in New York City. Fueled by my love for all things technology and a steady stream of coffee, I specialize in web application development, data engineering, and automation. With a diverse set of skills and a keen eye for detail, I am committed to delivering innovative and effective solutions to the problems my clients face. I've solved engineering problems for top companies around the USA: ✔️ Bank of America ✔️ Black Rock Inc ✔️ Goldman Sachs ✔️ Cube It (Startup) ✔️ Count it (Startup) ✔️ Headway (Startup) ✔️ Eigen Technologies (Startup) 🏆 What can i bring to the table? 🏆 ✔️ Help business streamline their processes with Software Engineering and AI ✔️ Custom web application development ✔️ Provide the best foundation of code with cutting edge solutions ✔️ I thrive working on fast paced environments and complex projects ✔️ Expertise in ML/AI related project development ✔️ Streamline your Data Engineering pipeline development needs ✔️ Always eager to learn and to take on new challenges If you're looking for a python developer who can help you stay ahead of the curve with AI, I would love to chat. Don't hesitate to reach out to me to learn more about my capabilities and how I can help your business succeed. Technologies: OpenCode AI, Open AI, Claude Code, Context Engineering, AI engineering, Django, Python, ScikitLearn, Dagster, AWS, EC2, Postgresql, Javascript, google app scripts, docker, docker-compose, pandas, numpy, Tensorflow, OpenAI, GPT4 and more. Looking forward to working with you! Keith L

I design and implement AI-powered systems, trading automation, and data infrastructure that drive measurable operational and financial outcomes. My work sits at the intersection of: - Machine Learning & LLM Evaluation - Quantitative Trading Systems (NinjaTrader, TradingView, IBKR) - Automation & API Integrations - Data Infrastructure & Analytics Engineering Recent focus areas include: - Evaluating and improving LLM reasoning performance - Designing automated trading strategies and execution systems - Building end-to-end data pipelines from ingestion to decision layer - Integrating AI models into production workflows I work best with founders, operators, and technical teams who need systems built — not slides created.

I am a New York–based data visualization developer, automations expert and AI engineer, combining my storytelling instincts and knowledge of information systems with deep technical expertise in data engineering, analytics, and testing and evaluation. React, D3, Python, and modern AI frameworks form the core of my toolkit, though I regularly leverage business intelligence platforms such as Looker and Tableau and low-code development tools like Retool when they are the right solution for the problem at hand. Throughout my career, I have built and supported full data ecosystems—from automated ingestion pipelines and data warehouse architectures to interactive visualization platforms and AI-powered retrieval systems. My experience spans Google Cloud, BigQuery, Looker, AWS, and Microsoft cloud environments, giving me a practical understanding of how organizations can structure their data infrastructure to support analytics, decision-making, and emerging AI capabilities. More recently, my work has expanded into applied AI and agentic systems. I have designed retrieval-augmented generation (RAG) architectures, semantic search pipelines, embedding-based document indexing systems, natural language interfaces for complex datasets, and orchestration layers that route user requests across specialized tools and data sources. This experience has given me a strong understanding of how large language models interact with enterprise data and how to build systems that deliver reliable, explainable results at scale. My expertise with building testing suites also positions me ideally to support robust AI-driven or deterministic automations. Using Retool, I have led the development of enterprise software and internal tooling for organizations including Wondery and TIDAL, while also supporting startups such as Ylopo and Innovation Refunds. What distinguishes my approach is the ability to select the perfect tool from among a portfolio of low-code, agentic and full-stack solutions. When projects require custom React components, advanced CSS, API integrations, AI-powered workflows, or specialized user experiences, I can bridge the gap between rapid application development and fully custom engineering solutions to create software that feels tailored to the organization's needs.