Hire the best Big Data Engineers in New York, NY
Check out Big Data Engineers in New York, NY with the skills you need for your next job.
- $55 hourly
- 5.0/5
- (1 job)
With over a decade of experience as a data engineer / software engineer, I've been heavily engaged in ETL pipelines, automation scripts, microservices, APIs, web portals, and more. 🚀 𝐌𝐲 𝐬𝐞𝐫𝐯𝐢𝐜𝐞𝐬 🚀 𝑷𝒓𝒐𝒈𝒓𝒂𝒎𝒎𝒊𝒏𝒈 𝑳𝒂𝒏𝒈𝒖𝒂𝒈𝒆: Python | JavaScript | TypeScript | SQL 𝑫𝒂𝒕𝒂 𝑬𝒏𝒈𝒊𝒏𝒆𝒆𝒓𝒊𝒏𝒈: - Apache Spark | Apache Hadoop | Apache Kafka - Databricks | Snowflake | AWS Glue - Dagster | Apache Airflow - DBT 𝑫𝒂𝒕𝒂𝒃𝒂𝒔𝒆: PostgreSQL | MsSQL | MySQL | MongoDB | DynamoDB 𝑫𝒂𝒕𝒂 𝑾𝒂𝒓𝒆𝒉𝒐𝒖𝒔𝒆: Google Big Query | AWS Redshift | Snowflake 𝑫𝒂𝒕𝒂 Visualization: Looker Studio | Power BI | Grafana 𝑫𝒆𝒗𝑶𝒑𝒔: Docker | Kubernetes | CI/CD 𝑪𝒍𝒐𝒖𝒅 𝑺𝒆𝒓𝒗𝒊𝒄𝒆𝒔: Amazon Web Services | Google Cloud Platform | Azure 💘 𝐖𝐡𝐲 𝐡𝐢𝐫𝐞 𝐦𝐞? 💘 - High quality - In-time delivery - Active communication - Optimal products Feel free to reach out if you need my help.
Big Data
Data MigrationData WarehousingData VisualizationData AnalysisBigQueryApache KafkaETL PipelineData EngineeringJavaScriptAPI IntegrationApache SparkSQLPythonWeb Application - $120 hourly
- 5.0/5
- (49 jobs)
Ryan is a certified solutions architect and engineer with almost two decades of experience and a proven track record spanning several industries. His clients range from scrappy startups to elite global banks and everything in between. He is a member of the AWS Partner Network and is an AWS Certified Solutions Architect - Professional. Equally comfortable in Azure and Google Cloud, Ryan has significant experience spearheading projects in the enterprise technology space. Recent projects include the AWS hybrid solutions architecture of a new physical facility for the world's largest printing company, spearheading the recent databricks migration for a FAANG technology company, and the complete deployment and management of technology infrastructure for the data science division of a US cellular carrier, Please note that although I am sometimes available for emergency situations, I am usually working on several projects at any given time and usually cannot accommodate requirements that need to be fulfilled yesterday. Provider Expertise: AWS/Azure/GCP Specialties: DevOps methodologies, team leadership, infrastructure as code Automation and Orchestration: CI/CD, Bazel, hermetic builds, containerization Compliance expert: HIPAA, PCI, GDPR Keyword alphabet soup: Databricks, Data Lake, Data Science, SageMaker, MLOps, Machine Learing, Terraform, Ansible, Kubernetes, Kafka, Elasticsearch, TensorFlow, Big Data, Data Lake, Data Warehouse, Blockchain, Machine Learning, Chef, Puppet, CloudFormation, Docker, Bash, Powershell, Python, Jenkins, Packer, Atlas, Hadoop, NoSQL, Ruby on Rails, PostgreSQL, MySQL, RightScale, OpenStack, Nginx, DNS, Apache, Ubuntu, Centos, RedHat, Nagios, AWS-CLI, HAProxy, ELB, VPN, Redshift, Glacier, S3, Shell, Git, OpsWorks, JIRA, RabbitMQ, NewRelic, Digital Ocean, BitBucket, etc...
Big Data
Software DevelopmentBuild AutomationCloud SecurityBlockchain ArchitectureMachine LearningDevOpsCloud ArchitectureTerraformKubernetesCI/CDHIPAAMicrosoft AzureGoogle Cloud PlatformAmazon Web Services - $130 hourly
- 5.0/5
- (1 job)
Ahsan Bukhari - Data Analytics & BI Expert | Transforming Data into Actionable Insights 🚀 About Me: Hello! I'm Ahsan, a seasoned BI & Big Data expert with 17 years of experience in turning complex data into clear, actionable insights. My journey has led me to work with US market leaders like Staples, Levi’s, Regeneron Pharmaceuticals, and Shutterstock, where I've honed my skills in data strategy, transformation, and advanced analytics. 🔍 My Expertise: Data Strategy & Transformation: Crafting data roadmaps that align with business goals. Advanced Analytics: Utilizing tools like Snowflake, AWS Redshift, and Apache Spark for deep data analysis. Data Visualization: Skilled in Tableau and SAP Business Objects for compelling visual storytelling. Team Leadership & Project Management: Proven experience in leading high-performing data teams and managing large-scale projects. Industry Versatility: Deep understanding of Telecom, Retail, and Healthcare sectors. 📈 What I Offer: Customized Data Solutions: Whether it's setting up a data lake, designing data models, or developing BI reports, I tailor solutions to your unique business needs. Strategic Insights: Leveraging my extensive consultancy experience to offer strategic guidance on data utilization and business intelligence. End-to-End Project Management: From initial consultation to final delivery, I ensure your project is executed flawlessly. 🌟 Why Me? Proven Track Record: My work has led to multi-million dollar savings and significant performance improvements in various organizations. Excellent Communication: I believe in clear, concise communication to keep you informed at every project stage. Commitment to Quality: Quality is at the heart of everything I do. I'm dedicated to delivering top-notch results that exceed expectations. Ready to transform your data into a strategic asset? Let's connect and explore how we can elevate your business together!
Big Data
AWS LambdaData LakeData AnalyticsMicrosoft AzureMicrosoft Dynamics 365Amazon RedshiftCloud ComputingSenior AdultMicrosoft Power BISnowflakeApache AirflowTeradata - $115 hourly
- 0.0/5
- (0 jobs)
Dynamic and entrepreneurial technology executive with 15+ years of expertise in product management, SaaS platforms, and digital transformation within FinTech and Financial Services. Proven ability to optimize customer experiences, scale cloud-native platforms, and drive cross-functional teams to deliver market-leading solutions in regulated ecosystems.
Big Data
Management SkillsDerivatives TradingCryptocurrencyFinTechCross Functional Team LeadershipSaaSAgile Software DevelopmentProcess ImprovementBusiness DevelopmentStrategic PlanningGo-to-Market StrategyBusiness ManagementProduct StrategyProduct Management - $50 hourly
- 4.3/5
- (16 jobs)
I am Alex, a Machine Learning Engineer with over 13 years of hands-on experience transforming complex data into actionable insights and building end-to-end AI solutions. I have successfully designed, developed, and deployed deep learning systems in both cloud environments and at the edge, ensuring scalability and performance. My skill set spans the entire ML pipeline—from data extraction, processing, and analysis to state-of-the-art model development and operational deployment. I bring a wealth of experience in computer vision, LLMs, predictive modeling, and advanced data engineering. For the last 3 years, I’ve been focused on creating AI-driven applications and agents powered by Large Language Models (LLMs), enabling dynamic, human-like interactions and intelligent automation. Key Strengths & Specialties: • End-to-end ML Development: Expert in building machine learning pipelines from raw data ingestion to deployment, ensuring robust performance at scale. Experience with scikit-learn, pandas, PySpark, deployment of models in cloud and optimizing performance, debugging and monitoring drift of models. Examples of work: Development of a high-performance fraud detection model in real-time submillisecond delivery currently processing more than 1.5 billion transactions per year for Fortune 500 companies. A patent was issued for this AI system: US20240346008. An AI system to assist auditors in medical coding that leads to more than 20% loss recovery of missed medical claims. Deployed in production in a major RCM company in the US. • Deep Learning & Computer Vision: Proficient in designing and optimizing CNNs, object detection, image classification, and other vision-based solutions. Experience with Pytorch, TensorFlow, and all CNN models with transfer learning to optimize for specific applications. Examples of work: A development of a computer vision model that automatically assesses car damage from a photo. Deployed in production in the top 10 US car insurance companies. A patent was issued for this AI system: US20240346008. A computer vision system for a major photo repository company that automatically classifies ancient sculptures, people, and art. Classified and analyzed millions of images to assist in the institute's work. Analyzed satellite images for a major Fortune 100 company that assisted in recognizing wind turbines that were due for maintenance to guide the sales team to prioritize outreach to clients. • LLM & AI Agent Development: Experienced in fine-tuning and integrating large language models for conversational AI, knowledge extraction, and intelligent assistants. Experienced in building RAG pipelines for private data repositories and LLM agents that perform complex tasks with standardized effective outcomes. Expert in all major LLM models, LlamaIndex for RAG and context-aware agents, CometML for LLMs performance monitoring in production, CrewAI for effective AI agents creation, and federation learning for finetuning agents in private data. Examples of work: Created an LLM agent for a major recruiting agency that automatically scouts for candidates, performs the outreach with uber personalized emails, schedules calls, and assists in screening the candidates during the call. Increased pipeline of candidates by 300% and reduced time to hire by 200%. Created multiple chatbots that are finetuned in specific industries and knowledge graphs and can assist in critical business functions without hallucinations. • Data Engineering & Big Data: Skilled in data architecture, distributed systems, and cloud technologies (AWS, GCP, Azure) to handle large datasets efficiently. Example of work: Processed more than 60GB of historical data for a hedge fund to derive modeling insights for optimizations of trading. Pipeline created for data updating and processing daily. • Predictive Modeling & Insights: Expertise in creating predictive algorithms that uncover valuable business insights, backed by sophisticated visualizations and dashboards. • Professional Delivery & Collaboration: Known for clear communication, timely project execution, and consistent focus on delivering measurable value to clients. References of previous clients available. What I Offer: • Customized ML solutions tailored to your business goals, whether it’s enhancing existing pipelines, deploying state-of-the-art deep learning models, or integrating advanced AI LLM agents. • Full-spectrum consulting and implementation—from initial data exploration to final model deployment—in cloud or on-premise setups. • Collaborative approach that values transparency, adaptability, and agile workflows, ensuring that projects stay on track and deliver real impact. If you’re looking to elevate your data-driven strategies or adopt cutting-edge AI solutions, let’s discuss how we can make it happen. I look forward to contributing my expertise and passion to help your project succeed.
Big Data
Computer VisionChatbotLLM Prompt EngineeringAI Agent DevelopmentSQLData ScienceMachine LearningPython - $80 hourly
- 0.0/5
- (1 job)
Experienced professional with 3 years in big 4 public accounting. Advanced Microsoft Excel proficiency, comfortable with big and ambiguous data sets. Project management, and familiarity with the software development lifecycle. Communication is key, I hope that we are in touch regularly.
Big Data
Excel FormulaAccounting BasicsMicrosoft ExcelAccounting - $30 hourly
- 0.0/5
- (0 jobs)
I'm a SDR experienced in driving BOFU results with a passion for solving critical business challenges and contributing to long term growth.
Big Data
Artificial IntelligenceSaaS - $75 hourly
- 0.0/5
- (0 jobs)
About Me: As a seasoned accountant, analyst, data scientist, and finance expert with over 20 years of experience, I help businesses and organizations make informed decisions by providing actionable insights and data-driven solutions. With a strong background in finance, accounting, and data analysis, I possess a unique combination of technical, business, and analytical skills, enhanced by a creative mindset. Summary: Highly accomplished analyst, accountant, manager, and data expert with two decades of experience in banking, economics, capital markets, and various industries. Skilled in data analysis, data visualization, machine learning, and artificial intelligence. Proven track record of delivering high-quality results and driving business growth. Possess excellent communication and project management skills, with the ability to work with diverse teams and stakeholders. _______________________________________________________________________ As a student of history and a believer in the importance of understanding the past to shape the future, I approach my work with a unique perspective and a passion for helping businesses and organizations make informed decisions. With my diverse background and experience working with people of various cultures and levels, I am confident in my ability to understand people and their issues, to propose and implement solutions, to drive business results through data-driven insights, and to communicate complex concepts to non-experts when discussing results. _________________________________________________________________________ Services: * Data Analysis: Data mining, data visualization, statistical analysis, and data modeling using tools like Excel, SQL, Python, and R. * Data Science: Machine learning, data mining, artificial intelligence, natural language processing, and predictive analytics. * Finance and Accounting: Financial modeling, forecasting, budgeting, and financial statement analysis. * Business Intelligence: Data visualization, dashboard creation, and reporting using tools like Tableau, Power BI, and D3.js. * Web Development: Web development, web design, and web programming using languages like HTML, CSS, JavaScript, and Python. * Technical Writing * Market Research and Competitive Analysis * International Tax and Intellectual Property (copyright/trademark) Law Skills: Data analysis and data science Finance and accounting Machine learning and artificial intelligence Data visualization and business intelligence Web development and web design Programming languages (Python, R, JavaScript, HTML, CSS) Data modeling and data mining Statistical analysis and predictive analytics Project management and communication Experience: Founder, dataSCIsive (Jan 2020 - Present) Develop and implement data analytics and data science solutions for clients across various industries. Manage and analyze large datasets, created data visualizations, and presented insights to clients. Senior Analyst & Quant, Federal Reserve Bank of New York (Sep 2011 - Oct 2019) Analyzed and reported on large global banks' investment banking and trading performance, risks, and developments. Created visualizations and presented to senior management and wider audiences. Manager and Quant, PricewaterhouseCoopers (Jan 2003 - Jun 2009) Managed and analyzed large transaction- and product-level datasets for elite clients. Supervised and assessed staff performance, and provided training. Associate, KPMG (Sep 2000 - Nov 2002) Prepared and explained complex int'l tax equalizations (and some returns) for HNW individuals and execs. Handled up to 35 clients concurrently while reporting up to 7 managers simultaneously.
Big Data
WritingCrisis ManagementData Analytics & Visualization SoftwareData ScienceData AnalyticsAccountingManagement ConsultingFinancial AuditFinancial AnalysisAnalyticsData MiningData AnalysisMachine LearningArtificial Intelligence Want to browse more freelancers?
Sign up
How hiring on Upwork works
1. Post a job
Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.
2. Talent comes to you
Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.
3. Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
4. Payment simplified
Receive invoices and make payments through Upwork. Only pay for work you authorize.
Trusted by
How do I hire a Big Data Engineer near New York, NY on Upwork?
You can hire a Big Data Engineer near New York, NY on Upwork in four simple steps:
- Create a job post tailored to your Big Data Engineer project scope. We’ll walk you through the process step by step.
- Browse top Big Data Engineer talent on Upwork and invite them to your project.
- Once the proposals start flowing in, create a shortlist of top Big Data Engineer profiles and interview.
- Hire the right Big Data Engineer for your project from Upwork, the world’s largest work marketplace.
At Upwork, we believe talent staffing should be easy.
How much does it cost to hire a Big Data Engineer?
Rates charged by Big Data Engineers on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.
Why hire a Big Data Engineer near New York, NY on Upwork?
As the world’s work marketplace, we connect highly-skilled freelance Big Data Engineers and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Big Data Engineer team you need to succeed.
Can I hire a Big Data Engineer near New York, NY within 24 hours on Upwork?
Depending on availability and the quality of your job post, it’s entirely possible to sign up for Upwork and receive Big Data Engineer proposals within 24 hours of posting a job description.