Data Integration Engineer: API Pipelines & Web Scraping (Python / BigQuery) (PAID TEST 1 OF 2)

We're a small, established data & analytics company that has been operating since 2020. We pull from major US retail and advertising platforms. Our main focus is Amazon, but we are expanding to many other advertising and retailer platforms. We acquire data, land it in BigQuery, and turn it into reports our clients rely on. We're replacing a full-time engineer and looking for someone who can own and maintain a portfolio of Python pipelines, API integrations, and scrapers. This role is the main data role in the company and will be responsible for everything on the data side. A typical week might include: standing up a new API connection, onboarding a new client account and backfilling its history, tracking down why a report is silently missing data, adapting a pipeline when a platform renames a metric or changes its export options, and owning the QC/alerting that catches problems before clients do. Stack: Python, BigQuery, Google Cloud, Google Drive API, and browser scraping (Python Selenium and requests). Familiarity with ad/retail data is a plus. On AI: We encourage our candidates to leverage AI to make them better developers. Our test fees are fixed regardless of hours, so efficiency is encouraged. That said, a LOT of our work will require real ability to code. You will NOT BE ABLE to vibe code through this role. How we hire We use paid test projects because they predict fit far better than interviews. The process is transparent up front: Paid Test 1 (shortlist): Propose a fix for a data parsing project given the requirements. This will test how well you can grasp the data concepts for our company as well as your communication style. ~5–7 days. Flat fee, fixed regardless of hours. Paid Test 2 (finalists only): A web-scraper build. Flat fee. This will test your coding ability. It will be impossible to vibe code and will require real engineering knowledge to be able to build a working solution. Short paid trial: before any ongoing commitment, a brief paid trial on real work at the rate we agree upon. A confidentiality agreement is required before any materials are shared. Both tests run against synthetic data or public, automation-permitted sources only. Requirements: - Strong Python (production pipelines, not just scripts) - SQL and hands-on BigQuery - Real API-integration experience (auth, pagination, rate limits, schema drift) - Web scraping with/without a headless browser - Clear written communication. You'll be expected to suggest action plans, discuss back-and-forth plans, and be able to discuss strategy - English fluency is a must - Google Cloud Infrastructure - Bonus: advertising/retail platform data We are a small team. This role demands a lot of different skills. Because of this, we understand that there may be a candidate that understands everything, but is willing to learn. If you want to be able to own the data portion of the company, work directly with the CEO and enjoy the flexibility of being able to work on something new every day, we may be a good fit. We look forward to your application.