You will get web-scraped SQL database with clean data, ready for analysis.
You will get web-scraped SQL database with clean data, ready for analysis.
Project details
You will get a fully realized sql database with data scraped from the web. I will provide you with the python script so that you are able to run the script to update the database or to continue collecting data over time. I am a developer with strong communication skills that can help you take your project from an idea to reality. Once you have the information you would like scraped from the web I will be able to provide you with a database containing clean data, ready for analysis.
Database Type
MySQL, MS SQL, PostgreSQLWhat's included $100
These options are included with the project scope.
$100
- Delivery Time 5 days
- Number of Revisions 2
- Number of Tables Added 4
- Schema Diagram
- Permissions Setup
- Import/Export Data
- Admin Panel Setup
About Isaac
Full-Stack Web Developer Specializing in React, Node.js and PostgreSQL
Denver, United States - 9:59 am local time
Climbing Analytics Application: Developed a web app utilizing React for the front end and Node.js with PostgreSQL for the back end. Implemented data visualizations using D3.js, including bar chart races and custom grade pyramid visualizations with multiple filters. Deployed on Heroku, ensuring seamless user experiences.
Household Management Application: Engineered a comprehensive solution with a React front end and a Node.js back end, employing PostgreSQL managed through Prisma ORM. Utilized Docker for streamlined deployment and Nginx for load balancing. Implemented CI/CD pipelines via GitHub workflows to ensure efficient development cycles.
Technical Proficiencies:
Front-End: React, Tailwind CSS (responsive and accessible design), D3.js (data visualizations)
Back-End: Node.js, Express.js, RESTful API development, Prisma ORM, PostgreSQL
DevOps: Docker (containerization), Nginx (load balancing), GitHub Actions (CI/CD), Heroku (deployment)
Testing & Optimization: Experience with Jest for testing; proficient in performance optimization techniques, including the use of callbacks and memoization in React.
Additional Skills:
Web Scraping: Developed custom web scrapers for market research, enabling data-driven UX/UI decisions.
Agile Methodologies: Familiar with Agile, Scrum, and Lean Startup principles; adept at using Git for version control.
Professional Background:
With a strong foundation in solo project execution, I bring a disciplined and self-reliant approach to development. My experience spans from web development to hands-on projects like floor replacement and greenhouse construction, demonstrating versatility and a commitment to delivering high-quality results across various domains.
Steps for completing your project
After purchasing the project, send requirements so Isaac can start the project.
Delivery time starts when Isaac receives requirements from you.
Isaac works on your project following the steps below.
Revisions may occur after the delivery date.
Information gathering
I will check the availability of the data and the html scripts that will have to be read.
Write web-scraping script
I will write a web-scraping script in python to collect the information and create a dataframe.