Hire the best Scrapy Developers in Australia
Check out Scrapy Developers in Australia with the skills you need for your next job.
- $50 hourly
- 5.0/5
- (39 jobs)
Full Stack Developer with Extensive Experience in Modern Web & Mobile Technologies With a strong foundation in full-stack development, I possess a track record of delivering optimized, scalable, and secure applications for diverse industries. My expertise spans a wide range of technologies, which empowers me to design, develop, and deploy versatile digital solutions. Backend Development: Languages & Frameworks: Proficient in Django, Django Rest Framework, Flask, and Node.js, I've been a key player in architecting robust backend infrastructures that prioritize security, scalability, and performance. Databases: My experience encompasses the design, optimization, and management of relational databases like PostgreSQL and MySQL. Authentication: I'm adept at implementing JWT-based and session-based authentication, having even customized Django's authentication model to cater to specific project needs. APIs: I can create intuitive and efficient RESTful and GraphQL API endpoints using best practices. My comprehensive knowledge of serializers ensures smooth data transmission and validation. Asynchronous Operations: Leveraging Celery, I've managed background jobs and scheduled tasks to optimize app performance and enhance user experiences. Frontend Development: React: My proficiency in React includes the use of state management, context providers, and components to create seamless and interactive user interfaces. Responsive Design: Whether it's a web application or a mobile interface with React Native, I craft designs that are both visually appealing and responsive across devices. Deployment & Infrastructure: Containerization & Deployment: With a hands-on approach, I've utilized Docker for application containerization, deployed projects on AWS EC2, and other Linux-based servers, ensuring efficient resource utilization and scalability. Media Storage: I've integrated AWS S3 for efficient media storage solutions, ensuring quick media access without compromising security. Security: I'm proficient in procuring and setting up SSL certificates to ensure domain security and user data protection. Collaboration & Version Control: Fully versed with Git, I believe in collaborative coding. My familiarity with branching, merging, and pull requests ensures a seamless collaborative environment and version control.
Scrapy
PDF ConversionXMLGUI DesignNode.jsReactReact NativeDashPlotlyGoogle APIsDjangoGoogle SheetsOpenCVSeleniumPython Scikit-LearnpandasPython - $50 hourly
- 5.0/5
- (16 jobs)
Hi, I am a Software Engineer with over three years of experience. I've strong problem-solving skills, logical thinking abilities, and an aptitude for self-learning. I'm open to opportunities and looking forward to working on good projects. Let's have a meeting and Get Started!
Scrapy
Internet of ThingsAWS IoT CoreAmazon DynamoDBAWS LambdaDjangoAmazon EC2DockerAmazon Web ServicesFlaskRESTful APISeleniumAmazon ECSPythonSQL - $30 hourly
- 4.6/5
- (16 jobs)
Hi, I am specialized in Lead Generation | Web Scraping | Data Scraping| Data Mining | Data Entry | Data Extraction | Automation | Wordpress | Virtual Assistance My name is Qadir Nawaz (Web Scraping, Lead Generation, Virtual Assistance, Data Scraping, Data Mining, Data Extraction, Data Entry and Automation) expert having experience of over 4 years using Python and Javascript. I have scraped almost every type of websites (from static to dynamic), extracted data in structured format such as CSV, XLSX, JSON, SQL. Skills: Web Scraping using (Requests, BeautifulSoup, and Scrapy) Lead Generation PDF Scraping Data Scraping Data Mining Virtual Assistance Microsoft Excel Automation Data Extraction API (JSON) Scraping MySQL Database Scraping Providing scraped data into CSV or Excel files Automatic uploading to Google sheets using Google API Spreadsheets Data Analysis Data Manipulation, Mining, Processing, and cleaning using Pandas and Numpy Regular Expression Data Visualization and inspecting fruitful insights using matplotlib Web Automation using selenium or playwright I have great experience in scraping data from many sources as follows: E-Commerce websites (eg. Shopify API) Fashion and Marketplace Websites eg. Trendyol, Hepsiburada, Boyner and Amazon.com Twitter Articles Jobs Ads Websites requiring login Search engines PDFs Tables included on websites I am mastering various python packages as follows: Pandas NumPy matplotlib Requests Scrapy BeautifulSoup Selenium Webdriver Tweepy JSON MySQL/sqlalchemy Playwright Process: I will develop a script for the website for which you require data scraping, collect and process the data according to your needs. Each customer has to provide the website for web scraping, although will be happy to help with an idea or a source from where I'll scrape the data. If we need credentials and search terms, they must be provided. I have completed many projects such as scraping Ecommerce websites, County collection websites, Real estate websites etc. Regards, Qadir Nawaz
Scrapy
WordPressMicrosoft ExcelVirtual AssistanceData MiningAutomationScraper SiteWeb CrawlingData ScrapingPythonData EntrySeleniumWeb ScrapingLead GenerationData Extraction - $19 hourly
- 4.6/5
- (60 jobs)
Web Scraping / Data Extraction / Web Crawling / Data Mining / Data Entry / Python / Selenium Expert / Web Automation / Browser Automation I have 3 years of experience in service based industry. Providing all the king of data related services like Data scraping, Data mining, Data Processing, Lead generation, Data Entry, Price Monitoring, Full Site Assortment. All the work done by automation. My Technical skills 》 Languages: Python 》Database : MySQL, NoSQL 》 Libraries: Selenium, Scrapy, Requests, Regex, Multiprocessing, Pandas, Numpy, Flask 》 OS: Windows, Ubuntu Linux 16.04 》 Browsers: Chromedriver, Firefox driver *****My experience and skills***** ✅ E-Commerce Sites Scaring and Price Monitoring ✅ All the type of Business listing and directories ✅ Lead Generation and Data entry ✅ 1000s of store locators. ✅ Google Maps, Google Shopping, Google reviews, and many more. ✅ Scraped Hotels details like booking.com. ✅ Hotel menu ✅ Scraped Social Media sites ✅ YouTube Channel details ✅ Email Extraction Using Websites ✅ Data Entry ✅ Social Media Scraping ✅ Integration Of Scrapy and Flask to make API ✅ Selenium Automation ✅ Images and Documents Download ✅ Social Media Influences Details ( Instagram, Facebook, YouTube) ✅ PDF to Word/Excel/Google Spreadsheet ***Why you need to hire me*** 》100% accurate data deliver to you at the exact time 》 My service is active always 24/7 》 Never disclose your data to any other person (NDA) 》Quality analysis on the work three times 》 Negotiable working price My main concern is to fulfill your requirements and provide you the best service. Thank you, Kinjal
Scrapy
Data CleaningData ProcessingAutomationMongoDBMySQLLead GenerationSelenium WebDriverWeb CrawlingpandasPythonData ScrapingScreen ScrapingMicrosoft Excel - $30 hourly
- 4.9/5
- (28 jobs)
Welcome to my profile. I am a programmer for 10+ years valuable experiences. I have been working on web development. I am specialized in following: - wordpress, codeigniter, cakephp, mybbs and other php frameworks. - python (Django) - web scraping (python). - selenium - node.js, agular.js, react.js , jquery and bootstrap. - database management (mysql, mongodb, sqlite3 and other local files) - web automation Guarantees of high quality and fast delivery. Alex Harricks
Scrapy
Data ScrapingWeb DevelopmentWordPressReactDatabase ProgrammingPHPDjangoNode.jsPython - $40 hourly
- 0.0/5
- (0 jobs)
🚀 I am a senior full-stack developer with 9 years experience in web development. I have good hands on React, Vue, Node.js, Django, Ruby on Rails and Laravel. Over the past 9 years, I have worked in many development teams and built around 15 web applications. 🏆 Experienced Skills 💎 React, Redux, Redux-Saga/Thunk, MobX, Flux, React Hooks, Next.js 💎 Vue.js, Vue-Router, Vue-CLI, Vue-Loader, Vuex, Vuetify, Quasar, Nuxt.js 💎 Node.js, Django, Ruby on Rails, Laravel, Socket.io, ASP.NET, ASP.NET Core 💎 HTML5, CSS3, Sass, LESS, SCSS, Stylus, BEM, ABEM 💎 Bootstrap, Material-UI, Foundation, Ant Design 💎 MERN/MEVN stack 💎 MongoDB, MySQL, PostgreSQL, Amazon DynamoDB 💎 GraphQL, Apollo, Prisma 🏆 Technologies 💎 AWS Services, EC2, S3, Lambda, DynamoDB, Cognito, Amplify 💎 Google APIs, Google Recaptcha, Google OAuth 💎 Google Cloud Functions 💎 Heroku, Godaddy, Azure 💎 Facebook Graph API, Facebook Marketing API, Stripe API, Zendesk Core API, Twillio API, Telegram Bot API, REST API 💎 Firebase Real-time DB, Firestore, Firebase Cloud Storage 🏆 What to expect when working with me: 💎 Responses within an hour in most cases, at least within 24h. 💎 I may be in a different timezone. but can work on your timezone. 💎 Available to work as full time if you need. 💎 Good communications. 💎 Daily reporting/updates if required. 💎 Agency level quality and service. Please contact me with your project. Thanks very much.
Scrapy
JavaScriptVue.jsPythonDjangoNode.jsReactWebRTCFirebaseGoogle Chrome Extension - $40 hourly
- 0.0/5
- (0 jobs)
Hi Please have a look at what I am quite good at. - HTML/CSS/SCSS/LESS/Sass,Bootstrap for web design - Javascript ,TypeScript,jQuery, React js, Vue js for frontend - PWA Development - Ruby on Rails, Node js/Express js. - MySQL/Postgresql/MongoDB/Firebase for the database - MEAN/MERN/LAMP Stack Development - Python/Selenium/Scrapy/beautiful soap ,PHP,jQuery for web scraping - Google Chrome Extensions/Google Drive add ons I am also familiar with many 3rd party apis and dev tools/envs - Facebook, Linkedin, Twitter, Twilio, Flickr, Rapleaf, Youtube - Amazon API - many payment integrations - Git, Docker, Jenkins, Ngnix, Kubernetes, AWS, Microsoft Azure - CPanel, Heroku, GoDaddy, MochaHost I always provide the best quality in time to have you satisfied and give you great pleasure. For me, nothing else is more important than your satisfaction with your project. If you want to work with skillful, honest, and dedicated hard workers, I am here. I am sure it would be a nice choice for us if we work together. Thanks for taking the time to learn about me.
Scrapy
RESTful APIDatabase DesignVue.jsTypeScriptCSSDjangoHTMLNode.jsAngularVuetifyPythonJavaScriptResponsive DesignReact - $30 hourly
- 0.0/5
- (0 jobs)
I offer Kind of Manual and Automation Testing (Using Selenium WebDriver using Python and API automation in Postman, Cypress, Puppeter, Playwright Automation) services listed below - Active Participant in Agile Scrum Development and meetings like Story Grooming, Stand Up, Sprint Planning, Sprint Review and Retrospective. Proficient in automation testing using Selenium Web Driver, TestNG, Ant, Maven, Jenkin, Java, Page Object Model (POM), TDD and BDD design pattern with Page Factory in continuous Integration/ continuous development environment Having good exposure of using repository management tools like Git, perforce. Strong experience and knowledge of Testing Methodologies such as Agile Methodologies, Waterfall and V - Model. Excellent Knowledge on Software Development Life Cycle (SDLC), Software Testing Life Cycle (STLC). Good experience in interacting with business analysts, developers, technical support to assist in resolution of technical issues. Extensive hands on experience in creation and execution of test cases and scripts for Functional testing, Sanity Testing, Smoke Testing, System Integration testing (SIT), User Acceptance Testing (UAT), Regression testing, exploratory testing, Operational Acceptance Testing, End to End Testing, Business Process Testing, System Testing and Risk-Based testing. Build Deployment on Testing Environment. Have good knowledge of e-commerce, Health Care and Financial (Accounting and Budgeting) Domain as well. Involved in functional and nonfunctional requirement clarification with business analysts. Extensively involved in preparing Test Scenarios and Test Cases from Requirements. Also involved in preparing Test Plan. Extensive experience in deriving Test Conditions, preparing Test Data, performing Test Data Validation, Preparing Test Cases, Defined the Test Entry Criteria & Test Exit Criteria and reviewed the test cases and other test artifacts. Having three years of experience in leading 10 members QA team. Technical Skills: LANGUAGES : Java, java script, python AUTOMATION TOOL : Selenium IDE, Selenium Web Driver, Appium, Postman (API), Cypress, Playwright, Puppeteer CI TOOLS : Jenkins, TeamCity TEST MANAGEMENT : Test Rail, Qmetry, Asana, Basic Knowledge of Q C., TFS DATABASE : MYSQL ENVIRONMENT : Windows, Linux and MAC OSX TESTING FRAMEWORK : TestNG, POM, TDD, BDD BUILD TOOL : Maven, Ant VERSIONING TOOLS : GIT, Perforce BUG TRACKER TOOLS : JIRA, Rally, Bugzilla, Mentis, Assembla MANUAL TESTING : Creating Test plan, Writing & executing test cases, review test cases, Black Box testing, Regression testing, Integration testing, Functional and Non-Functional testing, Database testing, Creating checklists and bug reporting. SOFTWARE Q/A : SDLC, STLC, Bug Life Cycle. I am flexible on project demands and shifting priorities. I thrive in unfamiliar situations and enjoy opportunities to learn and gain exposure to new ideas and experiences. I am open and willing to learn whatever is necessary to accomplish my client's goals.
Scrapy
Data ExtractionSelenium WebDriverTest AutomationSoftware TestingCypressSystem AutomationBeautiful SoupWeb CrawlerTestingSeleniumAutomationAlpha TestingData ScrapingPython Want to browse more freelancers?
Sign up
How hiring on Upwork works
1. Post a job
Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.
2. Talent comes to you
Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.
3. Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
4. Payment simplified
Receive invoices and make payments through Upwork. Only pay for work you authorize.