Crawlers Jobs

75 were found based on your criteria {{ paging.total|number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("0")|number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("1")|number:0}})
Hourly - Entry Level ($) - Est. Time: 1 to 3 months, 10-30 hrs/week - Posted
I Need someone who is does search engine Research. The Research is needed to be evaluated by different criteria. Researched Information are needed to be put into an Excel sheet. Basic German language skills are reqired for this Job. The work will be explained in Training Videos. Payment will be on an hourly Basis and a Bonus on top for extra good work.
Skills: Web Crawler English German Microsoft Excel
Fixed-Price - Intermediate ($$) - Est. Budget: $150 - Posted
Hi, I need data from ONEMAP. Here is the map, https://www.onemap.sg/index.html Here is the API documentation link, http://www.onemap.sg/api/help/ What data do I need? Valid Postal Codes (Postal Code range is from 000000 - 999999) Find the valid postal codes. Then use the valid postal codes to find, Lat Long Building Name Street Name Full Street Address Example Postal Code - 410636 Lat - 1.3311 Long - 103.9044 Building Name - EUNOS TENAGA VILLE Street Name - BEDOK RESERVOIR ROAD Full Street Address - 636 Bedok Reservoir Road Bonus, If you scan through the map, you will realize they are using particular colors for particular landscape types. Example, 636 Bedok Reservoir Road is a HDB Building - They use Yellow. Eunos MRT is a MRT station - They use dull Blue. Eunos Bus Interchange is a BUS Station - They use Brown. Bayshore Park is a Private Condominium - They use Grey. Bedok Stadium is a Recreational Place - They use Pink. East Coast Park is a National Park - They use Green. Ping Yi Secondary School is a School - They use lighter Yellow. MASJID ABDUL GAFOOR is a Mosque (Place of worship) - they use Light Purple. Why am i saying this? If you are able to get the full list of available categories of places, it will help us put the scraped addresses in the right categories. Also, some important places like Bedok Reservoir Park, Admiralty Park, East Coast Park and more doesn't even have a postal code. So, again if we are able to get the list of categories, then we will be able to get a better list of places using the categories and places that fall under those categories. If both can be done, then, we will have a perfect list of places in Singapore. Let me know if you can do this.
Skills: Web Crawling Google Map Maker Google Maps API Web Crawler
Fixed-Price - Intermediate ($$) - Est. Budget: $50 - Posted
Hi I need a script to run weekly or monthly bases Steps https://isqft.bidclerk.com/authenticate-login.html sales@am-finn.com/Am-Finn13 After login click on Search tab in keywork textbox type "steam room" and submit Search criteria: Division 10 Division 13 Sauna Steam Room Status: In Design, under construction, NOT cancelled, completed, abandoned Project Types: Hotels Condos Apartments Rec Centers Recreational Centers Towers Mixed Use Exclude: Motel 6 projects
Skills: Web Crawling Web scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $20 - Posted
We are looking for a person or persons who are able to HTML Scrap. More content will be provided at a later point. Please be advised previous experience with HTML, CSS and data reproduction is required. The fixed price is only a template - this requires you to quote after you have received the entire brief.
Skills: Web Crawling Data mining HTML
Hourly - Entry Level ($) - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
I'm looking for data mining of all vacation homes for a specific vacation/travel destination. This would included gathering from sites such as VRBO and Tripadvisor and many others. The challenge that needs to be addressed is the same home can be listed on multiple sites. Duplicates are not acceptable. Estimated 1000 rentals. Data I would like to collect includes: Home Name Address Number & size of Beds & Bedrooms Direct Web Addresses of listing Names of listing Agency(s) w/phone numbers, email, and web adresses Price - Both per Week and Night and Per Person/Couple Air Conditioning (y/n) Pool (y/n) Photos Available. Other data may be added as needed. Data format - I'm open to ideas. Initially I'd like a spreadsheet if possible. The goal is to use the data and or sell it. I understand that without knowledge of the exact location, this may be hard to estimate, so and hourly rate would be fine, just give an estimate of the hours required.
Skills: Web Crawler Data mining Database design Web scraping
Fixed-Price - Expert ($$$) - Est. Budget: $7,500 - Posted
We have to build large database for marketing. Please let us know price for 10,00000 database. Long term opportunity for good team or company. Looking for low price and quick finisher 1. First Name 2. Last Name 3. Professional Title 4. Specialty 5. Organization Name 6. Address 1 7. Address 2 8. City 9. State 10. Zip 11. Phone 12. Email (verified)– This should be the individual’s direct email address, not a shared email address. Company email addresses such as info@medsouth.com do not qualify. The domain must be a company domain. Addresses from personal email – aol, hotmail, gmail, etc – are unacceptable. 13. Company URL
Skills: Web Crawler Data Entry Data mining Data scraping
Fixed-Price - Expert ($$$) - Est. Budget: $2,500 - Posted
Automation & softdev EXPERTS only! We are trying to emulate a real user in a real browser on a website that has advanced checks to stop bots. ~The scenario~ We have to interact with a certain website through a browser (clicks). There are multiple steps that have to be performed and on each step, the response page from the website has to processed by our app/code. For the last couple of months, we had a solution that uses a scriptable WebKit headless browser called 'PhantomJS' and it worked good without any flaws. Unfortunately, recently this website started detecting that we use 'PhantomJS' and our code no longer works. ~Your solution~ We need someone with fresh ideas who can help us restore our functionality. We have noticed that a normal browser works perfectly fine on the website while PhantomJS does not work and they will detect that we use PhantomJS. You need to come up with a solution that is able to use this website without being detected as a bot. You can use any method that is at your disposal, but the most likely solution will be automating an actual browser such as Chrome. VERY IMPORTANT: Your code/solution needs to be able to run multiple browsers at the same time! REALIZE that we need to be able to run all of your code from our C# or C++ app in Windows. (Your stuff has to be controlled from code.) IDEALLY we would like a solution similar to PhantomJS but more like a real browser. Looking forward to forming a long term business relationship with a skilled individual. Good work means more work!
Skills: Web Crawler Automated Testing Automation C
Fixed-Price - Entry Level ($) - Est. Budget: $20 - Posted
Looking for one or two to download pdf couple of thousand times from the link provided. Simple download no search no intelligence. Should have international vpn with dynamic IPs. Exp in web traffic would help.
Skills: Web Crawler traffic geyser
Fixed-Price - Intermediate ($$) - Est. Budget: $5,000 - Posted
I have a ton of works about extraction data from many of web pages from my clients. I need a special data scraper who have experienced on this area and can work with me long term for this (~6 months or more). The work is scraping data in from Amazon, Ebay, Alibaba and many others. Please tell me your ability and show me some of your portfolios in order to make me understand you clearly and easy for me to make choice. Thanks you.
Skills: Web Crawling Data Entry Data mining Scrapy