You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Crawlers Jobs

56 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Hourly - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
Need A data extraction, web scraping expert needed for ongoing data mining activities. Need to be able to use import.io and or scrapy.org for extracting data. I will give you instructions on the data I need and I need you to build a crawler/extractor that will find the information and present it in csv format I also need you to find information on latest blogs, social media mentions, etc of my topics and people and compile it into data I can use. Respond with what you can do Software you work with work you have completed time frame to start getting data
Fixed-Price - Est. Budget: $ 300 Posted
### Expert Level ### Please reply with real world examples ?? If you have experience with a bloom filter please let me know. Hi I have a version of the application already built but isn't performing as I had hoped. I need a developer to help me improve the application in terms of performance and accuracy. Below are what I want to happen so be clear in your replies that you can perform this type of work. - Web scraping sort of works, but really needs to become multi-threaded and a lot more robust (currently breaks lots), the basic stack is below but I'm not adverse to other technologies being used. - The crawler aims to collect 100's millions of rows of data from numerous content networks, so the crawler needs to be able to manage that number of rows and the complications that bring to the table. - Post content to social networks, current app doesn't post in the correct format (weird categories) so that needs to be fixed. Basic headlines - Create multi-threaded...
Hourly - Est. Time: 1 to 3 months, 10-30 hrs/week - Posted
The task is to implement a focused Web crawler component comprising an API and a Web-based GUI. The focused crawler's objective is to gather user-specified pieces of data from Web pages using two strategies: (1) by carrying out a set of Web search engine queries for user-provided query terms, by downloading Search Engine Result Pages, and optionally following the hyperlinks contained therein; and (2) using a set of user-provided seed URLs, by following the hyperlinks on the Web pages identified by these URLs, using a breadth-first search and a user-specified depth. Rather than implement from scratch, the project should be pursued as wrapping existing open-source components such as crawler libraries and Web search engine APIs with additional layers of functionality, and in some cases, providing a convenience layer that hides complexity. Skills/technologies: Java, Heritrix, WARC, search engine technology, crawling, Yahoo BOSS
Fixed-Price - Est. Budget: $ 150 Posted
I need scrape and parser to xml akomantoso version, of http://www.concejodebucaramanga.gov.co/descargas.php?seccion=NQ==&categoria=MQ== and http://www.concejodebucaramanga.gov.co/descargas.php?seccion=NQ==&categoria=OA== I have 2 scripts templates for that only need create regualar expressions for that council chamber. Examples: https://comision6senado.files.wordpress.com/2013/03/acta-10-12-septiembre-18-de-2012.pdf converted to http://senado.felipeurrego.com/comisi%C3%B3n-sexta-senado/2012/septiembre/acta-no-10-18-09-2012.an I need test experience and skills with http://www.concejodecali.gov.co/documentos.php?id=502
Hourly - Est. Time: 1 to 3 months, Less than 10 hrs/week - Posted
We work in the software "Visual Web Ripper"; targeting a specific type of information. To import into Magento as products and imformation It will be your job to customize this template to fit each target site and to deliver your work to our import system.. It can take everything from 15 minutes to 5 hours to create a crawler (depending on the complexity of the target site). You will be paid per hour for your work We are looking for a person long term Requirements: -Expert skills in creating crawlers with Visual Web Ripper -Expert skills in .NET syntax/scripting -Available on Skype.
Hourly - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
Need a you to find companies doing plastic injection molding. I will set up a google online excell sheet that I need you to fill in with company name, web site, address, contact, email. Will also need you to follow and ad them to my facebook, twitter or linked in account Do not spam me with you complete work history, I will not read it, and I will delete it, just let me know: 1. If you can use google excell sheets. 2. Can you write and speak English to a decent level. 3. Your best hourly rate. 4. How many contacts can you input in one hour, roughly. I am on a very tight budget, so please make your bid reasonable.Please use my name when applying. Colm.
Fixed-Price - Est. Budget: $ 500 Posted
I am a Life Insurance agent and am in need of two lists for my telemarketers to call to sell individuals and businesses Life Insurance plans. The 1st list would be for all individuals in California. The filters are below. 1) First & Last Name 2) Address 3) Phone Number(s) 4) Ages 30 to 50 5) Household Income of $100k + 6) Own a Home 7) At least 1 Dependent (Spouse, Children) ***Could use Marital Status 8) Email(s) ***Preferred but not required The 2nd list would be for all business owners in California. The filters are below. 1) Business Name 2) Owners First & Last Name 3) Address 4) Phone Number(s) 5) Privately Owned Company (NOT Publicly owned) 6) Gross Sales/Receipts of $1 Million or More 7) Email(s) ****Preferred But Not Required I am open to any other suggestions on filters for both the individuals and business owners lists. Ideally the person I hire has already created similar lists and can provide an example. I would like the lists formatted in Excel/Google...
Hourly - Est. Time: Less than 1 week, 10-30 hrs/week - Posted
We're a consumer electronics startup prepping up our pre-sales campaign. We need someone to harvest emails or sell us lists for the following customer segments. - Teachers, principals at elementary, middle and secondary schools. - Emails from home-school associations - Emails from crowdfunding enthusiasts (fans, professionals, businesses, bloggers, etc.). - Incubators, accelerator programs for tech hardware, artificial intelligence and robotics Our geographical markets are: UAE, Saudi Arabia, India, Germany, UK, USA, Canada, Australia. You can sell us your existing lists.
Fixed-Price - Est. Budget: $ 500 Posted
See attached sheets but in a nutshell: single sign on : user signs into Muddleme and via our web crawler we sign them into all merchants in our network that have loyalty programs This single sign on loyalty app will also be tied into our ad serving platform on the muddleme merchant side of the business - we need to be able to Add new merchants to the loyalty program application if they have a loyalty program or want loyalty program associated with our platform