You will get any data from web pages automatically with email report
Project details
I have experiences: 20+ years as Software Developer, 10+ years as Data Engineer, 5+ years as WebCrawling, and 3+ years as InfoSec. (total 22+ years experiences in ICT).
Therefor you will get high quality, modular, and enhance able script.
Therefor you will get high quality, modular, and enhance able script.
Data Tool
PythonWhat's included
| Service Tiers |
Starter
$43
|
Standard
$57
|
Advanced
$96
|
|---|---|---|---|
| Delivery Time | 3 days | 3 days | 4 days |
Number of Pages Mined/Scraped | 1 | 3 | 6 |
Number of Sources Mined/Scraped | 1 | 1 | 1 |
Number of Revisions | 1 | 3 | 9 |
Optional add-ons
You can add these on the next page.
Fast Delivery
+$36 - $90
Additional Page Mined/Scraped
(+ 1 Day)
+$31
Additional Source Mined/Scraped
(+ 1 Day)
+$17
Additional Revision
+$7
Multiple output format
+$10
Multiprocessing
(+ 1 Day)
+$36
Intergrated with ohers platform
(+ 1 Day)
+$20About Anwar
Software and Data Engineer
Bogor, Indonesia - 11:24 pm local time
Let me introduce my self:
Hold master degree of Information Technology since 2004.
Experiences: ICT 22+ years, Software Developer 10+ years, Data Engineer with huge data 10+ years, InfoSec: 3+ years
Industry background: Telecommunication (Intelligent Networks).
Familiar with UNIX, Cloud Environment
Create custom software to handle data from/to many source/target/format: web (crawling), json, xml, csv, excel, text, sql, mml, pmml, arff, text, binary, etc.
Also can retrieve data directly from the compressed file (tar.gz) like find specific information from files inside the compressed file.
End-to-end process: collect/retrieve, extract, modify, integrate, analyze (anomaly, pattern, insight), update, reporting (visualization), and send the result to other process.
Tools:
python, perl, unix (awk, sed. shell, join, etc.), knime, talend, tableau, sql, selenium, etc.
Highlight on personal big project (one man developer):
1. on 2006 build tools to process data that run on unix server FSC PrimePower 1500, HW cost USD1 million (dedicated server, no other tools running on it)
- system: unix
- tools: perl, shell
- run everyday
- data source: CDR from 35 Intelligent Networks
- data size: 65GB /day
- report: excel
2. on 2018 build tools to process with multiprocessing (32-cores) on GCP
- system: ubuntu (Cloud)
- tools: python
- run on demand
- data source: GdmDataExport (tar.gz)
- data size 260GB (bulk data)
- output: csv
3. on 2021 build tools to collect data from web (Indonesia Stock Exchange), running everyday
- system: windows 10
- tools: python, selenium, knime, postgreSQL, chrome web-driver
- run everyday
- data source: web, xml
- data size: 1.7GB /day
- output: json, dbms
I will working at any day and any time, but be aware that on normal activities (no project) I will be active to be response at 08:00 - 21:00 Indonesia Time (GMT+7)
Please Hire me.
Thank You,
Anwar
Steps for completing your project
After purchasing the project, send requirements so Anwar can start the project.
Delivery time starts when Anwar receives requirements from you.
Anwar works on your project following the steps below.
Revisions may occur after the delivery date.
Send the pre-release script to be reviews
- Complete project will be send before due date, - Customer review, testing, send the feedback, and request for some correction - I will fix the script ASAP, then send the final release of the script.