You will get Data Analysis / Transform from / to any data format
Project details
I have experiences: 20+ years as Software Developer, 10+ years as Data Engineer, and 3+ years as InfoSec. (total 22+ years experiences in ICT).
Therefor you will get high quality, modular, and enhance able script.
I can Extract data from any file data format, Transform / Modify (analysis, filtering, join, etc), and Load to any data format.
I have fix several Oracle glitch on production, Fix the impact subs data (100K from 1.6M) from user event logs and Oracle logs (using regex on perl), compare the data on Oracle Query, then build XML batch file for fixing the inconsistent data.
Therefor you will get high quality, modular, and enhance able script.
I can Extract data from any file data format, Transform / Modify (analysis, filtering, join, etc), and Load to any data format.
I have fix several Oracle glitch on production, Fix the impact subs data (100K from 1.6M) from user event logs and Oracle logs (using regex on perl), compare the data on Oracle Query, then build XML batch file for fixing the inconsistent data.
Project Type
Data Analysis, Development, IT, File Conversion, QAWhat's included $50
These options are included with the project scope.
$50
- Delivery Time 3 days
- Number of Revisions 1
Optional add-ons
You can add these on the next page.
Fast 1 Day Delivery
+$100
Additional Revision
+$10About Anwar
Software and Data Engineer
Bogor, Indonesia - 2:39 pm local time
Let me introduce my self:
Hold master degree of Information Technology since 2004.
Experiences: ICT 22+ years, Software Developer 10+ years, Data Engineer with huge data 10+ years, InfoSec: 3+ years
Industry background: Telecommunication (Intelligent Networks).
Familiar with UNIX, Cloud Environment
Create custom software to handle data from/to many source/target/format: web (crawling), json, xml, csv, excel, text, sql, mml, pmml, arff, text, binary, etc.
Also can retrieve data directly from the compressed file (tar.gz) like find specific information from files inside the compressed file.
End-to-end process: collect/retrieve, extract, modify, integrate, analyze (anomaly, pattern, insight), update, reporting (visualization), and send the result to other process.
Tools:
python, perl, unix (awk, sed. shell, join, etc.), knime, talend, tableau, sql, selenium, etc.
Highlight on personal big project (one man developer):
1. on 2006 build tools to process data that run on unix server FSC PrimePower 1500, HW cost USD1 million (dedicated server, no other tools running on it)
- system: unix
- tools: perl, shell
- run everyday
- data source: CDR from 35 Intelligent Networks
- data size: 65GB /day
- report: excel
2. on 2018 build tools to process with multiprocessing (32-cores) on GCP
- system: ubuntu (Cloud)
- tools: python
- run on demand
- data source: GdmDataExport (tar.gz)
- data size 260GB (bulk data)
- output: csv
3. on 2021 build tools to collect data from web (Indonesia Stock Exchange), running everyday
- system: windows 10
- tools: python, selenium, knime, postgreSQL, chrome web-driver
- run everyday
- data source: web, xml
- data size: 1.7GB /day
- output: json, dbms
I will working at any day and any time, but be aware that on normal activities (no project) I will be active to be response at 08:00 - 21:00 Indonesia Time (GMT+7)
Please Hire me.
Thank You,
Anwar
Steps for completing your project
After purchasing the project, send requirements so Anwar can start the project.
Delivery time starts when Anwar receives requirements from you.
Anwar works on your project following the steps below.
Revisions may occur after the delivery date.
Send the pre-release script to be reviews
- Complete script will be send before due date, - Customer review, testing, send the feedback, and request for some correction - I will fix the script ASAP, then send the final release of the script.