If you're a database guru, preferably MS SQL server, this should be a fairly straight forward project.
I sell products online. I use an auction website that I have to list products on. I have an HTML template which I fill in the variables using product data from 4 different product suppliers.
My suppliers update their data a few times a day, I would like a SQL procedure to automatically download, import, and repopulate the data into the HTML template each day. That way everytime my suppliers add a new product, it would automatically be added to my online inventory.
Each supplier has between 15,000 and 45,000 products. Each supplier will have some unique products, but many will overlap.
Even though some items will be the same across each supplier, I still want to assign unique product ID's (SKU) to every single product. I'll need this for my point-of-sale system I'm working on down the road.
I'm open to other programming languages, but I choose SQL because I am somewhat familiar with SQL so I can make small changes myself if necessary.
I have 5 different suppliers
1 HTML template
I need to automatically download (HTTP and FTP) these datafiles (some CSV, XLS, Access DB)
The "script" or "query" should run 4 to 6 times per day to recomplie this product data into a database. There should be a field in the database that holds all of the HTML data.
I have current examples that I can send over to you, but they are greater than 5MB so I can't attach them to upwork.com's site.
Data is in the following folder so you can see what we're working with. You won't need all files, just some of them.
5 of these suppliers have data, 2 will not so ignore them.
Main data files (you can see these in dropbox link)
chattanooga - InventoryList_08_24_16_Morgan.xlsx
greensupply - gsprods.xls
gzanders - zandersinv.csv & detaildesc.xml (more data that needs imported about each product)
williams - willshoot_items.czv
rsr - rsrinventory-keydlr-new.txt & attributes-all.txt
These files won't always be in dropbox, they are available via FTP and HTTP download from suppliers. I want to COMPLETELY automate this process. Download, and import into on big master table that I can work with.
The HTML template is also included in this Dropbox link.
Feel free to ask questions, maybe you have a better idea about how to do this?