We have a need to establish a long term relationship with someone that is skilled in large data management, and database administration. We are currently using Microsoft Access for our reporting and data maintenance, but we will soon be transitioning to MySQL or another setup that allows us to more efficiently store, analyze, and retrieve data.
As an attempt to get quick insight into your skill set, we have an initial task we are seeking assistance with.
1. Assist in opening and filtering a large file (4.5 GB, and 13 million records) so that we can narrow it down to a smaller sized file. Once applied, the query should filter the file to around 2 million records.
Note that the file is available to us via FTP (and was originally a .dat format).
The need is simply to apply the following filter to the text file:
(A). On Hand Quantity > "00000000"
(B). Price >50
(C). Select ALL columns (or simply the following columns, if it makes it easier: GTIN Prefix, ISBN-10, Price, On-Hand Quantity, Discount Level, Publication Date, On Sale Date, Product Classification Type, and Product Type
2. Ensure that we are able to access the resulting reduced file within Microsoft Access, whether through an ODBC connection, link to txt file, or placing the file directly in Access
Thanks for your interest in working with us. We hope you can use this task to establish a long term relationship and help us craft a long term strategy for managing our data.