Looking for an experienced database administrator that will help us optimise our database infrastructure for fast querying.
The database has only one big table containing five columns:
- A: Varchar(20)
- B: Varchar(20)
- C: Integer
- D: Timestamp
- E: Varchar(1)
There are 100s millions of rows for a total size of 50GB. The DB is updated daily (new data coming in) and is integrated within our analytical framework. It is queried by only one client at the same time, mainly through SELECT, using filter on A, B, C, D, E or any combinations of these columns.
The main constraint is the RAM of the computer (16GB) and we are using PostgreSQL at the moment. We are open to another framework if it is justified.
Deliverable: bring down the process time of each query down to an acceptable level (below 1s).