I have a quick project for someone who has experience with spatial data (GIS) and shapefiles. I am looking at historical weather data from NOAA and I want to calculate the average daily max temp, min temp, and precipitation within geographic units of interest (like US state and county borders) and create a database of these values. The database should automatically collect, process, and incorporate new daily weather history as it is released. Project should be done entirely on a cloud service like Amazon AWS or Microsoft Azure, with source code in a version control system. If this project goes smoothly, there are follow on projects involving forecast data (GFS, etc). But for now, please quote a price for just this initial job.
The weather data is published by NOAA here: ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily/by_year/
After unzipping the files, the data looks like this:
The readme offers a full explanation, but mainly what you’re looking at is weather station, date, variable, value. This file contains the latitude and longitude of each station.
You can use any GIS program you want as long as it’s free and open source.