Record temperature data as a SQLite database
Paul Ford recently talked about sharing data as SQLite files as one of two good ways to share data (the other being UTF-8 text files). I'd never heard of using SQLite as an interchange or distribution format before but it sounds like a great idea.
I've been playing with data from ThreadEx (short for "Threaded Station Extremes") and wrote some code to parse their text files and put everything in a database. My ultimate goal is to build something to explore record temperatures. I've built a simple web app that makes it a bit easier to navigate the data but that's not what this post is about.
The data from ThreadEx is relatively small but it has its quirks. Unless I'm missing something, it's a home-grown format so I thought it might be worthwhile to share my data munging scripts and a copy of the resulting database. Scripts and data are over on github: threadex-to-sqlite.