Add public facing database dump, cron job and Arvados upload
There is code to do a dump of the public facing data. Merge it into Tapestry, create a cron job to automatically run on a daily basis and have it upload to an Arvados project.
Updated by Abram Connelly about 7 years ago
After speaking with Tom, the first step in this is to create a RESTful API interface for access points to the various tables for download. For example, something like:
Once that API is in place, a script can remotely download the relevant tables, collect results and create a stand alone SQLite database, say.