Add public facing database dump, cron job and Arvados upload
There is code to do a dump of the public facing data. Merge it into Tapestry, create a cron job to automatically run on a daily basis and have it upload to an Arvados project.
#2 Updated by Abram Connelly over 6 years ago
After speaking with Tom, the first step in this is to create a RESTful API interface for access points to the various tables for download. For example, something like:
Once that API is in place, a script can remotely download the relevant tables, collect results and create a stand alone SQLite database, say.