Project

General

Profile

Actions

Idea #6319

closed

Add API endpoint for backend tables

Added by Abram Connelly about 9 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
Publishing
Target version:
-
Start date:
06/12/2015
Due date:
Story points:
0.5

Description

Add an API endpoint to serve the backend public facing database tables. These include:

  • users
  • medications
  • user_files
  • datasets
  • immunizations
  • conditions
  • demographic

Each of these should have at the least some RESTful API access point to download a csv/tsv file. For example, something like 'https://my.pgp-hms.org/download/users.tsv'.


Subtasks 1 (0 open1 closed)

Task #6433: Review 6319-csv-exportsResolvedWard Vandewege06/12/2015Actions

Related issues

Related to Tapestry - Idea #6257: Add public facing database dump, cron job and Arvados uploadIn ProgressAbram Connelly06/29/2015Actions
Related to Tapestry - Bug #7395: Fix wrong column headers and "real name" content in /exports/users.csvResolvedTom Clegg09/29/2015Actions
Actions #1

Updated by Tom Clegg almost 9 years ago

  • Category set to Publishing

6319-csv-exports @ 81aeac2 adds /exports/phrccr_lab_test_results.csv. If this approach looks OK, I can add more CSVs along the same lines.

It takes about 50 seconds to download 200K rows from a PGP-HMS-sized database. Not great, but surely better than scraping. I'm hoping/expecting this export will be the slowest of the lot.

Actions #2

Updated by Tom Clegg almost 9 years ago

  • Status changed from New to In Progress
  • Assigned To set to Tom Clegg
  • Target version set to 2015-07-08 sprint
  • Story points changed from 2.0 to 1.0
Actions #3

Updated by Tom Clegg almost 9 years ago

At 3f83921 with
  • /exports/users.csv
  • /exports/datasets.csv
  • /exports/user_files.csv
  • /exports/phrccr_lab_test_allergies.csv
  • /exports/phrccr_lab_test_conditions.csv
  • /exports/phrccr_lab_test_demographics.csv
  • /exports/phrccr_lab_test_immunizations.csv
  • /exports/phrccr_lab_test_results.csv
  • /exports/phrccr_medications.csv
  • /exports/phrccr_procedures.csv

master at 6fa6b0f - 574 tests, 1232 assertions, 252 failures, 45 errors
6319-csv-exports at 3f83921 - 585 tests, 1270 assertions, 245 failures, 46 errors

Actions #4

Updated by Brett Smith almost 9 years ago

  • Target version changed from 2015-07-08 sprint to 2015-07-22 sprint
Actions #5

Updated by Tom Clegg almost 9 years ago

  • Story points changed from 1.0 to 0.5
Actions #6

Updated by Ward Vandewege almost 9 years ago

6319-csv-exports LGTM

Actions #7

Updated by Ward Vandewege almost 9 years ago

  • Status changed from In Progress to Resolved
Actions #8

Updated by Ward Vandewege over 4 years ago

  • Target version deleted (2015-07-22 sprint)
Actions

Also available in: Atom PDF