Project

General

Profile

2014-04-16 Dev tools and dataresource management » History » Revision 2

Revision 1 (Anonymous, 04/14/2014 03:48 PM) → Revision 2/9 (Tom Clegg, 04/16/2014 11:07 AM)

Retrospective h1. 2014-04-16 Dev tools and data/resource management 

 h1. Arvados Private Wiki 

 This wiki is internal to Curoverse, Inc. 

 h2. Development Process and Tools  

 * [[Summary of Development Process]] 
 * [[DevOps To Do List]] 
 * [[Release Roadmap]] 
 * [[Sprint Retrospectives]] 
 * [[Gem and Pypi publishing instructions]] 
 * [[Hacking API server]] 
 * [[Hacking Workbench]] 
 * [[Redmine wishlist]] 

 h2. Operations 

 * [[4xphq]] private beta instance 
 * [[Deploying a new Arvados instance]] 
 * [[Updating an Arvados instance]] 
 * [[Running tests]] 
 * [[Tech FAQ]] 
 * [[Distributing encrypted disks]] 
 * [[Cluster install instructions]] 
 * [[Deploy instructions]] -- installing and updating Arvados API server and Workbench on production systems 
 * [[New PaaS user activation]] 
 * [[Setting up a private VM for a user]] 
 * [[gps:Amazon setup and notes]] (in GPS project) 

 h2. System/component designs and specifications 

 * [[Functional components]] and where they live in the source tree 

 h3. Keep 

 * public [[arvados:Keep server]] specification @ Arvados 
 * public [[arvados:Keep index]] design in progress @ Arvados 
 * public [[arvados:Keep manifest format]] specification @ Arvados 
 * [[Keep Specification]] describes current Perl prototype 
 * [[Next generation keep]] 
 * [[Using Keep with S3 backing store]] 
 * [[Keep federation]] 

 h3. Other infrastructure 

 * [[Crunch]] 
 * [[Event bus]] 
 * [[Logging facility]] 
 * [[Metadata database]] 
 * [[EC2 compute node life cycle]] 

 h3. User interface 

 * [[Workbench UI design]] 
 ** [[Presenting a set of jobs]] 

 h3. Accounts and permissions 

 * [[User activation states]] 
 * [[Permissions model]] 
 * [[Terms of Service mechanism]] 
 * [[Pre-activation mechanism]] 

 h2. Research notes - related projects 

 * [[Alternative cluster storage systems]] 
 * [[Alternative MapReduce and cluster scheduling systems]] 
 * [[Remote Procedure Call systems]] 
 * [[Metadata database]] 
 * [[Openstack Notes]] 
 * [[Message bus]] 
 * [[Galaxy]] 

 h2. Data curation references 

 * [[Copying PGP data to AWS]] 
 * [[Importing PGP survey data to Arvados]] 

 h2. Admin references 

 h2. Introductory material for people new to Curoverse/Arvados 

 * [[Background Reading]] 

 h2. Customer Development 

 Materials such as a user personas, business strategy information, and notes on customer visits are stored in "Google Drive":https://drive.google.com (and other places?). 

 h2. Archives 

 These are pages that are no longer active or relevant  

 * [[Release 1]] 
 * [[Meeting notes]] 
 * [[API]] 
 * [[Permission model]] 
 * [[Source tree overview]] 
 * [[Demo 2013-02-05]] 
 * [[Project status]] 
 * [[Ruby client quick start]] 
 * [[Command line examples]] 
 * [[Admin and system API examples]] 
 * [[Explorvos]] sample API client, orvos-explorer 
 * [[Admin Interface]] (from Orvos days) 
 * [[Orvos-server install and bootstrap]] 
 * [[Compute node setup]] 
 * [[Underlying technical decisions]]