February development review: Sharing is caring

Added by Brett Smith about 6 years ago

Once you've found an interesting result in your analysis, you don't want to keep it to yourself. You want to share it with the world! The Arvados development team just wrapped up a sprint making it easier than ever to share those results, along with the pipelines and data that generated them.

Public Workbench sharing

Workbench public sharing screenshot

The Arvados Workbench already makes it simple to share your work with other Arvados users. We've extended that to let you share with people who don't have logins on your cluster. Once you do that, anyone can visit that page to view everything in it: collections of input and output data, Arvados pipeline templates, and even the specific pipelines that have been run. You can make all of that available in just a few clicks.

It's worth noting that all of these features are opt-in. Projects are not shared by default, and site administrators have to set a specific configuration value to enable public sharing in Workbench.

Dockerized Web services using arv-web

Of course, in many cases you want more than raw data. You'd like to be able to view it through dedicated software to help find patterns or unique results. arv-web is a new tool to configure those services with Arvados data, complete with automatic updates for new results.

Here's how it works: you have a Web service that provides a nice interface to your data. You build a Docker image to run that application and read data from a dedicated directory. Now start arv-web and point it at your Arvados project. arv-web will run your Docker container, filling the data directory with files from the latest collection in the project. As new collections are published (for example, because pipelines finish), arv-web automatically updates the Docker container's data directory, and can even run a reload script inside it. You get a nice view to your data that stays in sync with your latest results.

We're really looking forward to seeing what you all build with these new features. You can try them out on our public beta, and feel free to get in touch by IRC or e-mail to learn more.

Pathomap.png (98.2 KB) Pathomap.png Workbench public sharing screenshot Brett Smith, 02/23/2015 06:01 PM Delete